topic Re: wrong result in simple computation in Application Development and Automation Discussions

wrong result in simple computation

Former Member — Tue, 23 Sep 2008 08:44:45 GMT

Hi Gurus

need help, i have a requirement for computing in vat ,in calculator it seems correct but in abap the result is different. this weird scenario i encountered.

all variables are in type p decimals 2.

netwr = 249.38

kbetr = 50.00

i try 2 approach.

vat = (netwr * ( kbetr / 1000))

and

tmp_var = kbetr / 1000.

vat = netwr * tmp_var

the result is vat = 1246.90

but in calculator or in excel is 12.469

any idea? thanks

Re: wrong result in simple computation

Former Member — Tue, 23 Sep 2008 08:47:40 GMT

Hi..

It is with the decimal declaration I suppose.. Could you try declaring it with p decimal 1 instead of 2 and check if ur getting the same result.

Regards,

Vishwa.

Re: wrong result in simple computation

Former Member — Tue, 23 Sep 2008 08:48:27 GMT

Hi,

Check whether the fixed point arithmetic is checked or not. This makes lot of difference. To check this Goto Attributes of your report, a pop up window appears. Here you have that checkbox Fixed Point Arithmetic. Check it, Save and Close.

Regards,

Swapna.

Re: wrong result in simple computation

JozsefSzikszai — Tue, 23 Sep 2008 08:48:38 GMT

hi,

two things:

1. pls. check if Fixed point arithmetic is ticked in Program Attributes

2. Always multiply first and divide later for higher accuracy.

hope this helps

Re: wrong result in simple computation

Former Member — Tue, 23 Sep 2008 08:48:38 GMT

hii

I think the problem is with the declaration... Just try the same calculation by declaring it with p decimal 1 instead of 2.

Regards,

Vishwa.

Re: wrong result in simple computation

Former Member — Tue, 23 Sep 2008 08:49:24 GMT

Please check if the 'Fixed point arithmetic' check box is ticked in the attributes of your program.

Re: wrong result in simple computation

Former Member — Tue, 23 Sep 2008 08:49:46 GMT

Check below code....

data: v_kbetr type p decimals 2,

v_netwr type p decimals 2,

v_temp type p decimals 3.

v_netwr = '249.38'.

v_kbetr = '50.00'.

v_temp = v_kbetr / 1000.

v_temp = v_temp * v_netwr.

write:/ v_temp.

Output is 12.469

Re: wrong result in simple computation

Former Member — Tue, 23 Sep 2008 08:51:01 GMT

u divide the result by 1000.

Regards

Anbu

Re: wrong result in simple computation

Former Member — Tue, 23 Sep 2008 08:51:12 GMT

Hi,

The below code is working fine

data: vat type p decimals 2,

netwr type p decimals 2,

kbetr type p decimals 2.

netwr = '249.38'.

kbetr = '50.00'.

vat = ( netwr * ( kbetr / 1000 ) ).

write : vat.

Output is 12.47

Regards,

Surinder

Re: wrong result in simple computation

MilindMungaji — Tue, 23 Sep 2008 08:51:12 GMT

IF your target field is of type P decimals 2 then it is coming 12.47, right result...............

Re: wrong result in simple computation

Former Member — Tue, 23 Sep 2008 08:56:17 GMT

Hi,

I have executed your code and made some chnages it is working fine copy paste the code and check

DATA: NETWR TYPE P VALUE '249.38',

KBETR TYPE P VALUE '50.00',

VAT TYPE P DECIMALS 3.

VAT = ( NETWR * ( KBETR / 1000 ) ).

WRITE: VAT.

VAT = 12.450

Hope this helps you.

Cheers!!

Re: wrong result in simple computation

Former Member — Tue, 23 Sep 2008 09:02:25 GMT

Hi,

Plz write the code this way it works try :

data: vat type p decimals 3,
      netwr type p decimals 2,
      kbetr type p decimals 2,
      tmp_var type p decimals 2.


netwr = '249.38'.
kbetr = '50.00'.


tmp_var = kbetr / 1000.

vat = ( netwr * tmp_var ).


vat = netwr * tmp_var.

write: vat.

o/p : 12.469.

thanx.

Re: wrong result in simple computation

Former Member — Tue, 23 Sep 2008 10:02:27 GMT

thanks to all it solve my problem, the bottom problem is FIX POINT ARITHMETIC though i have also the right formula and all of you. I love this forum...

hope you got all your points