Numbers: Cell format 'percentage' results in incorrect calculation
B2 := 0.7 (cell format number)
C2 := -ln(1-B1) -> 1.20397 (correct)
change B2 cell format to percentage
C2 := 120.397 (incorrect)
Numbers (11.2), MacOS (12.2.1)
B2 := 0.7 (cell format number)
C2 := -ln(1-B1) -> 1.20397 (correct)
change B2 cell format to percentage
C2 := 120.397 (incorrect)
Numbers (11.2), MacOS (12.2.1)
Result is correct. Easy mistake to make when the result is too wide to fit fully in the cell. Hide a few of the decimal places on that 120.397... or increase the cell width to see it all and you'll find a percentage symbol at the right of it. The input was a percentage so the automatic format for the formula result is a percentage. Change the format to "number" if you want it to show as 1.20397...
Result is correct. Easy mistake to make when the result is too wide to fit fully in the cell. Hide a few of the decimal places on that 120.397... or increase the cell width to see it all and you'll find a percentage symbol at the right of it. The input was a percentage so the automatic format for the formula result is a percentage. Change the format to "number" if you want it to show as 1.20397...
1.20397 = 120.397% is correct.
If you were expecting the result '1.20397%', you are misinterpreting 'percent'.
Translated to English, 'percent' means 'per hundred'
Expressed as a fraction, 1.20397 is the same as 1.20397/1 (or 1.20397÷1
A percentage is a fraction with the denominator 100.
Converting the fraction shown above from 'oneths' to 'hundredths' is a simple matter of multiplying both the numerator ( 1.203970 ) and the denominator ( 1 ) by 100.
1.20397 x 100 =120.397. 1 x 100 = 100.
1.20397/1 = 120.397/100 = 120.397 percent.
If you were expecting the formatted result to be 1.20397%, the decimal number to be formatted is 0.0120397.
Regards,
Barry
Thank you, I didn't see the % sign in cell C2 as the result was too wide.
Numbers: Cell format 'percentage' results in incorrect calculation