|
|
|
|
|
by opcvx
4010 days ago
|
|
I have tried the code posted at the end of the article and it gives wildly incorrect results for input values in range of [ 0.5 , 1.5 ). Also for output, starting with multiplies of 4, values suddenly diverge and then start to converge towards correct value until the next multiple. Did I forget to do something with the result or is there a bug? |
|
The else block in the last if statement is missing this: signif = signif - 1.0; before the lg2 = FN; line.
Then the relative error becomes similar to what the bits of accuracy table predicts, which is very low.