|
|
|
|
|
by opcvx
4005 days ago
|
|
I have found the bug. The else block in the last if statement is missing this: signif = signif - 1.0; before the lg2 = FN; line. Then the relative error becomes similar to what the bits of accuracy table predicts, which is very low. |
|