|
|
|
|
|
by mbitsnbites
539 days ago
|
|
When measuring the errors I exhaustively iterate over all possible floats in the range [1, 2), by enumerating all IEEE 754 single precision representations in that range. That's "only" 2^23 numbers, so perfectly doable. My selection criteria was abit complex, but something like this: 1. Maximize number of accurate bits in the approximation. 2. Same in NR step 1, then NR step 2 etc. 3. Minimize the max error in the approximation, and then the avg ertor in the approximation. 4. Same for NR step 1, 2, ... |
|