|
|
|
|
|
by olliej
1349 days ago
|
|
So my interpretation of the neural hash approach is largely that it is essentially trading a much larger number of very small “neurons” vs a smaller number of floats. Given that I’d be curious about what the total size difference is. I could see the hash approach at a functional level resulting in different features essentially getting a different number of bit directly, which be approximately equivalent to having a NN with variable precision floats, all in a very hand wavy way. Eg we could say a NN/NH needs N bits of information to work accurately, in which case you’re trading the format and operations on those Nbits |
|