|
|
|
|
|
|
by int_19h
311 days ago
|
|
|
That is an artifact of implementation. You can absolutely implement it using strict FP. But even if not, any given implementation will still do things in a specific order which can be documented. And then if you're running quantized (including KV cache), there's a lot less floating point involved. |
|
|