|
|
|
|
|
|
by gus_massa
4 days ago
|
|
|
A JIT for Python is hard because it's a very dynamic language. You can redefine the functions on fly or monkey path a class. Anyway, 99.99% of the hard calculation for LLM are done in libraries that are written in C. I once tried to rewrite a custom case of enisum in plain Python and it was very slow until I used gvectorize and other specialized stuff. |
|
|