Hacker News new | ask | show | jobs
by paulluuk 1058 days ago
Show me I can save a considerable amount of time training a 70b parameter huggingface model by switching to Elixir, then we can talk about me learning a new language.
2 comments

The training costs and performance at that scale are mostly driven by hardware and I personally don't think language will make a large difference (I may be wrong).

Most of the Elixir Nx efforts are on inference, especially on how you can embed and scale it using concurrent and distributed patterns (see this post/video [1]). It may not be what you are looking for but we have more folks deploying than training models, so maybe they will find incentives to give Elixir a try. :)

[1]: https://news.livebook.dev/distributed2-machine-learning-note...

Seems like you didn't read even the first line as this article is directed at people already using Elixir who are currently doing ML stuff with Python.
I did actually read most of the article. Did you read the section immediately after that?

> Why is Python not Sufficient?

It then proceeds to make a case why Python would not have enough speed or support for parallel processing, which is what I'm disputing.