Hacker News new | ask | show | jobs
Making a vintage LLM from scratch (crlf.link)
21 points by croqaz 17 hours ago
2 comments

Nice project. I’m curious to see how it writes after instruct.
I am creating my tiny Llama 340M base model from scratch. If you're curious about the steps, challenges and cost, read on. I am still working on the instruct model.