Hacker News new | ask | show | jobs
by monegator 9 days ago
Feels like i'm missing the introduction paragraph in the repo.

What is LoRA in this context? the communication protocol? Or another term appropriated by LLMs? Why the speedrun?

3 comments

LoRa (Long Range) is a physical radio communication techniche.[1]

LoRA (Low-Rank Adaptation) is a parameter-efficient fine-tuning technique for large language models.[2]

[1] https://en.wikipedia.org/wiki/LoRa

[2] https://en.wikipedia.org/wiki/LoRA_(machine_learning)

Low Rank Adaptation. Google “Lora llm”
Yes but what are LoRAs being tested for / trying to do in this case? I couldn't find any information there about what the actual output goal is for the LoRAs. Speed doing what?
How long it takes to train that particular configuration. The table column is named "train time".
The author responds with reasoning here: https://news.ycombinator.com/item?id=48975473

The AI slop "why" section in the readme is completely useless. I struggle with this too. I start every project doc with a "why" then "overview" section, and AI is still horrendously bad at the "why", filled with vapid corpo/tech startup speak. I usually write the "why" myself, or at least put down the outline to be completed.