Hacker News new | ask | show | jobs
by roseway4 908 days ago
While not as pretty (and mobile-friendly) as the original link, the calculators below support modeling LoRA-based training, alongside full finetuning.

https://huggingface.co/spaces/Vokturz/can-it-run-llm

https://rahulschand.github.io/gpu_poor/

3 comments

They seem to be broken when I try any HF ids besides what came preconfigured. e.g. just tried brucethemoose/Yi-34B-200K-DARE-merge-v5-3.1bpw-exl2-fiction or LoneStriker/shisa-7b-v1-3.0bpw-h6-exl2
Been looking for something like thos for a while! I googled a lot, and this link never popped up. I feel google search is regressing.
Second link hasn't been working for awhile.