Y Hacker News new | ask | show | jobs

user: sleepyeldrazi created: 2021-06-03 karma: 72 Personal projects at https://git.kokoham.com/sleepy . Trying to optimize LLM inference frameworks for local models in speed, and explore interesting quants for size. submissions: 0 points | 0 comments Ask HN: Local model experiences with 'high-reasoning distill' finetunes 2 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments 0 points | 0 comments The only non-LLM-generated file in my repo 2 points | 1 comments 0 points | 0 comments