Hacker News new | ask | show | jobs
by rspoerri 806 days ago
I hope i get it to run on my 96gb m2 in q4.
1 comments
rspoerri 806 days ago
It actually does, in case anybody wonders. But it seems as if it's not fine tuned to chat, or i'm doing it wrong at the moment. Getting a lot of duplicates and non useful answers.
link
cyanydeez 806 days ago
They might've tweaked the prompt tokens.
link