Hacker News new | ask | show | jobs
by swalsh 806 days ago
Is this Mistral large?
2 comments

Unlikely, this model has a max sequence length of 65k, while mistral large is 32k.
Not sure trying to download the torrent and checking it out
For those of us without twitter, how many GB is the model?
(hope this isn't against rules but) If you don't have Twitter, the magnet link is

  magnet:?xt=urn:btih:9238b09245d0d8cd915be09927769d5f7584c1c9&dn=mixtral-8x22b&tr=udp%3A%2F%http://2Fopen.demonii.com%3A1337%2Fannounce&tr=http%3A%2F%http://2Ftracker.opentrackr.org%3A1337%2Fannounce
262 gb
Ooof. I really need to pick up another HD, these model sizes are killer.

Lacking a godly GPU, I will probably hold off for a quanitized version which has the potential to run okish on CPU or my modest GPU, but really appreciate the info.