|
|
|
|
|
|
by nikvdp
925 days ago
|
|
|
This piqued my interest so I made an ollama modelfile of it for the smallest variant (from TheBloke's GGUF [1] version). It does indeed seem impressively gpt4-ish for such a small model! Feels more coherent than openhermes2.5-mistral which was my previous goto local llm. If you have ollama installed you can try it out with `ollama run nollama/una-cybertron-7b-v2`. [1]: https://huggingface.co/TheBloke/una-cybertron-7B-v2-GGUF |
|
|