Hacker News new | ask | show | jobs
by guywhocodes 565 days ago
This is par for Ollama, look at the log_probs issues/prs and you get an idea of how well Ollama is run.

Ollama is IMO a model downloader for llama.cpp so you can do roleplay with ease.