Hacker News new | ask | show | jobs
by hskalin 930 days ago
I have also been trying to find good use cases. Currently I use Mistral 7B for summarization (when I want a tldr) and its good enough. Due to this I am thinking about setting up a RAG system based on my local notes using it. Although I could just use chatGPT for summarization (sometimes I do), but having a local LLM feels nice. They are uncensored so they can be used for some fun ropleplays as well.