[rolisz]

But that still makes it great for RAG applications, where I want the answer to be based on my data, not on whatever it learned from the web.

[monkeydust]

Interesting. Anyone tried / benchmarked this for RAG?

[refulgentis]

yeah it's good. you'd want* to finetune this before using it (c.f. my reply to it's depressed and insults me for no reason whatsover? @ https://huggingface.co/microsoft/phi-2/discussions/61)

* by want, I mean need. People self-peasantized heavily on "censorsed models" and don't really understand how these work, and the SNR is out of wack because there's a 100000x more waifu creators and culture warriors than knowledgable people sharing on this subject