Hacker News new | ask | show | jobs
by inferense 1130 days ago
what real use case did you use it for?
2 comments

For instance used it in conjunction with llama-index for knowledge management. Created an index for a whole confluence/jira of a mid-sized company, got good results with GPT, but for LLaMA of this size that use case was too much.
I'd argue 1k per month for mid-sized company is nothing, but I can understand where you are coming from.
Did you try instructor-xl? It ranks highest on huggingface.
Making demos to raise investment probably