Hacker News new | ask | show | jobs
by campaign_tools 949 days ago
I think sound advice is not to rely too much on any one company now. I founded an AI-based startup that is harnessing LLMs with RAG to do cool stuff. My guiding philosophy when designing it was to be agnostic as much as possible. And so far that's worked out.

I can send my prompts to multiple different LLMs. My embeddings are mine, for the most part. I have the raw content, so I can always re-embed them if I decide I no longer want to use Cohere or OpenAI. There's also self-hosted vector embeddings using things like Huggingface models.

And in terms of vector databases for RAG? Those are mostly open source, so I'm not worried there. The truth is that LLMs are in an arms-race right now, so staying flexible is just a good business model.

If anything the firing of Sam just confirmed that I have made the right decision by maintaining flexibility. Relying too much on any one of these companies early on could be dangerous.