Hacker News new | ask | show | jobs
by dutchbrit 1342 days ago
Let’s say I have 10TB of data that I want to make searchable, and want to self host, what are my options with Meilisearch?
3 comments

Can I get your use case? What is the data you have to index? If it's logs, indeed, Meilisearch will not be the best fit. I would recommend https://quickwit.io. If it's structured or unstructured data, even if 10TB seems huge for our use cases, I would love to put you in contact with my engineering team. We would find a way to manage it.
There is "Run in production" guide in Meilisearch documentation https://docs.meilisearch.com/learn/cookbooks/running_product... It uses DigitalOcean, but self-hosting in the right environment should work in a close way.
Thanks for the link! I however still don’t know how I’d be able to scale meilisearch to index terabytes of data.
I'm curious also about your use case (disclaimer, I'm one of the cofounder of Quickwit). Do you want simple search with a basic UI? Or some dashboarding with grafana for example?

Thanks @qdequelen for pointing out Quickwit :)