Hacker News new | ask | show | jobs
by wizwit999 1235 days ago
Perhaps this is true for business data (though I'm skeptical of the claims), but, for example, for security data, this isn't true at all. Collecting cloud, identity, SaaS, and network logs/data can easily exceed hundreds of terabytes. A big reason why we're building Matano as a data lake for security.

It seems an odd pitch in general to say, hey my product specifically performs poorly on large datasets.

2 comments

On the contrary, identifying what your product is explicitly not aiming to do is extremely helpful. "Big" adds a lot of complexity and pain, most people don't do that, our product avoids the complexity and pain and is the best choice for most people. Seems like a good, simple pitch, and all it requires is the humility to say that your solution isn't the best for some use cases.
Sounds like you're in the "Big Data One-Percenter" category described at the very bottom of the article.