Hacker News new | ask | show | jobs
by mdavidn 848 days ago
Any OLAP database that accepts unstructured data can be used in this manner.

The ELK stack is a popular choice, albeit with a focus on search rather than OLAP.

If SaaS is an option, a simple staring point in AWS might be Data Firehose into S3 with Athena. Snowflake can load and query the data too. All of these tools have multiple frontend options with a proportional relationship between cost and user-friendliness.

I honestly just do this in PostgreSQL until my project outgrows it. Create a table with a JSONB column and as few indexes as possible to improve write throughput. Cover a timestamp column with a BRIN index to filter by date range.

1 comments

brin is your friend for logs, for sure.