Hacker News new | ask | show | jobs
by villager 2473 days ago
>>timequerylog For storing only or for data analysis as well?

Currently our postgres have something around 1 Tb which is already not so easy to play with.

1 comments

It's on npm. It has some simple query abilities. Also there is `tql-cli`. The basic idea is pretty simple, just that you use log files and query by date and time range and key and so you avoid querying or analyzing the entire dataset at once. Note that since it uses the disk with lots of files so much, the assumption is that you are on an SSD.