Y
Hacker News
new
|
ask
|
show
|
jobs
by
riku_iki
724 days ago
Base on numbers you put, you would need to have stable 50-100GB/s speed to your disc system to just read 3TB data in 40-60sec. Would you mind sharing your setup?
1 comments
winrid
724 days ago
That's only if you read everything, and if none is in ram. With a columnar DB you can just scan the values of the column you need.
link
riku_iki
724 days ago
Then 3tb of total data volume is irrelevant. What relevant is size of column.
link