Hacker News new | ask | show | jobs
by brunokim 667 days ago
18k lines is very small, CSVs are fine as storage option.

My rule of thumb is that anything that fits into Excel (approx 1M lines) is "small data" and can be analysed with Pandas in memory.

1 comments

Hey, thanks for taking the time to reply. I won't be reaching 1M anytime soon, so good to know!