Hacker News new | ask | show | jobs
by mbrumlow 2733 days ago
What size restrictions are you worried about ?

*Note I work with software that regularly stores terabytes of data in sqlite.

1 comments

Heh I was thinking that > 1TiB of data in an sqlite db is a bad idea :).

How do you process that? The restrictions I had in my mind come from that it's infeasible to concurrently process a large dataset in mapreduce/bigquery style.

There are many different concurrence modules for sqlite. I can't see why you would have any problems with what you describe.

The systems I work with use it for backup data. We have many readers and writes. Some of those export a iscsi daemon that represents a block device from the backup that is then booted form.

spelling :(