Hacker News new | ask | show | jobs
by onetimeuse92304 943 days ago
Also I know some of these databases. For example, if you use something like MongoDB with its default configuration, it will be slow as molasses. It will send 20 documents over the network (default cursor batch size) and then yield its time to the operating system and wait for further instructions.

If that document is just three small fields, then you just effectively succeeded receiving maybe couple packets before the server gave up. Pitiful.

Change the batch size to maybe 2 or 20 thousand, enable network compression, increase client read buffer size from its ridiculously low default size, and this could start looking more like a data transfer we expect.