Show HN: Pytablewriter – A python library to write a table with various formats

Y	Hacker News new \| ask \| show \| jobs

	Show HN: Pytablewriter – A python library to write a table with various formats (github.com)
	6 points by thombashi 3679 days ago

1 comments

jastr 3678 days ago

This is pretty cool!

What functionality does this provide that Pandas doesn't?

Can it handle tables too big for memory? For example, could I use it to read 10 gigs from PostgreSQL to a CSV.

link

thombashi 3677 days ago

I would recommend that divide one SELECT query for 10GB data into for-loop that smaller SELECT query (like 1MB-data/query) execution and writing table by using LIMIT and OFFSET clauses. In that way, you don't need a large amount of memory.

link