[dambi0]

What specific risks do you foresee with this approach?

[diroussel]

Seem totally fine to me. As long as you can rollback if the download is truncated or the crc checksum doesn’t match.

[chii]

> or the crc checksum doesn’t match.

which wouldn't exist if the api is simply just a single CSV file?

at least with a zip, the CRC exists (an incomplete zip file is detectable, an incomplete, but syntactically correct CSV file is not)

[NL807]

DROP DATABASE blah;

[aidos]

That’s not how COPY FROM works in postgres. You give it a csv and a table matching the structure and it hammers the data into the table faster than anything else can.