[benjaminwootton]

This is the way the industry is going. Table formats such as Delta, Hudi, Iceberg stored on cloud object stores.

Though it works amazingly well, it is certainly slower than ingesting the data to be stored and manipulated in native formats.