Hacker News new | ask | show | jobs
by buremba 3912 days ago
I'm not sure about that because they say that SPICE is an in-memory query engine unlike BigQuery which is a distributed query engine that fetches data from a persistent distributed file-system. It seems to me more like Spark in-memory RDDs that caches data fetched from external data sources.

They also support incremental loading similar to Periscope.io which is actually quite cool. I would be great if they could give more information (syntax etc.) about SPICE.
1 comments
dskrvk 3910 days ago
> Built from the ground up for the cloud, Amazon QuickSight's Super-fast, Parallel, In-memory, Calculation Engine ("SPICE") uses a combination of columnar storage, in-memory technologies enabled through the latest hardware innovations, machine code generation, and data compression to allow users to run interactive queries on large datasets and get rapid responses.

The description sounds awfully similar to Spark, yet they say it's "built from the ground up", which I assume means "from scratch".

link