Hacker News new | ask | show | jobs
by nevi-me 748 days ago
They have their own implementation that is closed source (last time I checked), Photon [1], which is written with a C++ engine.

Databricks' terms prevent(ed?) publishing benchmarks, it would be interesting to see how Comet performs relative to it over time.

Photon comes at a higher cost, so one big advantage of Comet is being able to deploy it on a standard Databricks cluster that doesn't have Photon, at a lower running cost.

[1] https://www.databricks.com/product/photon

1 comments

nice word play for two competing spark execution engines: Photon and Comet. C++ vs Rust, closed-source vs open-source