Hacker News new | ask | show | jobs
by lustigmacher 2231 days ago
Does anyone know what kind of GPU support for Spark is mentioned in this announcement? Are they talking about existing XGBoost acceleration, or is it something general-purpose?
2 comments
zetazzed 2230 days ago
This goes beyond the existing Spark+XGBoost GPU acceleration to include ETL, Spark SQL, etc. Coming for Spark 3. Full details here: https://www.nvidia.com/en-us/deep-learning-ai/solutions/data...
link
T-A 2230 days ago
At first glance, it seems general purpose:

https://www.zdnet.com/article/nvidia-and-databricks-announce...

"based on the open source RAPIDS suite of software libraries" […] "will allow developers to take their Spark code and, without modification, run it on GPUs instead of CPUs"

https://rapids.ai/

link