Hacker News new | ask | show | jobs
by spark1377485 393 days ago
PySpark is great, except for UDF performance. This gap means that Scala is helpful for some Spark edge cases like column-level encryption/decryption with UDF