|
|
|
|
|
by captrb
1532 days ago
|
|
I'm experimenting with using this VSCode feature to edit code on a Spark master, with the code storage on an EFS volume. So far, this seems to be allowing me to have a local-feeling environment, with a well-factored codebase that I can reference from a Jupyter notebook (inside VSCode), that has high-bandwidth and low-latency access to our data repositories. I can also choose to temporarily vertically scale the remote host if I want to run single-node operations (ie Pandas). |
|