Hacker News new | ask | show | jobs
by ayakang31415 663 days ago
I really like this concept. I SSH to my university HPC to submit Python script for ML related work (sbatch script.py), and sometimes I edit a script with VIM. Now I can use Jupyter Lab on HPC with port forwarding, but it is not as convenient as just running Jupyter lab locally. Does your software have some sort of command line features within Jupyter Notebook that can be run on HPC?
2 comments
jerpint 663 days ago
I recommend VScode for that use case (other editors probably support this too) where you can ssh to your cluster, access all your files in the tree, and run Jupyter notebooks from VScode directly using HPC resources, very nice workflow
link
bblcla 663 days ago
Yeah, I agree! We looked into integrating Moonglow with academic clusters, because many of my ML PhD friends complained about using them. We unfortunately haven't found a good generalized solution, so I think VSCode's remote SSH + manual server management is probably the best option for now.
link
samstave 663 days ago
I almost exclusively us VSCode to access remote hosts now. VSCode is my ssh client.

I havent had a personal jupyter need like this thread is about, yet - but I am a curious mind in search of tools to help me curious harder.

I need to find a project that lets me leverage moonglow.

I hope they got the name MoonGlow from Ultima:

>Moonglow

>>Moonglow is a city dedicated to magic and mystical arts, found on the island of Verity. The principle area of the city is fenced and gated, surrounding a maze from which teleporters connect to the more outlying shops and facilities. One of these, the Encyclopedia Magicka, contains a magical pentagram, which proves to be a further teleporter. Saying, or more discretely whispering, the password ‘Recdu’ while standing on this will transport you to the Lost lands, to a second pentagram in the town of Papua. The city’s tinkers have no dedicated shop, instead they can be found in the city’s bank.

Seems appropriate for this project...

even has a theme song: https://www.youtube.com/watch?v=XMRlwVmetcc

link
joouha 663 days ago
Toy could try using euporie [1] to run Jupyter notebooks in the terminal

[1] https://github.com/joouha/euporie

link