Hacker News new | ask | show | jobs
by kfk 2527 days ago
Will you have a server too? Another issue is scheduling, triggers, etc.. You are in this strange space between Excel and “enterprise” ETL like Talend. We are so frustrated with the current poor state of data prep that we went to Python based workflows with the idea of scheduling, triggering, via Airflow. Seems to work well so far. But your IDE for data prep is a bit better positioned than what we use now (Jupyter).
1 comments

Actually, we provide a command-line interface, you can do pretty much everything the UI does with command-line. And you can also run it in server mode with command-line. In the current version, we haven't covered scheduling yet. A possible solution would be scheduling through Airflow BashOperator in airflow. Or we can implement scheduling solution into the server itself.