|
|
|
|
|
by xn
209 days ago
|
|
redo[1] with shell scripts has become my goto method of dealing with multi-step data problems. It makes it easy to review each step of data retrieval, clean-up, transformation, etc. I use mlr, sqlite, rye, souffle, and goawk in the shell scripts, and visidata to interactively review the intermediate files. 1. https://redo.readthedocs.io/en/latest/ |
|