Hacker News new | ask | show | jobs
by evolve2k 446 days ago
Something that would be insanely useful is if your tool could be users to do validations.

For example being able to define data types for each column and say required columns. And then run your tool as a validator and take the errors as an array that’d be amazing!

Coming from a dev who’s just over processing CSV files back into my apps.

3 comments

Reading CSV into a duckdb table will give you that, along with a table for the errors and reason for error: https://duckdb.org/docs/stable/data/csv/reading_faulty_csv_f...

Could definitely be done as a small little bash script

You should take a look at the Frictionless data library https://framework.frictionlessdata.io/docs/guides/validating...