Hacker News new | ask | show | jobs
by ChrisNorstrom 1044 days ago
Paying customer here. I LOVE Modern CSV, I've been using it for massive CSV files that have 15+ million rows of data. I (same username Chris Norstrom) was the guy that emailed a bug fix on a large CSV with UTF-8 faulty characters I was working with.

I was wondering if you had added a feature to make selecting and deleting massive amounts of rows/collumns easier.

Currently: I have a CSV with 5 million rows, I want to delete all rows that have "/gallery/" in collumn B. I have to filter that row then I have to select ALL 2 million rows and delete them. But that's so many rows that ModernCSV gets stuck so I have to delete 5,000 or 10,000 at a time if I can remember correctly. And once it starts deleting there is no message, progress bar, or sound notification when it gets done. On very large CSVs this takes forever.

Request: I wish I can somehow ask ModernCSV to "delete all rows" if "collumn B" contains the string "/gallery/" and just click "RUN" then I can walk away and go work on something else until a sound plays and I know it's done.

Maybe you have something similar already implemented?

1 comments

When you select after filtering, are you doing a select all (ctrl+a or cmd+a in Mac)? Or selecting the top row and hitting shift+down to get to the bottom? Ideally, it shouldn't make a difference, but with the way it works now, it does. That's something I need to fix. If you do a select all, you can use the down arrow key to push the selection below the header.

I'll set up a similar file and see what I can do to improve this.

For now, one alternative is to filter OUT the data you want removed, then use the Remove All Filtered Out and Hidden Data command.