[adamhepner]

I regularly test applications that generate big CSV reports. As I don't always have influence on the input data (we want to test on real datasets pulled from production servers of our partners), I fall back to defining constraints that must be satisfied. I ensure that they remain satisfied by analysing the csv files with powershell (of all the tools).

I just find the magic of "import-csv bla.csv | where some condition | select some existing or calculated value | group | format-list | out-file output.txt" to be extremely helpful, it's like SQL for the csv files.

And the ability to question live services and parse JSONs, and cross-check with other reports, or merge multiple reports into one... It's indispensable.