|
|
|
|
|
by westandskif
2277 days ago
|
|
Pandas are great, but I had a few cases where I had frustrating experience -- dealing with Decimal & float columns is a pain (missing data without any signs when using both in calculations). However this was not the reason why I needed to build convtools, I needed to process reports, touching only some columns (without failing if an unrelated column is no longer processable). So I needed to reuse and combine python expressions across multiple procedures. There are no benchmarks at the moment, you can just pass debug=True to the gen_converter method to see the generated code and judge whether it's optimal for your use case.
This is a python library which generates simple python code:
- without unnecessary conditions and loops
- without keeping all items of iterable in memory to aggregate (it leverages reducers)
- making no use of C-extensions. |
|