|
|
|
|
|
|
by rahimnathwani
1109 days ago
|
|
|
Hi Shawn, From yesterday's demo, it seemed to me that weave is a way to make easier the last few steps of aggregation/visualization, after you've done a bunch of your data joining and reshaping in pandas. (IIRC the starting point in the demo was a pandas dataframe.) But, during a break in the conference, I was talking with a W&B employee (a weave user, but not a member of the weave team) who said he thinks weave will eventually replace pandas. Is replacing pandas one of your goals for weave? |
|
|
You can do some amount of iterative and visual data transformation in Weave now. But maybe like 10% of what you can do with Pandas.
Pandas is awesome and lingua franca in data science, unseating it would be an incredible feat if anyone ever pulls that off.
The core data structure in Weave, ArrowWeaveList, has some advantages over a dataframe. It can represent arbitrarily nested data, store references to other object types that can't be stored in arrow (like images), and be visualized in the Weave UI.
For now, we just want to make it really easy to go back and forth.