Show HN: Visualize Model Spikiness in 3D

[afunk]

Models are referred to as 'spiky' entities - they have relative strengths and weaknesses.

Model map visualizes these strengths and weaknesses in 3D and give you the ability to fly around this 3D space (there is a hidden Star Wars themed mini game for pilots brave enough to try).

Spikiness is an intuitive mental model but the typical way of visualizing this spikiness is a generic table.

Is this useful? Maybe?

Is it fun? Yes.

You should try the flight controls. Click anywhere then use WASD + mouse to fly. Shoot projectiles to explore nodes.

Built on top of 3D Graph OSS library I made for visualizing KBs in 3D: https://github.com/a-funk/3dGraph

[Terretta]

A spider graph or radar chart of mutually exclusive 1d characteristics conveys information through the geometry of 2d areas.

Here, the 3d is not conveying anything as the volumes within are not MECE qualia spaces -- like sorts or like kinds of things should share common volumes.

[afunk]

i think i actually need to dig for a broader breadth of benchmark scores. right now, taking from the model page means i get the 'best of' results. instead of tests where the model sucks - glm is bad at biology for instance.

im going to aggregate as many benchmarks from as many sources as i can

[SiempreViernes]

I though this would be something cool and useful like 3d visualisation of a loss landscape, instead it's pretty much the least useful multidimensional data visualisation I've seen.

Would have been a much better idea to do a 3d Chernoff face instead.

[afunk]

thanks for the idea i'll try that out

[dmonterocrespo]

The page is not working

[BugsJustFindMe]

> "Model map visualizes these strengths and weaknesses"

No it doesn't.

> "Is this useful?"

No.

> "Is it fun?"

Also no.

[afunk]

did you blow it up or not