|
|
|
|
|
by andymatuschak
1618 days ago
|
|
It's an interesting pattern with academic HCI work like this. For instance, Shneiderman (who did legitimately innovative design work!) often claims not only Hyperties's hyperlink styling as an academia -> industry success story but also the iPhone keyboard: his group had done a series of usability studies on various tiny keyboard approaches. And yet Ken Kocienda, who actually created the iPhone keyboard, has told me he was unaware of this work (and in fact never surveyed prior work). I've heard the same story for CSCW interface elements. Not encouraging! |
|
I would merely roll my eyes at this (does it really hurt anyone to believe that 'Shneiderman designed the iPhone keyboard'? HCI people know almost all their work is useless anyway), but it leads people to greatly overvalue the role of theory and understanding in ML progress, and undervalue the role of compute. If you believe that resnets were invented by thinking hard to come up with a beautiful theory about identity transformations & gradient propagation, then you are going to make different forecasts and emphasize different things than if you knew the reality was that resnets had been repeatedly invented but failed because there wasn't enough compute to show that they worked on anything but toy problems like the swiss roll and the final invention of resnets was grad students throwing random archs at the wall to see what stuck who happened to have enough GPUs that they could show it worked amazingly well on ImageNet and then had to explain why mashing together multiple layers with additional connections did anything.