Hacker News new | ask | show | jobs
by tw000001 2210 days ago
>You only need one or 2-3 competiting Neuronal Networks for cancer detection and if you look how expensive it is to train that stuff, not many can actually do it anyway.

This is just wrong. You can train a cancer discriminator on a low end gpu on your desktop. The hard part is getting quality [often annotated] data - and thats why data brokers like Google are positioned to dominate.

1 comments

So why are those papers with good results are not running on 'low end gpus'?

I don't mean running them, i mean training them.

Which papers? There are thousands of papers being published.

There are a couple potential reasons. Powerful GPUs accelerate research and iteration. Some state of the art problems have hit the limits of current theory and make up the deficit by building massive nets - but even there we already have multiple automatic pruning/optimization algorithms to shrink those nets so that they work with smaller resources.

Make no mistake, the field is advancing exponentially. The state of the art googlenet/inception that arguably kicked off the whole craze with image recognition are laughably obsolete now and easily outperformed by simpler nets.

MNIST was the gold standard for recognition problems just a couple years ago, and now it's considered a solved toy problem.

If i google for it specificly, the paper in nature states:

"This study had some limitations. Mammograms were downsized to fit the available GPU (8 GB). As more GPU memory becomes available, future studies will be able to train models using larger image sizes, or retain the original image resolution without the need for downsizing. Retaining the full resolution of modern digital mammography images will provide finer details of the ROIs and likely improve performance." https://www.nature.com/articles/s41598-019-48995-4

Here they use a Nvidia V100 https://www.researchgate.net/publication/336339974_Deep_Neur...

Which yeah okay is more reasonable than i thought. But the advantage will still be at who ever has the hardware and thats just cheap for google.

You wouldn't need a market for models, you would just use whatever research delivers from whoever has the most accurate data & hardware.