Hacker News new | ask | show | jobs
by sgt 26 days ago
Think they will not train on the dull 2TB but use that as the data lake to start and then apply a more targeted approach.
1 comments

if you read the article 2pb is available as flash storage in the data pipeline, used to dedupe, clean, normalize, etc, for training from 60pb of raw data.