I worked for a company that was working on foundation models for enterprise data just at the time that the first papers came out on BERT, which I have to admit, I didn't grasp the impact of at the time.
I remember the weird specificity of the solutions we were building, and in the dark times when other employees lost faith I'd tell them that our solution could deliver enough value that we'd likely be bought by one of our customers, which is what happened.
Interesting that now, in contrast, startups are desperate to claim any specificity at all for differentiation, with the general solutions being so powerful
One of the striking things about working in big enterprise is the number of policies , rules, guidelines especially in industries governed by industry regulators (eg ISO, FDA). Those with proper knowledge of the arcane bureaucratic systems can navigate it (with effort!). Those without get bogged down quickly. Current LLMs could be good at populating the document filler required in this area.
A properly trained “oracle” could be a big leg up to new hires at companies and new entrants to such industries.
Yeah that exact use case keeps coming up in my work - populating forms or structured documents based on retrievable information is possibly the best broad enterprise application category in terms of bang for buck!
I remember the weird specificity of the solutions we were building, and in the dark times when other employees lost faith I'd tell them that our solution could deliver enough value that we'd likely be bought by one of our customers, which is what happened.