[nofriend]

Nobody owns their data. They just scrape the internet, or pirate massive troves of books. Just forcing companies to get a license to all the data they use, let alone an open license, would be a massive impediment to the development of open models.

[pabs3]

It is definitely doable to get openly licensed data, you just have to do it via voluntary participation of crowdsourced data acquisition programs. For example the RNNoise model was retrained from such crowdsourced data.

[tedivm]

IBM did it with their Granite models.

[pabs3]

The data used for training Granite doesn't sound like it would be under FOSS licenses.

https://en.wikipedia.org/wiki/IBM_Granite