I thought these things use a trawler style approach?
Bit like copilot is fond of spitting out copyrighted code I had assumed chatGPT would also have been trained without much regard to this