This is one of the reasons Databricks created Dolly, a slim LLM that unlocks the magic of ChatGPT. A homegrown LLM that can tap into/query the datasets of all the data in an organizations Data Lakehouse will be hugely powerful.
I am working with customers that are looking to train a homegrown LLM that they host and have blocked access to ChatGPT.