[ramblenode]

> Why wouldn't our AI girlfriends suggest that we avoid sugary drinks, to keep the American workforce healthy, a la CCP public efforts?

Because most products you use come from people trying to make money.

> Or why wouldn't our AI girlfriends tell us exactly what they deem each of us want to hear? It seems like the AI girlfriend LLM that mirrors our preferences best would be the most appealing to the average Joe.

I'm sure they will... until it's more profitable to show a Monster ad. See the VC product cycle a la Netflix, Facebook, Google search, etc.

> To assert that a scary scenario is the most probable, without strong evidence, is fearmongering.

It's not the scary scenario. It's the status quo and it's the standard curriculum in bussiness schools all over the country.