[vorhemus]

I have a smiliar feeling. Humans have certain wishes or desires and use language as a vehicle to express their feelings. Language models in turn just predict the next best tokens based on a large corpus of training data without an agenda behind. Even if the result (the produced words) are the same, there is a fundamental difference if it was produced based on statistical data or with a goal in mind.