|
|
|
|
|
by sieszpak
739 days ago
|
|
Unfortunately, researchers do not understand how LLMs work and they attribute their common known defects resulting from, among others, tokenization processes as irrational actions from a psychological point of view. It is known that the models cannot cope with mathematical operations or division into consonants and vowels - and these are the most serious allegations in the article... a weak article, written by dilettantes. |
|
> A common definition of a rational agent (human or artificial), which the authors adopted, is whether it reasons according to the rules of logic and probability.
Assuming that definition then LLMs clearly do not start from those two first principles; it is manifestly obvious that the rules of logic are not programmed into them explicitly, and since you acknowledge that LLMs cannot cope with mathematical operations (the underpinning of said rules) they also cannot have discovered either the rules of logic or probability implicitly.
Again, if relying solely on that definition (whatever the value of doing so) then it’s perfectly rational to label LLMs as irrational.