|
|
|
|
|
by GuB-42
1151 days ago
|
|
That will not solve the problem, because when GPT doesn't have the answer, it will make one up by copying the structure of correct answers but without any substance. For instance, let's say your LLM has never been told how many legs a snake has, it knows however that a snake is a reptile and that most reptiles have four legs. It will then confidently tell you "a snake has four legs", because it mirrors sentences like "a lizard has four legs" and "a crocodile has four legs" from its training set. |
|