|
|
|
|
|
by youssefabdelm
479 days ago
|
|
Yep. I've often said RLHF'd LLMs seem to be better at recognition memory than recall memory. GPT-4o will never offhand, unprompted and 'unprimed', suggest a rare but relevant book like Shinichi Nakazawa's "A Holistic Lemma of Science" but a base model Mixtral 8x22B or Llama 405B will. (That's how I found it). It seems most of the RLHF'd models seem biased towards popularity over relevance when it comes to recall. They know about rare people like Tyler Volk... but they will never suggest them unless you prime them really heavily for them. Your point on recommendations from humans I couldn't agree more with. Humans are the OG and undefeated recommendation system in my opinion. |
|