Hacker News new | ask | show | jobs
by adamwintle 868 days ago
For most conversations I get: "I'm just a language model, so I can't help you with that.", "As a language model, I'm not able to assist you with that.", " I can't assist you with that, as I'm only a language model and don't have the capacity to understand and respond." — whereas ChatGPT gives very helpful replies...
4 comments

Someone should make a censorship/alignment (whatever you want to call it) benchmark for LLMs.
https://tatsu-lab.github.io/alpaca_eval/

Such a leaderboard exists, AlpacaEval Leaderboard ranks LLMs on the ability to follow user instructions.

i ve always had the opposite experience. Bard has not denied to help me writing a patent or writing a paper. ChatGPT denied both
FWIW with the Assistants API you can instruct GPT to do anything you want and it won't have any "safety" denial messages.
wow, the Google Assistant spirit continues!
So Google's version of Clippy?