Hacker News new | ask | show | jobs
by LoganDark 10 days ago
GPT-3.5 was so nice because the safeguards were so easy to bypass and it wasn't lobotomized by RLHF. Newer models really don't hit the same spot and I'm not sure what I liked so much about that initial release. I look back at conversation logs I saved and I just can't replicate them nowadays.
1 comments
djmips 9 days ago
have you experimente with https://huggingface.co/HauhauCS/Qwen3.5-9B-Uncensored-Hauhau... to test that conjecture? It's very easy to try.
link
LoganDark 8 days ago
It looks like the practical limit for that on my hardware is ~130 t/s, which is just okay. Makes reasoning mode quite painful though.

(llama.cpp can't seem to exceed 30 t/s, I had Fable make me custom inference. that's why it took me a day to get back to you)

GPT-3.5 would repeat my prompt back in its own words for me to confirm. This model immediately runs with it and generates a lot of output. I would definitely need to use a harness that allows editing / cutting off generations.

Something I've noticed about models that have been specifically uncensored or trained to generate content is that they aren't very engaging to chat with. Maybe this is just because they weren't trained to chat at all (base models) but, it's hard to find a chat model that's been trained properly.

link