Hacker News new | ask | show | jobs
by andai 270 days ago
I'In the interest of escaping mode collapse, I've recently developed a fascination with the text/base models.

I haven't tested them much, but I did make a tiny GUI for talking to OpenAI's legacy Davinci-002. It's a completion model, so you prompt it by giving it a piece of text and it continues it in the same style. (If you ask it a question, it's likely to just respond with a question.)

https://jsfiddle.net/yxaL5z3c/

I've been wondering if it would be possible to create a chat like experience on top of a model like this, but the trick is that the data has to be formatted similar to what it's seen in the training. e.g. when I used "user:" and "assistant:" then it defaulted to making it sound like AI, because that was what the context implied. I tried "John" and "Steve", which worked better...