Hacker News new | ask | show | jobs
by furyofantares 1165 days ago
Very cool.

I'd love it if it gave me more info about the differences between some of the available models. I've been using GPT4 exclusively from the web interface; I don't know why I might select GPT4 vs GPT4-0314. I believe I do know why I want to use 32k, but others might not.

Basically, I'd want an explanation as to how these differ from what's available in the ChatGPT web-app.

The default temperature is 0.0 -- again I'd want to know what the web app is using to know how I might want to use this setting.

edit: I guess an answer is my API key is only valid for 3.5 anyway. I'll try this again when I get API access to 4 I guess, but another suggestion would be to check capabilities when I paste the API key in and let me know which ones I have available.

2 comments

The UI sure needs a bit of work. I'll try to add more information about the different models.

As for the default temperature, 0.0 is actually a bug ! I'll definitely fix that in the next release. The default intended value is 1.0. The API reference [1] describes what the temperature parameter does in more detail.

While doing some testing, I also noticed that the app disables streamed responses by default. Make sure to check the appropriate checkbox in the settings to get token-per-token answers !

[1] https://platform.openai.com/docs/api-reference/chat/create

'-0314' is a snapshot date, won't change, and will be retired in 3 mos:

https://platform.openai.com/docs/models/gpt-4