|
|
|
|
|
by furyofantares
1165 days ago
|
|
Very cool. I'd love it if it gave me more info about the differences between some of the available models. I've been using GPT4 exclusively from the web interface; I don't know why I might select GPT4 vs GPT4-0314. I believe I do know why I want to use 32k, but others might not. Basically, I'd want an explanation as to how these differ from what's available in the ChatGPT web-app. The default temperature is 0.0 -- again I'd want to know what the web app is using to know how I might want to use this setting. edit: I guess an answer is my API key is only valid for 3.5 anyway. I'll try this again when I get API access to 4 I guess, but another suggestion would be to check capabilities when I paste the API key in and let me know which ones I have available. |
|
As for the default temperature, 0.0 is actually a bug ! I'll definitely fix that in the next release. The default intended value is 1.0. The API reference [1] describes what the temperature parameter does in more detail.
While doing some testing, I also noticed that the app disables streamed responses by default. Make sure to check the appropriate checkbox in the settings to get token-per-token answers !
[1] https://platform.openai.com/docs/api-reference/chat/create