Hacker News new | ask | show | jobs
by czx4f4bd 1162 days ago
I pay for it because I can afford it, but honestly I haven't been super impressed.

GPT-4 is definitely better at some tasks and moderately less prone to hallucination, but it botched the first couple scripting tasks I gave it, so it didn't exactly wow me. The main difference I've observed is that it gives wordier responses than GPT-3.5.

That said, I might have a different opinion if usage of GPT-4 weren't so severely rate-limited. Currently, you can only send 25 requests every 3 hours, so it's hard to experiment with it as freely as I want.

4 comments

The only task GPT-4 "botched" for me was trying to write an IRC bot with Rust.

12 attempts and it still couldn't connect. After 6 attempts (of me pasting back compilation errors) it compiled, but didn't run. The last 6 attempts were me trying to get Rust to ignore TLS errors so it could connect. I gave up after that.

I had a set of ancient (10+ year old) shell scripts and Python controlling Deluge. I wanted to move to Transmission and still retain the same functionality.

Except for using an API from 2021, the code it gave me was 100% correct and properly named and even commented. I had to spend 5 minutes correcting the import and changing a few named variables (user -> username type stuff) and it just worked.

Use the API if you want some more time with it. You’ll pay for the tokens you use, but twenty bucks gets you some hours of experimentation depending on how fast you’re going.
You first need to get access to the API, which is not available to everyone
Have you requested it? In my experiences it takes a couple of days.
It's taking a lot longer than that for me.
over 2 weeks for me, still no access.
Do you have any references for how I can do this?
Not the person you asked, but the OpenAI playground is a great place to start messing with their API, I wrote this to help: https://www.inputoutput.ai/tutorials/openai-playground-guide (note website is still a work in progress just got it going bear with me haha)

However, you need access to the GPT-4 API which you have to request separately. So even if you have GPT-4 with chatGPT Plus you might not have access to GPT-4 through the playground/API.

Use a wrapper like TypingMind?
Not to be annoying, but have you tried asking chatGPT?
One important lesson I learned is to never ask ChatGPT about itself, it only seems to makes things up.
The 25 requests isn't too much of a hindrance for me but the user experience around its long response times definitely is. Needs notifications, or at least just have it wait and then send the text all at once rather than drip feeding it.

Although if they did that then I'd probably hit the 25 request limit a lot more.

> The main difference I've observed is that it gives wordier responses than GPT-3.5.

You pay per token, and they're way more expensive with GPT-4. Coincidence?