[noud]

ChatGPT4 blew my mind when I asked it some specific details about my PhD thesis. It was a relative simple question, but you needed to know some domain knowledge to give the correct answer. ChatGPT not only gave a wrong answer, it completely made up a story was beyond repair. It is concerning (blew my mind) how confident ChatGPT can provide a completely wrong answer.

[mensetmanusman]

A recent thesis is a single datapoint at the edge of human knowledge. These bots will necessarily be better at parsing information with more interconnectedness closer to the core of existing human knowledge.

[ithkuil]

Have you pasted (parts of) your thesis as context?

[was_a_dev]

Interestingly, I asked about my field of research it just outputed a combination of the two open-access review papers for the field.

It was nothing special, nor not completely correct, but it is the first time I've been able to pinpoint ChatGPTs source.

[kevviiinn]

GPT4 seems to do a better job with not making up references than GPT3.5. Don't check the DOIs though

[was_a_dev]

Are those references just relevant sources, or actual citations?

For my example I knew of the sources already. ChatGPT didn't make the connection

[kevviiinn]

Sometimes either just relevant or actual citations, I've seen both. If you ask for specific citations for a specific phrase it's basically a coin flip what you get, what you get could be fake citations

[taf2]

Was it GPT-4 or ChatGPT?

[endorphine]

What's the difference? Doesn't ChatGPT uses GTP-4?

[FabianBeiner]

Currently, by default, it uses 3.5. Premium allows you to switch to 4, but it's rather limited (25 messages every 3 hours or so).

[endorphine]

Ok, so by "ChatGPT" parent means "ChatGPT using GPT-3.5"