[Tepix]

Here's an example on how misleading ChatGPT is:

Prompt:

Can you explain what happens when i enter "ping 16843009" in a linux shell?

Answer:

When you enter the command ping 16843009 in a Linux shell, you are instructing the ping utility to send an Internet Control Message Protocol (ICMP) echo request to the IP address 168.43.9.0. [...]

The correct answer is that it will ping 1.1.1.1

Also ChatGPT missed that fact that 16843009 is bigger than 255 and failed to explain what happens and why.

[pphysch]

It's interesting that content generation AI (text, art, etc) is really being optimized for our flawed human perception. Which means a lot of stuff is going to look good on the surface, but tend to be deeply flawed.

[Tepix]

Interestingly when i ask ChatGPT what happens when i "ping 257" it both gets the IP address right and the explanation (kind of).