[mdmglr]

I asked ChatGPT to play this game:

I will give you 2 strings A and B.

You must tell me what operations from the list below to transform string A into B. You can use as many operations as you want but the more operations the less points you get.

Insert(a,b)- insert character a at position b. Delete(a)- delete character at position b. Swap(a,b)- swap characters a position a with position b.

A: ello B: Hello

Answer is insert(H, 0)

Try it for yourself and you will quickly see how bad ChatGPT is and how simple it is to trick humans you are intelligent.

[tkanarsky]

For what it's worth, Bing answers correctly and unceremoniously (although i had to reframe the question as a riddle with words, as the word 'string' seems to trigger it's anti-code-completion guardrail)

https://imgz.org/i4R5tbXH.jpg

[YeGoblynQueenne]

What did it "clear the slate" from?

[tkanarsky]

Some previous conversation, I forget what exactly. When you tap the "new conversation" button it displays a message to confirm context was cleared

[YossarianFrPrez]

I tried this and got a funny answer with the strings "bananas" and "pandas":

Great! Here are some possible ways to transform string A into B using the provided operations:

Insert(p, 0) -> "pananas" Swap(n, 2) -> "pananas" Swap(d, 4) -> "pandnas" Swap(a, 5) -> "pandasn"

Swap(b, 0) -> "abananas" Delete(a, 1) -> "bnanas" Swap(p, 1) -> "bpanas" Swap(d, 3) -> "bpands" Insert(a, 4) -> "bpanda" Swap(s, 5) -> "bpandas"

Insert(p, 0) -> "pananas" Insert(d, 1) -> "pdananas" Swap(a, 2) -> "pdnaanas" Swap(p, 3) -> "pdnapanas" Swap(a, 4) -> "pdnapnaas" Swap(s, 5) -> "pdnapnasa" Delete(a, 6) -> "pdnapnas"

[tiziano88]

This is most likely due to how tokenization works, i.e. the model does not even get to see individual letters in most cases, just tokens

[tkanarsky]

Bing also fails on this one:

https://imgz.org/i9ZzrkA3.jpg

[RugnirViking]

wow that is really entertaining lol. It simply can't get this one even close to right.