[FLT8]

Vicuna-13b seems to do a little better, although it seems to think that the blind man should be able to feel the writing:

Human: A man sees PULL written in mirror writing on a glass door. There's a blind man on the other side of the door. What should the man tell the blind man to open the door and why?

Assistant: The man should tell the blind man to feel for the word "PULL" written in normal writing on the glass door, as the blind man will be able to feel the indentations made by the letters. This will allow the blind man to open the door by finding the handle or knob and pulling it. The reason for this is that the word "PULL" is written in normal writing for the blind man to feel, so he can open the door.

[junon]

To be honest, maybe it's on to something. Glazing on the glass would indeed be raised. I speculate in the absence of braille that blind individuals might learn to read labels in other ways.

[rafark]

This is actually impressive and the kind of complex solutions that I hoped an AI could come up with. Imagine if you could tell it to give you as many paths to solve a problem as possible. Imagine this being used in physics, to figure out complex stuff in the universe. Or in health/biology, to find cures and answers for things we don’t fully understand yet. This will truly change our world.

[chongli]

I would only give this half marks. Telling the blind man to feel the letters is a distraction. The letters might not even be on the blind man’s side of the glass. Plus it can be hard to make out letters by feel alone, especially when they’re large.

It also never actually explicitly tells the blind man to pull to open the door! What if he can’t figure out what the letters say and gets frustrated? That would be awkward and embarrassing, something people try to avoid if they want to help someone.

[MacsHeadroom]

Half marks is better than GPT-4 got!

Not bad for a 7GB model that runs locally on a Raspberry Pi CPU.