[inconfident2021]

> understand X number of words, or pages, or paragraphs.

LLMs do not have the ability to reason with numbers. Most of the time they are hallucinating. One good strategy is to make it output in list and define the structure for each item of the list. If you give an example of what your list should look like, it will give you something close it.

> has trouble carrying a list forward without losing items.

This is the fundamental problem with these models because of the context limit. When you are prompting always remember that is processing a huge paragraph and emitting the next sentences of the paragraph. If you want information to be carried onwards, you have make it output on every prompt or you can also try to use specific identifiers. LLMs are good at in-context learning. It will not work 100% of the time, but it is usually good than having nothing at all.

> I want to speak chinese to the AI and I want it to correct me.

Give it a role of tutor and describe the instructions what the tutor should do.

[baby]

> LLMs do not have the ability to reason with numbers

Interestingly I get good results when I say "ask me 10 trivia questions"

> Give it a role of tutor and describe the instructions what the tutor should do.

I did do that, it never worked

[petesergeant]

> LLMs do not have the ability to reason with numbers

I’ve found ChatGPT pretty good at estimating long division