[GrantS]

I thought the overhang was going to be along the lines of the following, whether realistic or not:

-GPT-3, as is, should be the inner loop of a continuously running process which generates 1000s+ of ideas for "how to respond next" to any query, with a separate network on top of it as the filter which cherry-picks the best responses (as humans are already doing with the examples they are posting)

-Since GPT-3, as is, can already predict both sides of a conversation, it can steer a conversation toward a goal state just like AlphaGo does by evaluating 1000s+ of potential moves, lots of potential responses and counter-responses until it finds the best thing to say in order to get you to say what it "wants" you to say.

It seems ready to go as the initial attempt at the inner loop of both of these tasks (and more) without modification or retraining of the core network itself, no?

[lambdatronics]

I'd love to see what could be done with GPT-3 as part of a GAN. Text compression/summary, maybe?

[jobigoud]

I was also thinking something like this. GPT-3 should be the internal monologue, the subconscious soup of words constantly exploring random thought alleys, and there should be another layer on top of it to bridge it with the outside.