|
|
|
|
|
|
by buddhiajuke
2145 days ago
|
|
|
The examples I have seen tease but are not fully clear on how far GPT-3 can go on tasks that are not in principle text generation tasks. For example I’ve seen the translation to HTML code demo. Of course, LSTMs already generate quasi compilable code. But the promise seems far better here. Countless “AI” tasks can be conceptualized as entering prompts and receiving code — playing chess, finding logical implications (maybe from tabular data like in Formal Concept Analysis), detecting outliers in columnar/matrix data. How much does GPT do? How much turf beyond chatbots and automatic journalism does it cover? |
|
|
The real answer to this is that we don't really know just yet. People are still finding ways to represent problems as text completions and feeding them to GPT-3 and seeing what comes out. However there is a hard limit for GPT-3 specificially, and that's its context window. IIRC it can only be prompted with & generate 2048 "BPEs" in total (smaller than a word, but bigger than one character). So in your prompt you could give it a handful of tables, some with outliers, some without, and some metrics after each table concerning outliers. Then the last part of your prompt is a table you'd like the metrics for and let GPT-3 fill it in. Does this work? The answer is a strong maybe, lol. But you're so limited in space that for some use-cases it's more likely you'd need to wait for later iterations of this approach that raise or remove the length limitation.