| Here's a quick zero shot text compression attempt with GPT3, compressing then decompressing some of my sentences picked from upthread. Looks pretty impressive imo. Notes:
These results include every attempt I made and are not curated in any way, except for the "image formats" compression when I manually asked GPT3 for additional output because it stopped short. To construct the same request, copy the appropriate prompt and append two more lines matching the prompt, such as `{prompt}\n\nLong: your input text\nShort:` then ask GPT3 for a completion. -- Compression: Prompt Make text shorter or longer, using slang, chat speak, or just add or remove vowels and silent letters.
Long: This text is compressed.
Short: dis txt is shrt
Outputs (each prediction starts after Short:)Long: I want this sentence, only shorter. Short: I wnt dis sentnce, only shrr Long: This ensured the decompressed output was all real words, but lowering the jpeg quality basically controlled the descent into synonyms and madness. Short: dis enrvd th cmpd outut b all rl wrds, but lwg th jpg qulity basically cntrlwd th dscnt into synns and mds. Long: I'm away from my computer for the next week or so but if you catch me after that I'm happy to post some of the results. Would be interesting to try with some other image formats as well. Short: I'm awy frm my cmpu 4 da nex wk or so bt if u ctch me aftr dat I'm hppy 2 post sum of d rzltz. Wd b intrestng 2 try w/ sum odder imjd frms as wl. -- Now I take the above outputs (without the inputs) and feed them back into GPT3 with a different prompt. Decompression: Prompt Make text longer. Expand slang and chat speak, or just add vowels, silent letters, and punctuation.
Short: dis txt is shrt
Long: This text is compressed.
Short: I wnt dis sentnce, only shrr
Long: I want this sentence, only shorter.
Outputs (each prediction starts after Long:)Short: dis enrvd th cmpd outut b all rl wrds, but lwg th jpg qulity basically cntrlwd th dscnt into synns and mds. Long: This enhanced the compressed output by all real words, but long the JPEG quality basically controlled the descent into synonyms and made-up words. Short: I'm awy frm my cmpu 4 da nex wk or so bt if u ctch me aftr dat I'm hppy 2 post sum of d rzltz. Wd b intrestng 2 try w/ sum odder imjd frms as wl. Long: I'm away from my computer for the next week or so but if you catch me after that I'm happy to post some of the results. Would be interesting to try with some other image forms as well. |