|
|
|
|
|
by riveducha
1764 days ago
|
|
I made a similar little GPT-3 toy (for Linux/bash) that also ended up generating a Rickroll URL.[0] In vague cases, GPT-3 functions approximately as well as a markov chain - it will give you the most “probable” sequence of tokens. There’s some implementation details regarding how it deals with tokenization, but unless you really increase the randomness (“temperature”) you’re likely to get very popular YT video IDs. In other cases, it will “hallucinate” things like URLs, UUIDs, hashes, and other things that are basically a random string of characters. In my experience it will make UUIDs that have the right number of characters but seem suspiciously non-random and don’t fit any of the defined UUID formats. Fun stuff. [0] https://youtu.be/j0UnS3jHhAA |
|
As predicted by Scott Adams in October 2001 ;)
https://dilbert.com/strip/2001-10-25