Hacker News new | ask | show | jobs
by 3wolf 2162 days ago
It sounds like you have an output that has been generated by a recurrent neural network trained on a large corpus. The more I read about neural networks the more clear it becomes that there are some classes of them that just write some good stuff. The work of Andrej Karpathy on RNNs for poetry and other things comes to mind. Is your GPT-3 actually even a neural network, though? More research is needed!

^written in response to the blog by GPT-3

2 comments

Worthy to note that as another comment mentioned, GPT3 was likely trained on pre-GPT2 data.
Weak
Beside the point, really - The interesting fact is that it's a lot better than anything we have previously had.