|
|
|
|
|
by ImaCake
1180 days ago
|
|
Two thoughts on this: 1. someone could make a shitload of money building a tool for learning how to prompt engineer LLMs in a formal course setting. Would be better than most of the GPT grifts currently circulating. 2. the ETHZ writer, while having a generally good grasp, seems to not understand the concept of Attention here. Or that you can do additional training on these models (even just RLHF). I don't think I understand RLHF, Attention, or extra training (new NN layers right?) enough to comment further. |
|