Hacker News new | ask | show | jobs
by ImaCake 1180 days ago
Two thoughts on this:

1. someone could make a shitload of money building a tool for learning how to prompt engineer LLMs in a formal course setting. Would be better than most of the GPT grifts currently circulating.

2. the ETHZ writer, while having a generally good grasp, seems to not understand the concept of Attention here. Or that you can do additional training on these models (even just RLHF). I don't think I understand RLHF, Attention, or extra training (new NN layers right?) enough to comment further.

2 comments

There are already sites online that enable students to cheat. There are people that can churn out high quality essays for a very low price. Is there a place for lower quality essays at a lower price in that market?
Like A/B testing prompts and comparing output type of learning?
Something like that. Since interacting with the model is the best way to learn how to use it, a good course could just put that experience on rails to direct the student's learning towards optimal ways to use the chat bot.