|
|
|
|
|
by verdverm
756 days ago
|
|
There are many more features that would be needed, such as a peer comment pointed out, being able to recognize you are saying something incorrect, pausing, and then starting a new stream of output. This is currently done with multiple LLMs and calls, not within the running of a single model i/o Another example would be to input a single token or gibberish, the models we have today are more than happy to spit out fantastic numbers of tokens. They really only stop because we look for stop words they are trained to generate and we do the actual stopping action |
|