|
|
|
|
|
|
by YeGoblynQueenne
2227 days ago
|
|
|
Bert is a language model. It's trained to predict the next character in a sequence. It does not have any capacity to "understand" programming, or anything at all. It can also not produce outputs that are not similar to the examples it's been trained on. Like all neural net models it can interpolate between its examples, but it can't extrapolate to regions of the sample space it's never seen. This is why I say it lacks the ability to innovate. I'm not sure how you would combine AutoML-Zero with Bert. How do you mean? |
|
|