|
|
|
|
|
|
by hansonw
840 days ago
|
|
|
If you think about it, RAG is a relatively primitive “first pass attention layer” that is binary and semi-heuristic based. I think it’s fairly safe to say that in the long term RAG will be integrated into the model architecture somehow, just a matter of when :) |
|
|