Hacker News new | ask | show | jobs
by chpatrick 1037 days ago
In general I agree with you, but I think we need to figure out how to do really long context lengths before that's really true. A sci fi AI with a real identity would be able to relate to everything that happened in its "life", not just the last 4k tokens.
1 comments

LORAs are kinda able to do that.