|
|
|
|
|
|
by DCKing
27 days ago
|
|
|
I think there was a leap around Opus 4/4.1 that hasn't quite been equalled by self hostable models yet. Perhaps full Kimi K2.6 and Deepseek V4 Pro can achieve Opus 4.1 levels (it's hard to compare anyway, benchmarks are largely a game nowadays), but both of these are also north of 1000B parameters and therefore really impractical to run at home for the foreseeable future. It's not yet obvious to me that you can achieve the breakthrough performance of say Opus 4.1/4.5 in a number of parameters you can swing at home. |
|
|
People used to believe the same about GPT-4, and I'm not convinced this is going to be different this time.
You do need a very big model if you want something that remembers random trivia about everything, but I'm not convinced this is needed to do meaningful work.