|
|
|
|
|
by AlexC04
83 days ago
|
|
to directly answer this bit: > Feels like a fundamental bottleneck for production agent systems, so would love to compare how you're thinking about the latency vs accuracy tradeoff. I'm really not focusing on latency right now. My short term goal is to prove the thesis that `ail` can improve same-model performance on SWEBench Pro vs. their own published results. Can I run swebp with GLM-4.6 and get a score better than their published `68.20` https://www.swebench.com/? The argument is that the latency right now just isn't the part we should worry about. If we're reducing the time to code something from ~6 weeks to 1 hour... then does it really matter tha we add an other 30 minutes of tool calls if we get it 100% right vs. 80% right? Make it work -> Make it right -> make it fast. I'm still on the first one tbh :rofl-emoji: |
|