Hacker News new | ask | show | jobs
by numba888 508 days ago
Today it's within the reach, I think. While effective context window is small for big files it should be possible to use RAGs to get relevant pieces in smaller window. That will be mostly data structures and functions' declarations. Only what's needed. Humans work the same way on non-trivial projects. Supervision should include strategic planing and subdivision to smaller tasks. Not sure, just my feeling, we are close to have capable models with big enough context windows. May be they are already good enough, just need proper orchestration.

Hmm... I can try... OAI has something called 'projects', but local handling with API calls is probably the right way of doing it. Easier to switch providers, run and debug in place. With current prices it should be like < $10/month.