[avetiszakharyan]

I'd thought to share this quick tutorial to get an actual autonomous agent running on your local and doing some simple tasks. Still in progress trying to figure ou right MLX settings or proper model version to do it, but the framework around this approach is solid, so i hought i'd share!

[nottorp]

Now how do you feed it an existing codebase as part of your prompt? Does it even support that (prompt size etc).

[avetiszakharyan]

Ye you can just run it in a folder, and ask it to look around, it can execute bash commands, do anything that Claude Code can do. it will read all the codebase if it has to

[pylotlight]

Typically I'd use tools for that as context will be finite, but I hear it does a decent job at tool calling too so should see solid perf there.

[avetiszakharyan]

8b was very bad at tool calling. 30b does an "ok" job but requires the wrapper to do a lot of job, like for example the model will be very random, either have multiple tool_call ags, or have multiple tool calls in one tag inconsistant. but "handle-able"