[billmalarky]

Can you share some basic insight into how your system processes an open source repo to generate a wiki with a hierarchy and structure that maps to the same or similar hierarchy and structure of the codebase?

I can understand the value of marrying that wiki to the codebase and how that would help LLM's better "understand" the codebase.

What I'm lost on is how you can auto-generate that wiki in the first place (in a high quality way). I presume it's not perfect, but a very interesting problem space and would love to hear what you've learned and what you are trying to accomplish this feat!

Thanks for posting btw, this HN comments section has been INCREDIBLE.

[oshams]

Thanks! It's a multi stage process where we summarize the code and structure it into articles. We also do some self verification, for example checking for dead links.

[billmalarky]

Do you build a syntax tree of the code, then loop the tree to auto-write an article for each node (or the larger or more material nodes) and then also reference the tree to pull in related nodes/pieces/modules/whatnot of the codebase when auto-writing a documentation article for each node?

This is fascinating thank you

[oshams]

yeah ! you know the best way to learn more is to join us, we're hiring: https://www.workatastartup.com/companies/mutable-ai

[billmalarky]

Greatly appreciate the suggestion! but I recently joined another YC backed Gen AI startup in the fine-tuning space (OpenPipe) :-D

Speaking of, there's a good chance fine tuned models will be a component of your fully-optimized codebase -> wiki automation process at some point in the future. Likely to increase consistency/reliability of LLM responses as clear patterns start to emerge in the process. If y'all decide to layer that on or even explore it as an optimization strategy hit us (or me directly) up. We love collaborating w/ engineers working on problems at the edge like this, aside from how engaging the problems themselves are, it also helps us build our best possible product too!

Very excited to follow your journey! just sent you a LI request.

Thanks again so much for sharing your wisdom!