The generator doesn't crawl and index your entire website. Instead, for llms.txt, it:
- analyzes your homepage to extract site information
- identifies and categorizes main navigation links
- creates a structured llms.txt file following the specification
This aligns with the llms.txt proposal.
For llms-full.txt, it fetches the content from the links on the homepage. It's a much more complete documentation of your site.
is that an offering of the product?