Hacker News new | ask | show | jobs
by grouchy 439 days ago
hey i gave this a test run. not sure it worked how I expected I thought it would index the entire site?

is that an offering of the product?

1 comments

The generator doesn't crawl and index your entire website. Instead, for llms.txt, it:

- analyzes your homepage to extract site information - identifies and categorizes main navigation links - creates a structured llms.txt file following the specification

This aligns with the llms.txt proposal.

For llms-full.txt, it fetches the content from the links on the homepage. It's a much more complete documentation of your site.

You can read more about it here: https://llms-txt.io/blog/what-are-llms-txt-files

Or see examples here: https://llms-txt.io/blog/companies-using-llms-txt-examples