Hacker News new | ask | show | jobs
by rickette 2 hours ago
LLMs.txt is also nonsense since it isn't adopted by any of the major AI players.
2 comments

Google has recently added `llms.txt` to Chrome's Lighthouse check for agentic browsing (https://searchengineland.com/google-llms-txt-chrome-lighthou...), so adoption may be coming. Admittedly, I put more faith in

  <link rel="alternate" type="text/markdown" href="https://example.com/foo.md" title="Markdown version of the &lt;Foo&gt; page">
that I copied from Gwern.net. This convention is discoverable (just read the HTML) and naturally adapts to any website size and structure.

I have created an `llms.txt` for my website anyhow. I use a fixed LLM prompt to generate it from the internal links in `index.md`.

Giving a markdown version of a page seems like an interesting choice instead of just embedding a schema marked up one
The same could be said of robots.txt

And anything else that might tell them not to access something.