SEO is changing, and AI-generated results are rapidly becoming more common. To gain a competitive edge, it is now recommended to include a llms.txt file in the root directory of your site. I’ve attached a link to a useful article about this below.
https://www.mintlify.com/blog/what-is-llms-txt
I would like to propose a new automated job feature to be added in the core: auto-generate an llms.txt file (similar to how the sitemap.xml job works).
Also, if you search for ‘llms.txt generator’, there are some free tools out there to help you generate one for your existing site.