AI and SEO

What is llms.txt?

llms.txt is a proposed text file that can be placed on a website, usually at yourdomain.com/llms.txt. It can contain a short description of the website and links to important pages.

The idea is to make information clearly available for AI applications. Whether an AI system uses the file varies by application. The file does not determine which pages are cited or which answers an AI provides.

What is the difference between robots.txt and a sitemap?

  • robots.txt contains instructions for crawlers about which parts of a website they are allowed to visit.
  • An XML sitemap gives search engines an overview of URLs that the website owner considers important.
  • llms.txt is a proposal for an overview of information and links for AI applications.

These files each have a different function. None of them guarantee that a page will appear in search results or AI answers.

Bram

Ready for the next step?

We build websites that are technically and strategically future-proof.

Why is llms.txt smart to use?

With llms.txt, you not only make your website more findable, but also more trustworthy in the eyes of an AI. This benefits your organization on multiple fronts:

  1. You are prepared for the future of search engines: More and more AIs are working alongside or even within search engines. By applying llms.txt, you will future-proof your site and stay one step ahead.
  2. You keep control of your story: Without llms.txt, an AI decides for itself which pieces of text or pages are relevant. With llms.txt, you help the AI use the most current and reliable info.
  3. You offer visitors a better answer: The better the input, the better the answer. With llms.txt you point an AI and thus your visitors the way to your best and most relevant pages. This way, a potential customer gets the right information immediately, without noise or outdated details.

How do you work on visibility in Google and AI?

Start with the basics: a website that is accessible, works well, and clearly answers relevant questions. Think of up-to-date information, a logical structure, internal links, and examples that show what your organization is an expert in.

It is also important that search engines and relevant AI search crawlers can reach the pages you want to make available. How you check this varies by provider. For ChatGPT Search, for example, OpenAI describes the role of OAI-SearchBot. Allowing access enables discovery but does not guarantee a mention.

At Studio Brabo, we therefore look at the combination of technology, content, and management. This creates a website that helps visitors and that your organization can continue to improve itself.

Also read our new article on WordPress, SEO, and AI findability.