Free tools
llms.txt generator and validator
Enter your site. If you already have llms.txt, we check its format and links. Either way, you get a ready draft built from your sitemap and page titles.
What this check does
- Reads robots.txt and applies the rules to each AI bot the way the bots do (RFC 9309: own group first, then the “*” group, longest rule wins).
- Visits your home page with the real User-Agent of each crawler and compares the answer with a regular browser. This catches Cloudflare and firewall rules that block AI without you knowing.
- Checks /llms.txt and /llms-full.txt against the llmstxt.org format and tests the links inside.
- Counts the words present in the HTML without running JavaScript: that is what most AI bots read.
What is llms.txt
llms.txt is a plain Markdown file at the root of a site: the site name, one line about it and a list of key pages with short notes. AI assistants use it to understand a site without crawling everything. It does not replace robots.txt or the sitemap.
Search bots and training bots are different
OAI-SearchBot, Claude-SearchBot and PerplexityBot fetch pages to answer questions and link to sources. GPTBot, ClaudeBot, Google-Extended and CCBot collect text for model training. You can close training and keep search open: your site still shows up in AI answers.
What the SEO audit checks
Title and description length, canonical, robots meta, mobile viewport, language, headings H1–H6, amount of text and readability, image alt texts, links, Open Graph and Twitter tags, JSON-LD and HTML validation errors.
Questions
Is it free?+
Yes. The AI readiness check is free without sign-up. The SEO audit gives three free checks a day to guests; sign up for more.
Why does a bot show “blocked” if robots.txt allows it?+
robots.txt is only a request. The server, CDN or firewall can still refuse a bot by its User-Agent or IP. We make a real visit as each bot to see the actual answer.
Should I block GPTBot?+
It depends on your goal. Blocking GPTBot stops training on your texts but does not remove you from ChatGPT search answers: that is OAI-SearchBot. Most businesses keep search bots open.
Does llms.txt help ranking?+
No search engine promises that. It helps AI assistants that read it to understand your site quickly and link to the right pages. It takes ten minutes to add.
Do you store my site data?+
We keep the check result for 24 hours so repeated checks do not load your server. Nothing else is saved.
Other free tools
Check if ChatGPT, Claude and Perplexity can read your site
Free check: can ChatGPT, Claude and Perplexity crawl your site? We test robots.txt, real bot access, llms.txt and page text, then give fixes. No sign-up.
Free website SEO checker
Check any page for SEO: title, description, headings, images, links, schema markup and HTML errors, plus whether AI search bots can reach it. Free, no sign-up.
Want AI that works with your own site and documents?
INGDG connects AI to your content and tasks. A human engineer helps you set it up.
Try INGDG free