llms.txt generator
Create a concise Markdown source map from your core pages.
Open generatorAI search visibility toolkit
Make your website easier for AI answers to cite.
Create a clean /llms.txt, align crawler access, and publish source pages that search engines and AI answer engines can understand without guessing.
Start with the highest-intent decisions: where to publish llms.txt, what impact to expect, and how to verify OAI-SearchBot access.
Static firstFast pages that crawlers can read.
No dark patternsBuilt around search engine guidelines.
GEO readyClear sources for AI-generated results.
Free tool
llms.txt generator
Generated locally in your browser.
Toolbox
Free tools for source maps and crawler policy.
Generate, validate, convert, and audit the files that help crawlers and AI assistants understand your strongest source pages.
Sitemap to llms.txt
Paste sitemap XML or URLs and draft a source map to refine.
Open converterllms.txt validator
Check headings, summary, source links, and concise structure.
Open validatorAI robots.txt builder
Draft crawler rules for search, user retrieval, and training bots.
Open builderAI robots.txt checker
Review whether your policy supports AI search visibility.
Open checkerAI crawler log checker
Classify GPTBot, OAI-SearchBot, Claude, and Perplexity crawler lines from logs.
Open log checkerAI crawler log command builder
Generate ready-to-run commands for Nginx, Caddy JSON, and Apache logs.
Open command builderCloudflare 525 SSL checker
Generate origin TLS and SNI checks for Cloudflare SSL handshake failures. Need a full playbook? Use the Nginx 525 fix workflow.
Open 525 checkerAI referral regex builder
Create GA4 and log regex filters for ChatGPT, Perplexity, Copilot, Gemini, and Claude referrals.
Open regex builderCloudflare 52x checklist
Pick 520-526 and generate first-response checks for Caddy or Nginx origins.
Open 52x checklistCloudflare crawler troubleshooting
One hub for 520-526, 403 blocks, Bot Fight Mode, and WAF allow-rule patterns.
Open troubleshooting hubrobots.txt rule tester
Check whether one path is allowed or blocked for a specific crawler token.
Open rule testerGEO checklist
Check whether your pages are crawlable, factual, and citeable.
Open checklistReal operations
Transparent growth logs from a live implementation.
These pages share measured traffic baselines, crawler behavior, and what we changed next, so strategy stays tied to evidence instead of generic advice.
Traffic baseline (May 2026)
Transparent baseline plus latest checkpoint: clean daily unique IP from 60 to 132.
Read case studyHow to choose an llms.txt generator
A practical scorecard with real pass/fail examples from active publishing workflows.
Open scorecardDoes Bot Fight Mode block AI crawlers?
Use evidence commands and a safe allow scope pattern before changing edge policy.
Open guideAI visibility daily reports
Track clean unique IP, opportunity pages, crawler signals, and distribution queue in one place.
Open dashboardPolicy templates
Ready robots.txt patterns for AI crawler decisions.
Use these templates when you need explicit allow/block policies by crawler purpose, then validate with logs and checker tools.
Allow OAI-SearchBot, block GPTBot
Visibility-first pattern with separate training crawler control.
Open templateAllow Claude-SearchBot, block ClaudeBot
Separate search retrieval and training policy for Claude crawlers.
Open templateAllow AI search, block training bots
Compact policy for sites that want broad answer visibility.
Open templateShould you allow PerplexityBot?
Decision matrix and verification commands for visibility-first rollout.
Open decision guideWhat to build first
GEO is still grounded in crawlable, useful pages.
Google's public guidance for AI search emphasizes unique, valuable content, crawlability, page experience, and structured data that matches visible content. Bing's webmaster guidance says the same SEO foundation supports AI grounding and Copilot visibility.
Publish source pages
Answer exact questions with first-hand, specific information. AI systems need sources they can quote, not vague category pages.
Use the GEO release checklistAdd an AI map
A concise llms.txt file can point assistants to your strongest docs, pricing, policies, and factual reference pages.
Read llms.txt deployment guideAlign robots policy
Decide which bots can crawl your site and keep policy choices explicit by crawler role. Then validate with logs.
Read crawler decision guideExamples and decisions
See what belongs in the file, and what does not.
Use examples and comparisons to avoid treating llms.txt like a replacement for sitemap.xml, robots.txt, or useful source pages.
llms.txt examples
Compare concise examples for SaaS, ecommerce, publisher, documentation, and local sites.
Open examplesllms.txt vs sitemap.xml
Learn why sitemap.xml is for URL discovery while llms.txt is a curated source map.
Read comparisonllms.txt vs robots.txt
Separate crawler permissions from AI-readable guidance for your strongest pages.
Read comparisonPlatform recipes
Build an llms.txt file for the stack you already use.
Each recipe focuses on what source pages to include and how to keep the file useful for AI assistants without promising unsupported platform magic.
Blogs and content sites
Map cornerstone pages, category hubs, editorial policy, authors, and evergreen explainers.
Open WordPress recipeStores and catalogs
Highlight buying guides, collections, shipping, returns, warranty, and customer support pages.
Open Shopify recipeModern web apps
Keep static source pages discoverable and align canonical URLs with generated files.
Open Next.js recipeDeveloper docs
Expose quickstarts, API references, SDK guides, versioned docs, and changelogs.
Open Docusaurus recipeProject docs
Point assistants to README, docs, examples, releases, license, and contribution pages.
Open GitHub Pages recipeMarketing sites
Connect product pages, comparisons, case studies, pricing, and trust pages.
Open Webflow recipeBot guides
Separate search visibility from model training.
Several AI companies now document different crawlers for search, user-triggered retrieval, and training. Treat them separately when you write robots.txt rules.
OAI-SearchBot vs GPTBot
Allow search discovery while deciding separately whether training crawls fit your policy.
Read OpenAI bot guideClaudeBot and Claude-SearchBot
Map Anthropic's three documented agents to search, user retrieval, and training choices.
Read Claude guidePerplexityBot policy
Understand what Perplexity says it indexes when pages are allowed or disallowed.
Read Perplexity guideLong-tail library
Templates for common site types.
Start with a template, then rewrite it with real details from your website. Thin generic files do not create durable search value.
Product and docs sites
Prioritize docs, pricing, integrations, security, changelog, and support policy pages.
Open SaaS templateProduct catalogs
Highlight category hubs, buying guides, shipping policy, returns, warranty, and product data feeds.
Open ecommerce templateBlogs and media
Expose evergreen explainers, editorial policy, author pages, corrections, and topic archives.
Open publisher templateDeveloper documentation
Point AI assistants to quickstarts, API reference, examples, SDKs, and changelogs.
Open docs templateLocal business sites
Clarify service areas, booking, pricing, policies, location pages, and trust signals.
Open local templateLead-generation sites
Prioritize solutions, ICP fit pages, pricing model details, proof assets, and implementation process pages.
Open B2B templateIndustry templates
Start with sector-specific source maps.
These templates focus on the pages each industry is expected to provide so AI assistants can answer with fewer wrong assumptions.
Dental clinic template
Prioritize treatment pages, dentist bios, insurance, pricing, and booking policy.
Open dental templateLaw firm template
Map practice areas, attorney profiles, fee structure, and consultation terms.
Open law firm templateReal estate template
Expose listing hubs, neighborhood guides, commission policy, and contact channels.
Open real estate templateOnline course template
Highlight curriculum, instructors, pricing, enrollment rules, and support.
Open education templateTravel agency template
Include itinerary pages, pricing details, cancellation policy, and visa notes.
Open travel templateLocal service template
Clarify service areas, estimate logic, scheduling, guarantees, and terms.
Open service templateGenerator playbooks
Use-case pages for high-intent llms.txt searches.
These pages map common keyword intents such as "llms.txt generator for SaaS" and "llms.txt generator for law firm" to practical source-page checklists. For service businesses, start with the local business generator playbook. Browse the full use-case library.
llms.txt generator for SaaS
Product docs, pricing, security, integrations, changelog, and support sources.
Open playbookllms.txt generator for blogs
Cornerstone guides, category hubs, author profiles, and editorial policy pages.
Open playbookllms.txt generator for stores
Collections, buying guides, shipping, returns, warranty, and support policy pages.
Open playbookllms.txt generator for law firms
Practice areas, attorney profiles, fee terms, and consultation workflow pages.
Open playbookllms.txt generator for dental clinics
Treatment pages, dentist credentials, insurance, pricing guidance, and booking policy.
Open playbookllms.txt generator for agencies
Listing hubs, neighborhood pages, buyer/seller process, and commission policy.
Open playbookllms.txt generator for local business
Service areas, estimates, booking terms, and guarantee policy pages.
Open playbookllms.txt generator for lead-gen sites
Solutions, ICP fit pages, pricing model details, and case study sources.
Open playbookllms.txt generator for docs sites
Quickstart, API reference, SDK guides, examples, and release notes.
Open playbookQuestion intents
Fast answers for common llms.txt decisions.
These pages target practical question searches and explain implementation choices without jargon. Browse all llms.txt questions.
Where to put llms.txt
Correct root path, status checks, and deployment validation.
Read answerDoes llms.txt help SEO
What it improves and what still depends on core SEO fundamentals.
Read answerHow to test llms.txt
A 4-step validation process for structure, links, and crawler policy alignment.
Read answerAllow OAI-SearchBot in WAF
Path-scoped rule pattern to reduce 403 blocks without weakening security.
Read answerHow to check OAI-SearchBot visits
Verify whether access expands from crawl-entry files to your key content pages.
Read answerShould you allow PerplexityBot?
Use a visibility-first rollout and validate with status-mix checks over multiple days.
Read answerWhat pages should B2B llms.txt include?
A practical page-priority order for lead-generation sites so AI assistants can quote the right sources.
Read answer