Where to put llms.txt
Exact file path, canonical URL, and deployment checks.
Read answerQuestion library
Short answers for common implementation decisions. Each page includes practical steps and links to related tools. For Chinese resources, visit 中文问题库.
Exact file path, canonical URL, and deployment checks.
Read answerWhat it can improve, and what it cannot replace.
Read answerFast checks for syntax, links, crawlability, and policy alignment.
Read answerWhy permissions and source mapping are separate decisions.
Read answerDiscovery vs curation, and how to run both files together.
Read answerA practical range by site type and content maturity.
Read answerIdentify GPTBot and related AI crawlers from user-agent lines.
Read answerWhat to submit, what not to submit, and what actually matters.
Read answerVisibility-first policy pattern for OpenAI search crawler access.
Read answerA practical weekly and monthly maintenance cadence.
Read answerFix wildcard conflicts, stale files, and policy deployment issues.
Read answer