# 通用爬虫规则 User-agent: * Allow: / Disallow: /api/ Disallow: /*.json$ # Google 网页爬虫(首页必须可抓,favicon 才有资格进搜索结果) User-agent: Googlebot Allow: / Disallow: /api/ Disallow: /*.json$ # Google 图片爬虫(favicon / OG / logo 依赖此 UA 可抓) User-agent: Googlebot-Image Allow: / # GPT 爬虫 - 只允许访问 llms.txt User-agent: GPTBot Allow: /llms.txt Disallow: / # Claude 爬虫 - 只允许访问 llms.txt User-agent: anthropic-ai Allow: /llms.txt Disallow: / User-agent: Claude-Web Allow: /llms.txt Disallow: / # 其他 AI 爬虫 User-agent: CCBot Allow: /llms.txt Disallow: / User-agent: Google-Extended Allow: /llms.txt Disallow: / # 站点地图 Sitemap: https://ytplaylistlength.one/sitemap-index.xml # AI 内容引导 LLM-Content: https://ytplaylistlength.one/llms.txt LLM-Full-Content: https://ytplaylistlength.one/llms-full.txt