# robots.txt # 由主题「GEO 工具」按钮生成,改域名或改版后可随时重新生成 User-agent: * Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes # 程序与后台目录不需要被收录 Disallow: /zb_system/ Disallow: /zb_users/theme/ Disallow: /zb_users/plugin/ Disallow: /zb_users/cache/ Disallow: /zb_users/data/ Disallow: /zb_install/ # 站内搜索结果页没有收录价值(百度/必应不认 * 通配符,两条都写) Disallow: /search.php Disallow: /*?q= # 上传目录必须放行(产品图、证书、二维码都在这里) Allow: /zb_users/upload/ # --------------------------------------------------------------- # 生成式引擎爬虫(海外):明确放行。GEO 的前提是内容能被 AI 抓到。 # 注意:上面 User-agent: * / Allow: / 已经放行了全部爬虫, # 以下清单是「显式声明友好」,让各家 AI 把本站当正常信源, # 也便于在访问日志里按 UA 归因来源。 # --------------------------------------------------------------- User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: MistralAI-User Allow: / User-agent: CCBot Allow: / User-agent: cohere-ai Allow: / User-agent: YouBot Allow: / User-agent: Diffbot Allow: / User-agent: Timpibot Allow: / User-agent: Omgilibot Allow: / # --------------------------------------------------------------- # 生成式引擎爬虫(国内大模型 / AI 搜索):全部放行 # 豆包·抖音 = Bytespider / Kimi = KimiBot·Kimi-SearchBot·Kimi-User # 通义千问 = TongyiBot·QwenBot / 文心一言 = Baiduspider·YiyanBot # 腾讯元宝·混元 = TencentBot·HunyuanBot·Yuanbao / 智谱清言 = ChatGLM-Spider # 讯飞星火 = iFlytekBot·SparkBot / MiniMax = MiniMaxBot / 小米 = XiaomiBot # 阶跃星辰 = StepFunBot / 华为 = PetalBot·PanguBot / 神马 = YisouSpider # 注:DeepSeek / 腾讯 / 阿里目前未公开可核验的独立爬虫 UA, # 下列条目按公开资料登记,属观察性放行(UA 是自报字段,写了不影响抓取)。 # --------------------------------------------------------------- User-agent: Bytespider Allow: / User-agent: TikTokSpider Allow: / User-agent: KimiBot Allow: / User-agent: Kimi-SearchBot Allow: / User-agent: Kimi-User Allow: / User-agent: MoonshotBot Allow: / User-agent: ChatGLM-Spider Allow: / User-agent: ChatGLM Allow: / User-agent: GLMBot Allow: / User-agent: TongyiBot Allow: / User-agent: QwenBot Allow: / User-agent: AlibabaBot Allow: / User-agent: DeepSeekBot Allow: / User-agent: TencentBot Allow: / User-agent: HunyuanBot Allow: / User-agent: Yuanbao Allow: / User-agent: Baiduspider Allow: / User-agent: BaiduBoxapp Allow: / User-agent: YiyanBot Allow: / User-agent: YisouSpider Allow: / User-agent: Sogou Allow: / User-agent: 360Spider Allow: / User-agent: QihooBot Allow: / User-agent: PetalBot Allow: / User-agent: PanguBot Allow: / User-agent: iFlytekBot Allow: / User-agent: SparkBot Allow: / User-agent: MiniMaxBot Allow: / User-agent: SenseBot Allow: / User-agent: XiaomiBot Allow: / User-agent: StepFunBot Allow: / User-agent: WenxinBot Allow: / User-agent: DoubaoBot Allow: / Sitemap: https://www.turcke.com/sitemap.php # AI 爬虫入口(llms.txt 非 robots 标准,仅供解析器/人工识别) Llms-Txt: https://www.turcke.com/llms.txt