# Copyright (c) 2026 Chinaready. All rights reserved. # https://chinaready.co robots.txt User-agent: * Allow: / # Cloudflare Email Obfuscation / system paths — not content pages (GSC 404 noise). Disallow: /cdn-cgi/ # Handbook PPT HTML shells (slide decks) — not Search targets; Guides remain canonical. Disallow: /handbooks/ # OpenAI crawlers — explicit declarations of the wildcard policy above # (all allowed, consistent with Content-Signal: ai-train=yes). Per-agent groups # do not inherit the wildcard group, so each repeats the two Disallow lines. # OAI-SearchBot powers ChatGPT Search; ChatGPT-User is user-initiated browsing; # GPTBot is model training; ChatGPT-Dispatcher routes user-shared pages. User-agent: OAI-SearchBot Allow: / Disallow: /cdn-cgi/ Disallow: /handbooks/ User-agent: ChatGPT-User Allow: / Disallow: /cdn-cgi/ Disallow: /handbooks/ User-agent: GPTBot Allow: / Disallow: /cdn-cgi/ Disallow: /handbooks/ User-agent: ChatGPT-Dispatcher Allow: / Disallow: /cdn-cgi/ Disallow: /handbooks/ Content-Signal: ai-train=yes, search=yes, ai-input=yes Sitemap: https://chinaready.co/sitemap-index.xml