User-agent: * Disallow: /api/ Disallow: /pm-data.json Allow: / # /dashboard.html /captcha-demo.html /pay-demo.html 放开:这些是 sitemap 里的正经营销/演示页, # 之前 Disallow 与 sitemap 自相矛盾(Google 标 blocked by robots.txt,2026-08-17 修)。 # AI crawler posture — minia2a 是 agent-reachable 市场,明确欢迎 AI crawler/agent 抓取。 # 声明式策略(MCP Census F2 判据:named = considered,allow/disallow 都算 declared)。 # 所有 named agent 与 * 组同权:/api/ 和 /pm-data.json 同样不抓。 User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: CCBot User-agent: Bytespider User-agent: meta-externalagent User-agent: Amazonbot User-agent: Applebot-Extended User-agent: cohere-ai User-agent: OAI-SearchBot User-agent: Claude-SearchBot User-agent: Googlebot User-agent: bingbot User-agent: PerplexityBot User-agent: Applebot User-agent: DuckAssistBot User-agent: ChatGPT-User User-agent: Claude-User User-agent: Perplexity-User User-agent: MistralAI-User Disallow: /api/ Disallow: /pm-data.json Allow: / Sitemap: https://minia2a.uk/sitemap.xml