# Miget - https://miget.com # AI agents and answer engines are explicitly welcome. Everything below is an # allow: there is no crawler we ask to stay out. # Named AI crawlers and agents, allowed explicitly so no default-deny bot rule # is read as a signal to stay away. User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: ClaudeBot User-agent: Claude-User User-agent: Claude-SearchBot User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot User-agent: Applebot-Extended User-agent: DeepSeekBot User-agent: Bingbot User-agent: Amazonbot User-agent: Bytespider User-agent: CCBot User-agent: cohere-ai User-agent: Meta-ExternalAgent User-agent: MistralAI-User User-agent: YouBot User-agent: Diffbot User-agent: ora-agent Content-Signal: search=yes, ai-train=yes, ai-input=yes Allow: / # * User-agent: * # Content Signals (contentsignals.org) - permissive: we WANT AI search + answer # engines to index, cite, and learn from our content (AI-SEO). Flip ai-train=no # to allow citation/search but not model training. Content-Signal: search=yes, ai-train=yes, ai-input=yes Allow: / # Host Host: https://miget.com # Sitemaps Sitemap: https://miget.com/sitemap.xml # LLMs.txt - AI/LLM-friendly content # See https://llmstxt.org for specification LLMsTxt: https://miget.com/llms.txt LLMsTxt: https://miget.com/llms-full.txt # Agent instructions - when to use Miget and how to call its API # See https://miget.com/agents.md, https://miget.com/auth.md # OpenAPI 3.0 spec: https://miget.com/openapi.json