# robots.txt for https://moniqueharriswhitt.com # AI and answer-engine crawlers are welcome to index public pages (see /ai.txt). # They share the rules below: a crawler that matches its own group ignores the "*" group, # so the private paths are listed once for everyone. User-agent: * User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Bingbot Allow: / Disallow: /api/ Disallow: /admin/ Sitemap: https://moniqueharriswhitt.com/sitemap.xml