# The LaSallian — crawler policy (deployed by Ansible: wordpress role) # Served as a static file by nginx (location = /robots.txt) so plugin or CDN # changes cannot regress it. See SEO_HEADLESS_PLAYBOOK.md for the rationale. # # Policy: allow every crawler (search, social, AI) except wp-admin internals. # AI Overview / AI Mode eligibility is governed by Googlebot access + snippet # controls; ChatGPT Search, Perplexity and Claude search each require their # own bot token allowed here. Do NOT add Disallow rules for GPTBot, # OAI-SearchBot, ClaudeBot, Claude-SearchBot, PerplexityBot, Google-Extended. User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://thelasallian.com/sitemap.xml Sitemap: https://thelasallian.com/sitemap-index-1.xml Sitemap: https://thelasallian.com/image-sitemap-index-1.xml Sitemap: https://thelasallian.com/video-sitemap-1.xml Sitemap: https://thelasallian.com/news-sitemap.xml Sitemap: https://thelasallian.com/sitemap-prints.xml Sitemap: https://thelasallian.com/sitemap-static.xml