User-agent: * Disallow: /admin/ Disallow: /bin/ Disallow: /Connections/ Allow: /i/ Disallow: /inc/ Disallow: /docs/ Disallow: /*.pdf$ Disallow: /*.doc$ Disallow: /*.xls$ Disallow: /*.docx$ Allow: /inc/gallery/ Allow: /i/photos/Gallery/ Sitemap: http://www.vividisesites.co.uk/sitemap.xml # BEGIN Greenhouse AI crawler restrictions User-agent: GPTBot User-agent: ClaudeBot User-agent: CCBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Bytespider User-agent: Meta-ExternalAgent User-agent: img2dataset Disallow: /inc/gallery/ Disallow: /i/photos/Gallery/ # END Greenhouse AI crawler restrictions