# Robots.txt for zeboudoir.com # Grant access to Adsense bots User-agent: Mediapartners-Google* Disallow: # Only Alexa crawler User-agent: ia_archiver Disallow: User-agent: * Disallow: /Site/