# Robots.txt for traduwiki.org User-agent: * Allow: / Disallow: /info.txt Disallow: /Site/ Disallow: /SiteAdmin/ # Grant access to Adsense bots User-agent: Mediapartners-Google* Disallow: # Only Alexa crawler User-agent: ia_archiver Disallow: Disallow: /Site/ Disallow: /SiteAdmin/