# hello robots & spiders! User-agent: Mediapartners-Google* Disallow: User-agent: Slurp Crawl-delay: 200 User-agent: MSIECrawler Disallow: / User-agent: Fasterfox Disallow: / User-agent: WebReaper Disallow: / User-agent: * Disallow: /css/ Disallow: /js/ Disallow: /gfx/ Disallow: /img/ Disallow: /xml/ Disallow: /swf/