User-agent: * Sitemap: http://www.amateurwifevideos.com/sitemap_index.xml Disallow: /search/ Crawl-delay: 2 User-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: 008 Disallow: / User-agent: BLEXBot Disallow: / User-agent: sistrix Disallow: / User-agent: ia_archiver Disallow: / User-agent: proximic Disallow: / User-agent: SiteExplorer Disallow: / User-agent: Baiduspider Crawl-delay: 30 User-agent: MSNBot Crawl-delay: 7 User-agent: Bingbot Crawl-delay: 7