# robots.txt to block all bots except bots from Google , MSN , Yahoo #User-agent: Googlebot #Disallow: #User-agent: Slurp #Disallow: #User-agent: MSNBot #Disallow: #User-agent: ia_archiver #Disallow: #User-agent: * #Disallow: / User-agent: * Allow: /