# This directs automatic www robots, crawlers # and mappers to directories they may spider on ratguide.com. User-agent: * Disallow: /images/ Disallow: /logs/ Disallow: /missing.html Disallow: /internal_error.html Disallow: /failed_auth.html Disallow: /fobidden.html Disallow: /scripts/ Disallow: /stats/ Disallow: /texts/ Disallow: /logos/ Disallow: /banners/ Disallow: /mt/ Disallow: /backup/ Disallow: /poll/ Disallow: /templates/ Disallow: /savedratguide/ User-agent: vscooter #AltaVista Image Search Disallow: / User-agent: ArribaPacketRat #Arriva Vista Disallow: / User-agent: ExcaliburInternetSpider #Yahoo Image Surfer Disallow: / User-agent: Googlebot-Image #Googlebot Image Search Disallow: / #Yahoo Image Surfer User-agent: Yahoo-MMCrawler Disallow: /