# robots text for growvotes.org #Google's bot User-agent: Googlebot Disallow: /ballot/add/ Disallow: /home/city_state Disallow: /account/ Disallow: /feedbacks/ Disallow: /users/new Disallow: /terms-of-service.html Disallow: /privacy-policy.html Disallow: /honesty-policy.html Disallow: /blog/democratsabroad.org Disallow: /noexist_7083d839ed610393.html Crawl-delay: 0.5 #Cuil's bot User-agent: twiceler Disallow: /ballot/add/ Disallow: /home/city_state Disallow: /account/ Disallow: /feedbacks/ Disallow: /users/new Disallow: /terms-of-service.html Disallow: /privacy-policy.html Disallow: /honesty-policy.html Disallow: /blog/democratsabroad.org Crawl-delay: 0.5 #Yahoo!'s bot User-agent: Slurp Disallow: /ballot/add/ Disallow: /home/city_state Disallow: /account/ Disallow: /feedbacks/ Disallow: /users/new Disallow: /terms-of-service.html Disallow: /privacy-policy.html Disallow: /honesty-policy.html Disallow: /blog/democratsabroad.org Disallow: /SlurpConfirm404/ Disallow: /SlurpConfirm404.htm Crawl-delay: 0.5 #MSN's bots User-agent: MSNBot Disallow: /ballot/add/ Disallow: /home/city_state Disallow: /account/ Disallow: /feedbacks/ Disallow: /users/new Disallow: /terms-of-service.html Disallow: /privacy-policy.html Disallow: /honesty-policy.html Disallow: /blog/democratsabroad.org Crawl-delay: 0.5 User-agent: MSRbot Disallow: /ballot/add/ Disallow: /home/city_state Disallow: /account/ Disallow: /feedbacks/ Disallow: /users/new Disallow: /terms-of-service.html Disallow: /privacy-policy.html Disallow: /honesty-policy.html Disallow: /blog/democratsabroad.org Crawl-delay: 1 #Gigablast's bot User-agent: Gigabot Disallow: /ballot/add/ Disallow: /home/city_state Disallow: /account/ Disallow: /feedbacks/ Disallow: /users/new Disallow: /terms-of-service.html Disallow: /privacy-policy.html Disallow: /honesty-policy.html Disallow: /blog/democratsabroad.org Crawl-delay: 0.5 #Ask.com's bot User-agent: Teoma Disallow: /ballot/add/ Disallow: /home/city_state Disallow: /account/ Disallow: /feedbacks/ Disallow: /users/new Disallow: /terms-of-service.html Disallow: /privacy-policy.html Disallow: /honesty-policy.html Disallow: /blog/democratsabroad.org Crawl-delay: 0.5 #CyberPatrol's bot User-agent: CyberPatrol SiteCat Webbot Disallow: /ballot/add/ Disallow: /home/city_state Disallow: /account/ Disallow: /feedbacks/ Disallow: /users/new Disallow: /terms-of-service.html Disallow: /privacy-policy.html Disallow: /honesty-policy.html Disallow: /blog/democratsabroad.org Crawl-delay: 1 #ScoutJet's bot (New Engine) User-agent: ScoutJet Disallow: /ballot/add/ Disallow: /home/city_state Disallow: /account/ Disallow: /feedbacks/ Disallow: /users/new Disallow: /terms-of-service.html Disallow: /privacy-policy.html Disallow: /honesty-policy.html Disallow: /blog/democratsabroad.org Crawl-delay: 1 #Picsearch's bot User-agent: psbot Disallow: /images/alpha/facebook-icons.gif Crawl-delay: 1 #Yanga's bot. Not sure if correct. (british engine) User-agent: Yanga WorldSearch Bot Disallow: /ballot/add/ Disallow: /home/city_state Disallow: /account/ Disallow: /feedbacks/ Disallow: /users/new Disallow: /terms-of-service.html Disallow: /privacy-policy.html Disallow: /honesty-policy.html Disallow: /blog/democratsabroad.org Crawl-delay: 1.5 #radian6 http://www.radian6.com/ bot. (social media crawler) User-agent: R6_FeedFetcher Disallow: / Allow: /blog/ Crawl-delay: 1 #Goo's bot (Asian engine) User-agent: ichiro Disallow: / #Become.com's Bot (Shopping Related Site) User-Agent: BecomeBot Disallow: / #Bad Spambot Agent: Morfeus Fucking Scanner Disallow: / User-Agent: * Disallow: /