User-agent: * Disallow: /atad Disallow: /report Disallow: /images Disallow: /application.cfm Disallow: /requesterr.cfm Disallow: /senderror.cfm Disallow: /validationerr.cfm Disallow: /donation_thanks.cfm Disallow: /feedback_thanks.cfm Disallow: /footer.cfm Disallow: /header.cfm Disallow: /NextN.cfm Disallow: /submitfeedback.cfm Disallow: /submitvolunteerinfo.cfm Disallow: /volunteer_thanks.cfm # don't let search engines see the RSS feed, it's just confusing. User-agent: Googlebot User-agent: InfoNaviRobot User-agent: TV33_Mercator User-agent: AVSearch User-agent: Mercator User-agent: Scooter User-agent: Slurp User-agent: SearchengineLicenceSheep User-agent: shadow User-agent: MultiText User-agent: FAST-WebCrawler User-agent: Lycos_Spider User-agent: Atomz User-agent: htdig User-agent: spider00.logika.net User-agent: NetMechanic User-agent: libwww-perl User-agent: Teleport Pro Disallow: / # updated 2002-03-22 (disallow rtestprob links) # updated 2002-06-25 (disallow info/slides links, info/robots/) # updated 2002-07-25 (disallow /searchtools/ which is an alias) # updated 2003-09-27 by Chris Montgomery # updated 2003-11-14 by Chris Montgomery