User-agent: psbot Disallow: / # Rover is a bad dog User-agent: Roverbot Disallow: / User-agent: Mac Finder Disallow: / User-agent: NextGenSearchBot Disallow: / # EmailSiphon is a hunter/gatherer which extracts email addresses for # spam-mailers to use User-agent: EmailSiphon Disallow: / # Blocking Teleport Pro downloader User-agent: Teleport Pro Disallow: / User-agent: * Disallow: /images/ Disallow: /fls2/ Disallow: /c1/ Disallow: /errors/ Disallow: /logs/ Disallow: /Smems/ Disallow: /web/ # Ignore FrontPage Files Disallow: /_borders/ Disallow: /derived/ Disallow: /_fpclass/ Disallow: /_overlay/ Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_txt/ Disallow: /_themes/ Disallow: /_derived/ User-agent: Mediapartners-Google* Disallow: /c1/ Disallow: /errors/ Disallow: /fls1/ Disallow: /fls2/ Disallow: /img1/ Disallow: /logs/ Disallow: /Smems/ Disallow: /web/ # Ignore FrontPage Files Disallow: /_borders/ Disallow: /derived/ Disallow: /_fpclass/ Disallow: /_overlay/ Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_txt/ Disallow: /_themes/ Disallow: /_derived/