User-agent: * Disallow: /Application.cfm Disallow: /error.cfm Disallow: /left_nav.cfm Disallow: /left_nav2.cfm Disallow: /lib Disallow: /print_article.cfm Disallow: /right_nav.cfm Disallow: /right_nav_old.cfm Disallow: /pretemp.cfm Disallow: /temp.cfm Disallow: /cgi-bin Disallow: /Connections Disallow: /content Disallow: /content2 Disallow: /dsn.cfm Disallow: /print.cfm Disallow: /Templates #idiot-bot; generates tons of 404 and malformed urls User-agent: wget Disallow: / #User-agent: ExtractorPro #Disallow: /