# W3C Link checker User-agent: W3C-checklink Disallow: # exclude some access-controlled areas User-agent: * Disallow: /_private/ Disallow: /_temp/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_pvt/ Disallow: /_vti_log/ Disallow: /_vti_txt/ Disallow: /admin/ Disallow: /admin2/ Disallow: /cgi-bin/ Disallow: /exf/ Disallow: /cbdsw2005/ Disallow: /iface/