home *** CD-ROM | disk | FTP | other *** search
/ ftp.netscape.com (from bu.edu) / ftp.netscape.com.2013.04.zip / ftp.netscape.com / robots.txt < prev    next >
Text File  |  2004-03-17  |  103b  |  4 lines
  1. # This had to be implemented due to misconfigured robots hammering our site.
  2. User-agent: *
  3. Disallow: /
  4.