home *** CD-ROM | disk | FTP | other *** search
/ PC Professionell 2006 September / PCpro_2006_09.ISO / docs / Seagate / www.seagate.com / robots.txt < prev   
Encoding:
Text File  |  2005-09-09  |  428 b   |  17 lines
  1. # This is a file retrieved by spiders that 
  2. # conform to a defacto standard.
  3. # See <URL:http://info.webcrawler.com/mak/projects/robots/robots.html>
  4. #
  5. # The webmaster for this site is <webmaster@seagate.com>
  6. #
  7. # robots.txt for www.seagate.com  -- 010314 -- kevinw
  8.  
  9. User-agent: *
  10. Disallow: /cgi-bin     # Prevents CGIs from being indexed
  11. Disallow: /redirects  # Don't want to corrupt data
  12. Disallow: /images  
  13.  
  14.  
  15.  
  16.  
  17.