home *** CD-ROM | disk | FTP | other *** search
/ linuxmafia.com 2016 / linuxmafia.com.tar / linuxmafia.com / robots.txt-SAVE < prev   
Text File  |  2009-07-26  |  69b  |  6 lines
  1. User-agent: Slurp
  2. Crawl-delay: 2
  3.  
  4. User-agent: *
  5. Disallow: /calendar/
  6.