Fravia's Message Board ~ Moderated
Re: Re: DIGIMARK is scanning the web
Thursday, 05-Nov-98 03:34:42

Yes, all search engines bots are supposed to respect some rules. Yet there are many many private (and funny) bots out there that do'nt respect anything at all. Best bots are very difficult to log, because they have 'normal user' names, like hcp07137.tpd.tno.nl, and you just HAVE to know that there are no hcp followed by a zero on tpd.tno.nl to spot it...

Yet bots hunting is great fun

later
fravia+


fravia+