[Search-l] User Agent For Search Wikia

John McCormac jmcc at hackwatch.com
Thu Jan 3 16:07:52 UTC 2008


Dennis Kubes wrote:
> Yes that is the current bot.
> 
> Dennis
> 
> Seth Finkelstein wrote:
> 
>>On Thu, Jan 03, 2008 at 03:35:39PM +0000, John McCormac wrote:
>>
>>>What is the User Agent for Search Wikia?
>>
>>	Hmm ... looks like this is it:
>>
>>"Grub/2.0 (Grub.org crawler; http://www.grub.org/; bot at grub.org)"

Brilliant move - use one a UA that is on the blacklist for many sites. I 
think that only Nutch is as equally blacklisted.

Regards...jmcc
-- 
******************************************************
John McCormac  *  e-mail: jmcc at whoisireland.com
MC2            *  voice:  +353-51-873640
22 Viewmount   *  web:  http://www.whoisireland.com/
Waterford      *  blog: http://blog.whoisireland.com
Ireland        *  Irish Domain Stats & Market Research
******************************************************



More information about the Search-l mailing list