[Search-l] User Agent For Search Wikia
John McCormac
jmcc at hackwatch.com
Thu Jan 3 16:07:52 UTC 2008
Dennis Kubes wrote:
> Yes that is the current bot.
>
> Dennis
>
> Seth Finkelstein wrote:
>
>>On Thu, Jan 03, 2008 at 03:35:39PM +0000, John McCormac wrote:
>>
>>>What is the User Agent for Search Wikia?
>>
>> Hmm ... looks like this is it:
>>
>>"Grub/2.0 (Grub.org crawler; http://www.grub.org/; bot at grub.org)"
Brilliant move - use one a UA that is on the blacklist for many sites. I
think that only Nutch is as equally blacklisted.
Regards...jmcc
--
******************************************************
John McCormac * e-mail: jmcc at whoisireland.com
MC2 * voice: +353-51-873640
22 Viewmount * web: http://www.whoisireland.com/
Waterford * blog: http://blog.whoisireland.com
Ireland * Irish Domain Stats & Market Research
******************************************************
More information about the Search-l
mailing list