[Search-l] User Agent For Search Wikia

[Dennis Kubes]

That is the current UA we are using for the Nutch crawling.


Jimmy Wales wrote:
> We are also crawling using Nutch... not sure what the user agent is for 
> that.
> 
> Seth Finkelstein wrote:
>> On Thu, Jan 03, 2008 at 03:35:39PM +0000, John McCormac wrote:
>>> What is the User Agent for Search Wikia?
>> 	Hmm ... looks like this is it:
>>
>> "Grub/2.0 (Grub.org crawler; http://www.grub.org/; bot at grub.org)"
>>
>>  IP: 149.20.54.195 
>>
>>  Resolves to: www.isc.swlabs.org
>>
>>   and:
>>
>>  OrgName:    Internet Systems Consortium, Inc. 
>>  OrgID:      ISC-94
>>  Address:    950 Charter Street
>>  City:       Redwood City
>>  StateProv:  CA
>>  PostalCode: 94063
>>  Country:    US
>>
> 
> _______________________________________________
> Search-l mailing list
> Search-l at wikia.com
> http://lists.wikia.com/mailman/listinfo/search-l
> Change options or unsubscribe: http://lists.wikia.com/mailman/options/search-l