[Search-l] User Agent For Search Wikia

[Jimmy Wales]

We are also crawling using Nutch... not sure what the user agent is for 
that.

Seth Finkelstein wrote:
> On Thu, Jan 03, 2008 at 03:35:39PM +0000, John McCormac wrote:
>> What is the User Agent for Search Wikia?
> 
> 	Hmm ... looks like this is it:
> 
> "Grub/2.0 (Grub.org crawler; http://www.grub.org/; bot at grub.org)"
> 
>  IP: 149.20.54.195 
> 
>  Resolves to: www.isc.swlabs.org
> 
>   and:
> 
>  OrgName:    Internet Systems Consortium, Inc. 
>  OrgID:      ISC-94
>  Address:    950 Charter Street
>  City:       Redwood City
>  StateProv:  CA
>  PostalCode: 94063
>  Country:    US
>