[Search-l] Wikia - Global focus or country level search?

[jer]

>> There isn't "a" plan at all, there's lots of ideas and projects,  
>> and  many more to come.
>
> So there isn't "a" plan then. Is there even a strategy?

Transparency, Community, Quality, and Privacy.  The strategy is to  
support development of any search technology or resource according to  
those four principles.

> No. I was building a search index and cleaning out rubbish from it  
> - real search engine work.

Real closed search engine work.

> A bit of dot.bomb dejavue. Search is a business. Those who don't  
> approach it as such end up getting devoured by it. That's why  
> Google, Yahoo and Microsoft dominate the market. They don't blindly  
> hope that things will happen. They make them happen.

A quote I just saw seems appropriate:

"Hope is definitely not the same thing as optimism. It is not the  
conviction that something will turn out well, but the certainty that  
something makes sense, regardless of how it turns out." - Vaclav Havel.

>
>> Do you have a specific question?   I'm doing my best to  
>> contribute,  it just may not be to your satisfaction as it's not  
>> in practical  forms (yet).
>
> For the list:
>
> What projects exist?

Atlas, Grub, Intellisophic's to-be-named text categorization engine,  
that's what exists now.

> What resources exist?
> What assets exist?

There's some donated hardware from Wikia and Dell at swlabs.org, any  
open source search project is welcome to use it for development, as  
well as anyone wanting to experiment and learn about other OS search  
projects like Nutch, hadoop, and YaCy.

> What is the collective knowledge in Wikia that is available to  
> developers?

Collective knowledge?  This is about *creating* knowledge, new ways  
of organizing and building a search engine openly.  If you're talking  
about collecting content and indexing, we're just not there yet, but  
getting closer and closer.

> What is available to developers?

Now that some of the kinks are worked out of grub.org we can finally  
get the source repos online and begin expanding the vision  
significantly.  The resulting crawls/updates will be available for  
any OS developer to start experimenting with, at least lowering the  
bar a little bit, it's a step and an experiment.

Jer