<div dir="ltr">Sweet! That's beautiful. I can picture hundreds of of little brokers serving up interesting bits of information, and being pulled into meta-search results in the client, providing a richer and more up-to-date experience for the searcher... very cool. Tell you what, if there's any interest, I've got small datasets at both <a href="http://wikidweb.com" target="_blank">wikidweb.com</a> (domain level, mostly, about 40k listings, GFDL) and <a href="http://tagthis.info" target="_blank">tagthis.info</a> (page level, don't know how many off the top of my head, no license selected yet... gotta do that...) that I'd be happy to publish via js api call, to help feed such a thing. Getting data from larger vendors (<a href="http://del.ico.us" target="_blank">del.ico.us</a>, stumbleupon, whoever) would be better of course, but... :-)<div>
<br></div><div>Cool...<br></div><div><br></div><div>I've got this whole vision (I continue to think it's pretty close to your vision) of a much more interconected, cross-pollinating internet, with data shared, aggregated, ranked, and shared again much more freely... Somewhat off topic, I'm working on something simple and waaay compelling: RSS type feeds for events, and then an aggregator/search engine to find events. (Think of it, garage sales, concerts, sports events, all published in an atom feed, and searchable by date and location...) - I'm working on a prototype/promotional website at <a href="http://eventfeed.org">http://eventfeed.org</a> - I plan to open source the (relatively simple) code in an effort for greater adoption. (It's really simple and rough right now, but basically works.)<br>
<div><br></div><div>Best Regards,</div><div>Aerik</div><div><br></div><div><div><br><div class="gmail_quote">On Thu, Sep 4, 2008 at 9:44 AM, Jeremie Miller <span dir="ltr"><<a href="mailto:jeremie@jabber.org" target="_blank">jeremie@jabber.org</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Heh, that's almost exactly how the JS behind the current re.search<br>
stuff works, it's pulling in and merging between two indexes currently<br>
(nutch and KT contribs, and another recent idea is to build a third<br>
index of just page summaries so we can fit more into our limited<br>
resources). One of our important principles is to try and use only<br>
open-source-built and freely-licensed indexes too :)<br>
<br>
The "widgets" (or whatever you want to call them) discussion is very<br>
close to this also, triggering the merge of other custom results into<br>
any search, and there's some working going on now to clean up the JS<br>
to support this even better.<br>
<br>
Jer<br>
<div><div></div><div><br>
On Sep 3, 2008, at 3:45 PM, Aerik Sylvan wrote:<br>
<br>
> Crossposting this - not sure of the best home for it...<br>
><br>
> So, we have the the beginnings of code and a framework that really<br>
> facilitates multiple indexes, with factories and brokers and<br>
> collectors... How about moving the processing of the final result to<br>
> the client? In other words, meta search via javascript. You get a<br>
> lot of nifty things with that architecture - one of the big bits is<br>
> that it reduces the server resources needed to aggregate results.<br>
> It increases bandwidth, becuase you'd need to server perhaps the top<br>
> 100 results from each index you're querying, and let the client<br>
> whittle them down to the top 10 combined result.<br>
><br>
> Anybody working/thinking in that direction?<br>
><br>
> (Had this thought for awhile, but the news of Google Chrome's js<br>
> engine being 10+ times faster makes it even more intriguing).<br>
><br>
> Best Regards,<br>
> Aerik<br>
><br>
> --<br>
> <a href="http://www.wikidweb.com" target="_blank">http://www.wikidweb.com</a> - the Wiki Directory of the Web<br>
> <a href="http://tagthis.info" target="_blank">http://tagthis.info</a> - Hosted Tagging for your website!<br>
</div></div>> _______________________________________________<br>
> Wikia Search mailing list<br>
> <a href="http://re.search.wikia.com/" target="_blank">http://re.search.wikia.com/</a><br>
> Change options or unsubscribe: <a href="http://lists.wikia.com/mailman/options/search-l" target="_blank">http://lists.wikia.com/mailman/options/search-l</a><br>
<br>
_______________________________________________<br>
Wikia Search mailing list<br>
<a href="http://re.search.wikia.com/" target="_blank">http://re.search.wikia.com/</a><br>
Change options or unsubscribe: <a href="http://lists.wikia.com/mailman/options/search-l" target="_blank">http://lists.wikia.com/mailman/options/search-l</a><br>
</blockquote></div><br><br clear="all"><br>-- <br><a href="http://www.wikidweb.com" target="_blank">http://www.wikidweb.com</a> - the Wiki Directory of the Web<br><a href="http://tagthis.info" target="_blank">http://tagthis.info</a> - Hosted Tagging for your website!<br>
</div></div></div></div>