[Search-l] Coop - Custom search engine

Balinny balinny at gmail.com
Thu Sep 25 21:16:32 UTC 2008


Jeremie Miller wrote:
> A really really exciting step is happening in the current index- 
> building process right now, Dennis is busy adding support for external  
> scripts in Nutch's processing of the content for adding custom fields  
> to the index during the MapReduce phases... what this means is that  
> anyone can start contributing simple/small scripts in any language to  
> extend the index (for example marking any urls matching a regex or  
> list with X and then search filtering on X), making building tools  
> like this incredibly easier.
>
> It might take some time to get all the kinks worked out, but I think  
> we're talking weeks here, maybe a few more to get a new custom-field  
> index rolled out, so it's definitely in the near future :)
>
> Jer

Could you provide an example? Looks like it will be great, but I'm not 
chasing the scope.
Would the script provide select a subset for a given query, or be for a 
wide subset?
Would it score the matches?



More information about the Search-l mailing list