[Search-l] Search Team Update: July 23, 2008

Dan Lewis dan at wikia-inc.com
Wed Jul 23 18:33:56 UTC 2008


Here's what the Search team did last week:

Nutch
* Finish FieldIndexer
* Finished BasicFields
* Working on AnchorFields

These are all part of the new Indexer that will allow fine grained control
of fields that go into our index.  The FieldIndexer is the actual indexer
itself that replaces the current Nutch indexer.  The BasicFields replaces
the current nutch functionality for fields from the indexer and
BasicIndexingFilter plugin.  The AnchorFields both replaces the current
AnchorIndexingPlugin and enhances it to allow analysis and ordering by score
of anchors to be indexed.  The AnchorFields job should be finished, tested,
and ready for larger deployment early this coming week

Search Tools
* Worked on a new, experimental "light" fork to the results UI
* Lots of work testing new KT tools in development
* Brainstorming about the widget framework and how to speed up results
* Lots of work with the crawler, trying to find the source of very high
fetch failure rates
* Continued development of the toolbar

Community Tools:
* Began work on a contact importer
* Created interface for translating Wikia Search interface

Operations:
* Deploy-redploy of KT /ktdev/, started review of code
* Started work on determining new hardware requirements
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.wikia.com/pipermail/search-l/attachments/20080723/fc70c8ab/attachment.html 


More information about the Search-l mailing list