[Grub-dev] Valid workunits

[jer]

> Yesterday i was asigned the following url:

Yeah, still some bad ones in there, the workunit generation will come  
straight from the hbase webdb in the near future and these should go  
away.

> PS: How goes the upload process? Are now server responses without
> headers 'valid'?

Seth has gotten hbase fairly stable (not regularly crashing) after  
some great detective work to find a race condition, but now it's  
having performance issues with the relatively small dataset already  
crawled/uploaded... we're trying some different approaches for  
storing the data to see if we can't get it to improve by an order of  
magnitude or two.  Might even have some more news tomorrow with luck :)

Jer