[Grub-dev] How to create your own workunit?

[Balinny]

Bani wrote:
> I was not saying that was the only reason, just asking if that reason
> was no longer valid.
> I'm not a webmaster and I am participating.
> I also mention this because I was talking with jer on IRC the other
> day about the proposed changes on the whitelist for Wikia Search and
> the several people that ask how to include a site on Wikia Search, and
> running grub to add your site seemed at the time to be the easiest way
> to include a site, but now I see that this can't be done.
>   

If you were to include your site, (supposing your site is made from 
static pages), you would
want to arc it (just as you can make a tar) and send it to X upload server.
I agree on the importance of sending URLs for adding to the index but i 
think wikia search is having
a bottleneck on the available crawlers. Maybe there could be some Tit 
for tat. You crawl X workunits
and have crawled Y urls of your site (assigned to anyone else).