[Grub-dev] How to create your own workunit?

ab spam at abittner.de
Sun Feb 17 11:40:36 UTC 2008


Bani wrote:
> I would like to try crawling some URLs specified by me, but I'm not
> sure about how to create my own workunit. I've tried getting one from
> http://dispatch.grub.org/do/workunit and editing all the sites, but in
> the end I got a 401 Unauthorized. This doesn't seem right, so I'm not

i guess you can generate and crawl your own unit, but you cant upload 
it, as it would allow spammers/scammers/abusers to inject "trash" or bad 
data into the database or hammer the servers.

> sure about how I should generate my PUT line.
> The workunit I tried to use is at http://www.ime.usp.br/~bani/tmp/workunit

if you can live without the upload, then simply work on your simulated 
workunits without the last step.


More information about the Grub-dev mailing list