[Grub-dev] LZMA support in upload server
Balinny
balinny at gmail.com
Wed Feb 25 23:04:01 UTC 2009
Jeremie Miller wrote:
>> Where/how are they stored?
>>
>
> As workunit files :) At some point they exist as a flat list of one
> url per line feeding through stdin/stdout but then they're fed into
> this:
> http://svn.swlabs.org/grubng/trunk/perl/workunit.pl
>
So, how is the flat list generated? I assumed it was read from some kind
of database ^-^
And if there isn't a database, where is annotated that a URL has been
crawled / hasn't
been crawled yet?
More information about the Grub-dev
mailing list