[Grub-dev] LZMA support in upload server
Jeremie Miller
jeremie at jabber.org
Wed Feb 25 22:45:20 UTC 2009
>> They're derived from an initial dump of urls from here from last
>> year:
>> http://index.isc.org/download/index
>> And supposed to be regularly including submissions from here (but
>> it's
>> manual right now):
>> http://dispatch.grub.org/maps/
>>
> Where/how are they stored?
As workunit files :) At some point they exist as a flat list of one
url per line feeding through stdin/stdout but then they're fed into
this:
http://svn.swlabs.org/grubng/trunk/perl/workunit.pl
> What would need a workunit-generator to read the db?
There isn't a DB?
> Should sitemaps creation be added to other clients, then?
Sure! It's not required but it's a nice way to help close the loop
and collect more urls to be fed in. The sitemap file also supports
the last-modified and etags that can be added as conditional headers
in the workunits too :)
Jer
More information about the Grub-dev
mailing list