[Grub-dev] LZMA support in upload server

Jeremie Miller jeremie at jabber.org
Wed Feb 25 22:45:20 UTC 2009


>> They're derived from an initial dump of urls from here from last  
>> year:
>> 	http://index.isc.org/download/index
>> And supposed to be regularly including submissions from here (but  
>> it's
>> manual right now):
>> 	http://dispatch.grub.org/maps/
>>
> Where/how are they stored?

As workunit files :)  At some point they exist as a flat list of one  
url per line feeding through stdin/stdout but then they're fed into  
this:
	http://svn.swlabs.org/grubng/trunk/perl/workunit.pl

> What would need a workunit-generator to read the db?

There isn't a DB?

> Should sitemaps creation be added to other clients, then?

Sure!  It's not required but it's a nice way to help close the loop  
and collect more urls to be fed in.  The sitemap file also supports  
the last-modified and etags that can be added as conditional headers  
in the workunits too :)

Jer



More information about the Grub-dev mailing list