[Grub-dev] grub server/clientt

[Bartek Jasicki]

On 2009-01-09, at 07:45:38
"bruce" <bedouglas at earthlink.net> wrote:

> Hi...
> 
> New to grub. just discovered it... (or rediscovered it)
> 
> I have a possible project that I'm playing around with. In the
> concept stage right now. But I wanted to get some
> information/understanding about Grub, beyond what I've found on the
> net (grub.org).
> 
> As I understand grub, it's a server/client app, that allows clients
> to be run on multiple client servers, and that these client apps
> actualy perform the fetching of the pages from the targeted sites...
> Do I have this correct?
> 

Hi

Yes, little more clarify:
1) Dispatch server create file (we call it workunit) with a list of
URL's to crawl.
2) Clients connect to dispatch server, download workunit file and start
visiting URL's and write results to .arc file.
3) After crawling, clients send .arc file to upload server.
4) Back to #1

> I'm toying with an idea for a very specific crawling kind of
> function, and it might make sense to use/examine the grub
> server/client process to see how it works. I'm also looking into the
> BOINC project as well.
> 
> Is there someone I can talk to to get additional information, or is
> this the best forum for these questions... Is there an IRC channel as
> well?
> 
> thanks
> 
> -bruce
> 

If you have any questions, you can ask it here (probably it is fastest
way to get answer), on page forum or on our IRC channel - #wikia-search
at irc.freenode.net (but IRC is the longest way to get some help with
Grub, mainly because, it is not too popular ;) ).

Best Regards

Bartek Jasicki

-- 
Grub Next Generation: http://grub.org
Mailing List: grub-dev at wikia.com
IRC: #wikia-search at irc.freenode.net
Jabber: thindil at jabberpl.org