Programming Forums
User Name Password Register
 

RSS Feed
FORUM INDEX | TODAY'S POSTS | UNANSWERED THREADS | ADVANCED SEARCH

Reply
 
Thread Tools Display Modes
Old Sep 29th, 2005, 10:54 AM   #1
Ringo
Newbie
 
Join Date: Sep 2005
Location: Cambridge, UK
Posts: 13
Rep Power: 0 Ringo is on a distinguished road
Beowulf Cluster Manager.....

I have started another thread to make this tidy - if this needs moving then please let me know.

Some nice guy (Infinite Recursion) suggested i write some software to create a manager for a linux based Beowulf Cluster as a good idea of getting back into C programming.

Very good idea i thought - so i had a little think about it....

Mind map of very basic operation

Initial problems are:
1) It is apparent that i will need an OS - or someway of simulating this. A round robin routine won't work as i will need some way of interrupting the background processes when the user wants to interact. Is this over complicating the exercise ?
2) The test harness will probably have to be run on the same PC (running windows). Is this possible ?
3) Im not too sure about setting up communications between the manager and the test harness but this is probably getting a bit ahead of myself. (Sockets ?)

Please feel free to comment and give suggestions if you like - especially on my problems!

Thanks

Ringo
Ringo is offline   Reply With Quote
Old Sep 29th, 2005, 11:09 AM   #2
pr0gm3r
Hobbyist Programmer
 
Join Date: Dec 2004
Location: CA
Posts: 102
Rep Power: 4 pr0gm3r is on a distinguished road
Send a message via MSN to pr0gm3r
Post

1. I think you should develop it in Linux OS instead of Windows because lack of internal access in windows and the src are not provided for Hybird Kernel. I believe you need to manipulate the Cluster with the Kernel of operating system right?

2. NOt very sure...
3. Have you check out Beowulf-style Compute Cluster yet.

I am not too sure about Beowulf Clustering.

you can also check this site to further help you with Beowulf Clustering
www.beowulf.org/
__________________
--
pr0gm3r
pr0gm3r is offline   Reply With Quote
Old Sep 29th, 2005, 11:28 AM   #3
Infinite Recursion
Programming Guru
 
Infinite Recursion's Avatar
 
Join Date: Jul 2004
Location: United States
Posts: 3,467
Rep Power: 8 Infinite Recursion is on a distinguished road
Send a message via MSN to Infinite Recursion Send a message via Yahoo to Infinite Recursion
Glad to see you are interested in what I suggested.

1) Drop any concept of windows and go with Linux.
2) This is fine, similar to running a client / server program on the same computer for testing purposes.
3) Yes, sockets, time-synched daemons, or some derivative.

This definitely a good site. www.beowulf.org
Here is a picture of a beowulf cluster for those who are wondering what we are talking about: http://jasonpowers.net/images/LoBoS2.jpg

Initially, you may want to create a simulator of a linux network for simplicity, if you are not to familiar with the client/server side of coding. Then as the pieces of code start coming together you can pull out the simulator and put in the actual systems, if you have some to spare.
__________________
http://jasonpowers.net

"There are a thousand hacking at the branches of evil to one who is striking at the root."
Infinite Recursion is offline   Reply With Quote
Old Sep 29th, 2005, 11:49 AM   #4
Ringo
Newbie
 
Join Date: Sep 2005
Location: Cambridge, UK
Posts: 13
Rep Power: 0 Ringo is on a distinguished road
It had to happen sometime i suppose - i need to get linux then!

What do you recommend ? Will need to create a dual boot so i can get windows too.

That website was the first hit on google! Very good.

Thanks

Ringo
Ringo is offline   Reply With Quote
Old Sep 29th, 2005, 12:25 PM   #5
Infinite Recursion
Programming Guru
 
Infinite Recursion's Avatar
 
Join Date: Jul 2004
Location: United States
Posts: 3,467
Rep Power: 8 Infinite Recursion is on a distinguished road
Send a message via MSN to Infinite Recursion Send a message via Yahoo to Infinite Recursion
you can dual boot windows...

I suggest Fedore Core 4.
__________________
http://jasonpowers.net

"There are a thousand hacking at the branches of evil to one who is striking at the root."
Infinite Recursion is offline   Reply With Quote
Old Sep 29th, 2005, 3:23 PM   #6
iignotus
Professional Programmer
 
iignotus's Avatar
 
Join Date: Apr 2005
Location: Nowhere Special
Posts: 466
Rep Power: 4 iignotus is on a distinguished road
Send a message via AIM to iignotus
Imagine a Beowulf Cluster of these Beowulf Cluster Managers, all managing Beowulf Clusters at the same *explodes*
__________________
% rc4 hexkey < input > output
#define S ,t=s[i],s[i]=s[j],s[j]=t /* rc4 hexkey <file */
unsigned char k[256],s[256],i,j,t;main(c,v,e)char**v;{++v;while(++i)s[ 
i]=i;for(c=0;*(*v)++;k[c++]=e)sscanf((*v)++-1,"%2x",&e);while(j+=s[i]
+k[i%c]S,++i);for(j=0;c=~getchar();putchar(~c^s[t+=s[i]]))j+=s[++i]S;}
iignotus is offline   Reply With Quote
Old Sep 29th, 2005, 3:37 PM   #7
Polyphemus_
Expert Programmer
 
Polyphemus_'s Avatar
 
Join Date: Aug 2005
Location: Rotterdam, the Netherlands
Posts: 942
Rep Power: 4 Polyphemus_ is on a distinguished road
Quote:
I suggest Fedore Core 4.
i prefer suse..
Polyphemus_ is offline   Reply With Quote
Old Sep 29th, 2005, 3:52 PM   #8
BinaryStorm
Programmer
 
BinaryStorm's Avatar
 
Join Date: Sep 2005
Location: Požega, Croatia
Posts: 93
Rep Power: 4 BinaryStorm is on a distinguished road
I prefer FC too. You get whole bunch of software that you will probably never need.
YellowDog Linux would be good choice also. Or RedHat Server.
__________________
1001 1101 1001 1110 0101 1102 ?! AAAAARRGGHHH
_____________________
Free&Premium Web hosting reviews. Click here!
Money making oasis. Run your own home based biz.
BinaryStorm is offline   Reply With Quote
Old Sep 29th, 2005, 6:13 PM   #9
Infinite Recursion
Programming Guru
 
Infinite Recursion's Avatar
 
Join Date: Jul 2004
Location: United States
Posts: 3,467
Rep Power: 8 Infinite Recursion is on a distinguished road
Send a message via MSN to Infinite Recursion Send a message via Yahoo to Infinite Recursion
Suse is bloated... for that matter you could always use Ubuntu.

I'd go with Redhat Enterprise Server at the core and Fedore Core 4 for your member servers.
__________________
http://jasonpowers.net

"There are a thousand hacking at the branches of evil to one who is striking at the root."
Infinite Recursion is offline   Reply With Quote
Reply

Bookmarks

« Previous Thread in Forum | Next Thread in Forum »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump




DaniWeb IT Discussion Community
All times are GMT -5. The time now is 3:12 AM.

Powered by vBulletin® Version 3.7.0, Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Copyright ©2007 DaniWeb® LLC