Author Topic: Turn Internet Servers Into Free Supercomputer  (Read 4851 times)

0 Members and 1 Guest are viewing this topic.

Offline voyager2Topic starter

  • Supreme Robot
  • *****
  • Posts: 463
  • Helpful? 6
    • Voyager Robotics
Turn Internet Servers Into Free Supercomputer
« on: September 28, 2010, 07:07:31 PM »
Hi All,

I had another one of my "ideas":
I was thinking of a better way to let the average Joe have his own super computer, than hooking up two thousand PlayStation 3s

How about using internet servers?
Join the servers, somehow, i've heard that Server to Server transfer is really fast, then have them share the load.

You can sign up for free server space at 000webhost , with 1.5GB of space, and 99.9% uptime.

Anyone tried to do this?
It might be my next project... ::)

Voyager
« Last Edit: September 28, 2010, 07:08:58 PM by voyager2 »
And Admin said "Let there be robots!"
And it was good.

Offline madsci1016

  • Contest Winner
  • Supreme Robot
  • ****
  • Posts: 1,450
  • Helpful? 43
    • Personal Website
Re: Turn Internet Servers Into Free Supercomputer
« Reply #1 on: September 28, 2010, 08:08:44 PM »
You can sign up for free server space at 000webhost , with 1.5GB of space, and 99.9% uptime.

Nope, won't work. All hosting companies use shared servers. They can host thousands of accounts on one server. So you would have to sign up for thousands of accounts before you had the power of a single server.

You can get a 'dedicated host', which means you are the only account on a server, but they cost hundreds of $ per month to have. By the time you get a cluster going, might as well have bought all those PS3s.

Offline voyager2Topic starter

  • Supreme Robot
  • *****
  • Posts: 463
  • Helpful? 6
    • Voyager Robotics
Re: Turn Internet Servers Into Free Supercomputer
« Reply #2 on: September 28, 2010, 08:13:59 PM »
The thing is, with this, you don't have to pay for the electricity, and you don't realy need to have a server as such, the server computer will still be computing it all.
And Admin said "Let there be robots!"
And it was good.

Offline madsci1016

  • Contest Winner
  • Supreme Robot
  • ****
  • Posts: 1,450
  • Helpful? 43
    • Personal Website
Re: Turn Internet Servers Into Free Supercomputer
« Reply #3 on: September 28, 2010, 08:18:47 PM »
The thing is, with this, you don't have to pay for the electricity, and you don't realy need to have a server as such, the server computer will still be computing it all.


Your missing the point, the server's are already operating at near 100% load just serving the pages for thousands of websites per computer. There's no room left for any 'computing'. If there were, they would add more websites to the server till it was at full load to increase profits.

Offline chelmi

  • Supreme Robot
  • *****
  • Posts: 496
  • Helpful? 15
    • Current projects
Re: Turn Internet Servers Into Free Supercomputer
« Reply #4 on: September 29, 2010, 08:50:08 AM »
The thing is, with this, you don't have to pay for the electricity, and you don't realy need to have a server as such, the server computer will still be computing it all.


Your missing the point, the server's are already operating at near 100% load just serving the pages for thousands of websites per computer. There's no room left for any 'computing'. If there were, they would add more websites to the server till it was at full load to increase profits.

Exact. Moreover, most of these servers won't allow you to run your own program.

Offline Soeren

  • Supreme Robot
  • *****
  • Posts: 4,672
  • Helpful? 227
  • Mind Reading: 0.0
Re: Turn Internet Servers Into Free Supercomputer
« Reply #5 on: September 30, 2010, 03:11:11 PM »
Nah, it's hard enough to be allowed running a CRON.
Bin that idea and look into Beowulff clusters if you really need that much power (and when you gain some more electronics knowledge, you will be able to make your utility meter run slow, or even backwards - not that I'd recommend it though).
Regards,
Søren

A rather fast and fairly heavy robot with quite large wheels needs what? A lot of power?
Please remember...
Engineering is based on numbers - not adjectives

Offline rbtying

  • Supreme Robot
  • *****
  • Posts: 452
  • Helpful? 31
Re: Turn Internet Servers Into Free Supercomputer
« Reply #6 on: September 30, 2010, 05:13:31 PM »
You'd be better off building your own server farm than using a hosting provider - even the more expensive VPS systems aren't really better than your computer until you're paying $100s per month, at which point you can afford the server farm.  Plus most providers will kick you out for using up all the CPU =). 

Offline TrickyNekro

  • Contest Winner
  • Supreme Robot
  • ****
  • Posts: 1,208
  • Helpful? 15
  • Hardware and Firmware Designer
    • The Hellinic Robots Portal
Re: Turn Internet Servers Into Free Supercomputer
« Reply #7 on: September 30, 2010, 05:30:53 PM »
Apart from the things the guys above said....

Man, we are at the age of dodeca-core architectures.... Peace....
If you need that much power get an Opteron...


Still a six core Phenom for a home PC is an over kill....
For whom the interrupts toll...

Offline voyager2Topic starter

  • Supreme Robot
  • *****
  • Posts: 463
  • Helpful? 6
    • Voyager Robotics
Re: Turn Internet Servers Into Free Supercomputer
« Reply #8 on: September 30, 2010, 06:58:33 PM »
Apart from the things the guys above said....

Man, we are at the age of dodeca-core architectures.... Peace....
If you need that much power get an Opteron...


Still a six core Phenom for a home PC is an over kill....
What do you mean Phenom? I'd go Phenom II!
You have no idea what I'd do with a computer like that!
I'd overclock it to 7.127GHz and have it compute an infinite loop in 6 seconds...
If the Cray Supercomputer can do it, so can a Phenom II.
And Admin said "Let there be robots!"
And it was good.

Offline madsci1016

  • Contest Winner
  • Supreme Robot
  • ****
  • Posts: 1,450
  • Helpful? 43
    • Personal Website
Re: Turn Internet Servers Into Free Supercomputer
« Reply #9 on: September 30, 2010, 07:01:12 PM »
The six cores are Phenom II's.

Offline TrickyNekro

  • Contest Winner
  • Supreme Robot
  • ****
  • Posts: 1,208
  • Helpful? 15
  • Hardware and Firmware Designer
    • The Hellinic Robots Portal
Re: Turn Internet Servers Into Free Supercomputer
« Reply #10 on: October 01, 2010, 02:28:33 AM »
Apart from the things the guys above said....

Man, we are at the age of dodeca-core architectures.... Peace....
If you need that much power get an Opteron...


Still a six core Phenom for a home PC is an over kill....
What do you mean Phenom? I'd go Phenom II!
You have no idea what I'd do with a computer like that!
I'd overclock it to 7.127GHz and have it compute an infinite loop in 6 seconds...
If the Cray Supercomputer can do it, so can a Phenom II.


Phenom is the word.... (Family guy)

BTW
I'm really thinking of phenom II.... It's a time for upgrade.... But I desperately lack the money....

Would you get the 6 core, or the 4 core just for the higher freq....
With my time at Phenom overclocking exp. I found that freq DOES matter heavily....

But six core sounds so sweet.... :-PPP
For whom the interrupts toll...

Offline SeagullOne

  • Robot Overlord
  • ****
  • Posts: 248
  • Helpful? 0
  • Humans and Robots working together for our future.
    • Loren John Presley - Author, Artist, Roboteer
Re: Turn Internet Servers Into Free Supercomputer
« Reply #11 on: October 01, 2010, 09:08:34 PM »
What?! 6-core processors?! :o
Do those exist? And AMD Processors too? Doesn't the intel i7 still only have four cores?

Wow...the exponential growth of processing power is going up faster than I thought...

Let me know if I'm confused about the i7 though. :P
I think the chauffeur did it.

.......

He did.

Offline chelmi

  • Supreme Robot
  • *****
  • Posts: 496
  • Helpful? 15
    • Current projects
Re: Turn Internet Servers Into Free Supercomputer
« Reply #12 on: October 01, 2010, 10:03:51 PM »
What?! 6-core processors?! :o
Do those exist? And AMD Processors too? Doesn't the intel i7 still only have four cores?

Wow...the exponential growth of processing power is going up faster than I thought...

Let me know if I'm confused about the i7 though. :P

http://en.wikipedia.org/wiki/List_of_Intel_Core_i7_microprocessors#.22Gulftown.22_.2832_nm.29

The Gulftown has 6 cores.

Offline madchimp

  • Robot Overlord
  • ****
  • Posts: 158
  • Helpful? 2
Re: Turn Internet Servers Into Free Supercomputer
« Reply #13 on: October 02, 2010, 08:49:07 PM »
I believe they have 12 core opterons :)

Offline dunk

  • Expert Roboticist
  • Supreme Robot
  • *****
  • Posts: 1,086
  • Helpful? 21
    • dunk's robot
Re: Turn Internet Servers Into Free Supercomputer
« Reply #14 on: October 03, 2010, 02:37:29 AM »
the issue with using any multi processor system is writing software to take advantage of multiple processors.
on most multi core desktop systems only one of the cores ever approaches full CPU load.
by their nature can servers make far better use of multiple CPUs, particularly if they are performing multiple concurrent tasks.

if your processors are on different physical machines the problem gets *much* harder. the CPUs now no longer share the same IO and storage system so making them interact quickly enough to be useful is very challenging.
much of the research in this area has been aimed at the server market, allowing server farms to use different servers to handle requests without end users knowing they are receiving results from different physical machines.

as for building your own networked multi-computer cluster out of virtual machines,
it's kind of pointless from a performance point of view but it is highly educational.
for experimenting, rather than using "free server space" with all the restrictions that entails i would use multiple virtual machines on a computer at home.

if it is performance you are looking for without having to do the hard work of setting it all up yourself,
have a look at some of the offerings from Google or Amazon.
these companies let users run code on their datacenters.
the advantage here is you get an API that makes it appear as if you are using a single host but storage, CPU time, network capacity, etc, are distributed between as many physical machines as is required.
http://code.google.com/appengine/docs/whatisgoogleappengine.html
or
http://aws.amazon.com/


dunk.

Offline amando96

  • Robot Overlord
  • ****
  • Posts: 187
  • Helpful? 1
Re: Turn Internet Servers Into Free Supercomputer
« Reply #15 on: October 03, 2010, 04:12:39 AM »
Damn... someone hates lag   :D
Rorcle, 60% complete
AATV, 5% complete

Offline arachne

  • Beginner
  • *
  • Posts: 5
  • Helpful? 0
Re: Turn Internet Servers Into Free Supercomputer
« Reply #16 on: October 03, 2010, 05:02:27 AM »
How about using the power of our internet-connected PCs when they r idle. Something like SETI project

Offline voyager2Topic starter

  • Supreme Robot
  • *****
  • Posts: 463
  • Helpful? 6
    • Voyager Robotics
Re: Turn Internet Servers Into Free Supercomputer
« Reply #17 on: October 03, 2010, 07:07:52 AM »
I'll look into that dunk, sounds good...

How about using the power of our internet-connected PCs when they r idle. Something like SETI project
You read my mind.
People might not like some weird app uploading goodness knows what to a server ;)
Never the less I might look into it... 
And Admin said "Let there be robots!"
And it was good.

Offline TrickyNekro

  • Contest Winner
  • Supreme Robot
  • ****
  • Posts: 1,208
  • Helpful? 15
  • Hardware and Firmware Designer
    • The Hellinic Robots Portal
Re: Turn Internet Servers Into Free Supercomputer
« Reply #18 on: October 03, 2010, 10:07:54 AM »
Basically, the most easy to do thing, is a grid like configuration...

Provided you know how to code in that particular language these PC's use...

You can "chop" your "many many repeats" program, in sub programs and give a separate tank
to separate computers on the GRID...

So if a single computer needs one hour to do 1000 math... 10 computers would need 6 minutes to do 100 math...
And so have your answer, simulation, or what ever you need, in one tenth of the time need by a single core...
For whom the interrupts toll...

Offline chelmi

  • Supreme Robot
  • *****
  • Posts: 496
  • Helpful? 15
    • Current projects
Re: Turn Internet Servers Into Free Supercomputer
« Reply #19 on: October 03, 2010, 10:58:19 PM »
You can "chop" your "many many repeats" program, in sub programs and give a separate tank
to separate computers on the GRID...

So if a single computer needs one hour to do 1000 math... 10 computers would need 6 minutes to do 100 math...
And so have your answer, simulation, or what ever you need, in one tenth of the time need by a single core...

With a big limitation though. This is the theoretical speedup, achievable only if there is no dependencies between your tasks.
In reality, you will almost never be able to parallelize your application in completely independent sub-tasks. At some point during
their execution they will need to synchronize and talk to each other. And you will waste time here.

So it's just to say that parallel computing does not come down as putting computing resources together. It also implies connecting them smartly
and most importantly (in my opinion), writing an application in such a way that you will minimize dependencies between tasks.

Conclusion is, it all depends on what you want to do (type of application, quantity of data...). What is it in your case voyager2?

Offline Razor Concepts

  • Supreme Robot
  • *****
  • Posts: 1,856
  • Helpful? 53
    • RazorConcepts
Re: Turn Internet Servers Into Free Supercomputer
« Reply #20 on: October 03, 2010, 11:54:15 PM »
Folding at home is a good example of it working, but of course it is a very specialized task and is not very time sensitive (you don't need one part to finish the rest, so no computers are stuck waiting)

Offline voyager2Topic starter

  • Supreme Robot
  • *****
  • Posts: 463
  • Helpful? 6
    • Voyager Robotics
Re: Turn Internet Servers Into Free Supercomputer
« Reply #21 on: October 04, 2010, 01:21:02 AM »
You can "chop" your "many many repeats" program, in sub programs and give a separate tank
to separate computers on the GRID...

So if a single computer needs one hour to do 1000 math... 10 computers would need 6 minutes to do 100 math...
And so have your answer, simulation, or what ever you need, in one tenth of the time need by a single core...

With a big limitation though. This is the theoretical speedup, achievable only if there is no dependencies between your tasks.
In reality, you will almost never be able to parallelize your application in completely independent sub-tasks. At some point during
their execution they will need to synchronize and talk to each other. And you will waste time here.

So it's just to say that parallel computing does not come down as putting computing resources together. It also implies connecting them smartly
and most importantly (in my opinion), writing an application in such a way that you will minimize dependencies between tasks.

Conclusion is, it all depends on what you want to do (type of application, quantity of data...). What is it in your case voyager2?

My evil plan is to compute pi, to at least 5000 places...
Hence the little message in my signature
And of course there's the satisfaction of telling people that I own a super computer...hehe
My pi algorithm is very simple (1 step!):
Code: [Select]
360 / theta * sin(theta / 2) = piThe smaller theta is the more accurate pi is.
Unfortunately for me, although my computer (you don't want to know the specs!) has the capacity of computing this, my programming skills do not  :(
I should also mention that sine MUST be in degrees NOT radians...

Also, since the computation is only done once, I wouldn't want to spend lots of money on PS3 clusters, renting a supercomputer, etc...

Before you ask, why can't I do this without a computer, let me tell you this:
You try calculating the sin of half 0.0000000000001  ;)
 
« Last Edit: October 04, 2010, 01:25:59 AM by voyager2 »
And Admin said "Let there be robots!"
And it was good.

Offline msprague

  • Jr. Member
  • **
  • Posts: 35
  • Helpful? 1
Re: Turn Internet Servers Into Free Supercomputer
« Reply #22 on: October 04, 2010, 07:47:25 AM »

Offline chelmi

  • Supreme Robot
  • *****
  • Posts: 496
  • Helpful? 15
    • Current projects
Re: Turn Internet Servers Into Free Supercomputer
« Reply #23 on: October 04, 2010, 09:32:43 AM »
My evil plan is to compute pi, to at least 5000 places...
Hence the little message in my signature
And of course there's the satisfaction of telling people that I own a super computer...hehe
My pi algorithm is very simple (1 step!):
Code: [Select]
360 / theta * sin(theta / 2) = piThe smaller theta is the more accurate pi is.
Unfortunately for me, although my computer (you don't want to know the specs!) has the capacity of computing this, my programming skills do not  :(
I should also mention that sine MUST be in degrees NOT radians...

Also, since the computation is only done once, I wouldn't want to spend lots of money on PS3 clusters, renting a supercomputer, etc...

Before you ask, why can't I do this without a computer, let me tell you this:
You try calculating the sin of half 0.0000000000001  ;)
 

It seems to me that this is not the kind of problem that will take advantage of parallel computing. Ask yourself the question "how can I split the problem is small subtasks?"

For instance you can split the problem in two parts:
- 360 / theta
- sin(theta / 2)

the final multiplication need the two parts and cannot be parallelized.

You have 2 sub-tasks that can be computed in parallel.  Maximum speedup: < 2

You just need 2 computers! You can add billions of computers to your cluster, this result won't change.

To really take advantage of distributed computing, you need an application with a lot more of data entry.
The Folding@Home and SETI project are good examples. PCs are used to perform simulations or to process data from radio signal.
The amount of data processed is HUGE.

One last comment on your project. My guess is the difficulty is not access to computing power, but the coding.

Offline voyager2Topic starter

  • Supreme Robot
  • *****
  • Posts: 463
  • Helpful? 6
    • Voyager Robotics
Re: Turn Internet Servers Into Free Supercomputer
« Reply #24 on: October 04, 2010, 08:10:44 PM »
Pi to 1,000,000 decimal places.
http://newton.ex.ac.uk/research/qsystems/collabs/pi/pi6.txt
Pi has been calculated too 5,000,000,000,000 places.
My evil plan is to compute pi, to at least 5000 places...
Hence the little message in my signature
And of course there's the satisfaction of telling people that I own a super computer...hehe
My pi algorithm is very simple (1 step!):
Code: [Select]
360 / theta * sin(theta / 2) = piThe smaller theta is the more accurate pi is.
Unfortunately for me, although my computer (you don't want to know the specs!) has the capacity of computing this, my programming skills do not  :(
I should also mention that sine MUST be in degrees NOT radians...

Also, since the computation is only done once, I wouldn't want to spend lots of money on PS3 clusters, renting a supercomputer, etc...

Before you ask, why can't I do this without a computer, let me tell you this:
You try calculating the sin of half 0.0000000000001  ;)
 

It seems to me that this is not the kind of problem that will take advantage of parallel computing. Ask yourself the question "how can I split the problem is small subtasks?"

For instance you can split the problem in two parts:
- 360 / theta
- sin(theta / 2)

the final multiplication need the two parts and cannot be parallelized.

You have 2 sub-tasks that can be computed in parallel.  Maximum speedup: < 2

You just need 2 computers! You can add billions of computers to your cluster, this result won't change.

To really take advantage of distributed computing, you need an application with a lot more of data entry.
The Folding@Home and SETI project are good examples. PCs are used to perform simulations or to process data from radio signal.
The amount of data processed is HUGE.

One last comment on your project. My guess is the difficulty is not access to computing power, but the coding.
Indeed the coding is the hardest part, but its the funnest  ;)
I tried to create a JavaScript that could do it all on my website...
But what luck! JavaScript doesn't have a simple sine command...

There is another algorithm that could take advantage of computer clusters...
And of course I can't remember it ::)
Much more complex, 5-6 steps, but I can't remember exactly right now...
I'll post again when I find it...
And Admin said "Let there be robots!"
And it was good.

Offline voyager2Topic starter

  • Supreme Robot
  • *****
  • Posts: 463
  • Helpful? 6
    • Voyager Robotics
Re: Turn Internet Servers Into Free Supercomputer
« Reply #25 on: October 04, 2010, 09:09:37 PM »
Here's that algorithm:
It starts off with the values:
A=1, B=0.5, C=square root of 2 / 2, D=0.25
Code: [Select]
Let E = A
Let B = 2 * B
Let A = (A + C) / 2
Let C = square root of C * square root of E
Let D = D - [B * (A - E)^2]
Then pi = (A + C)^2 / (4 x D)
Loop

In six loops it can calculate pi to 170 digits.
In 20 loops it can calculate pi to 1 million digits...
And Admin said "Let there be robots!"
And it was good.

 


Get Your Ad Here

data_list