Windows Azure Recipe: High Performance Computing —
One of the most attractive ways to use a cloud platform is for parallel processing. Commonly known as high-performance computing (HPC), this approach relies on executing code on many machines at the same time. On Windows Azure, this means running many role instances simultaneously, all working in parallel to solve some problem. Doing this requires some way to schedule applications, which means distributing their work across these instances. To allow this, Windows Azure provides the HPC Scheduler.
This service can work with HPC applications built to use the industry-standard Message Passing Interface (MPI). Software that does finite element analysis, such as car crash simulations, is one example of this type of application, and there are many others. The HPC Scheduler can also be used with so-called embarrassingly parallel applications, such as Monte Carlo simulations. Whatever problem is addressed, the value this component provides is the same: It handles the complex problem of scheduling parallel computing work across many Windows Azure worker role instances.
- Elastic compute and storage resources
- Cost avoidance
SolutionHere’s a sketch of a solution using our Windows Azure HPC SDK:
- Web Role – this hosts a HPC scheduler web portal to allow web based job submission and management. It also exposes an HTTP web service API to allow other tools (including Visual Studio) to post jobs as well.
- Worker Role – typically multiple worker roles are enlisted, including at least one head node that schedules jobs to be run among the remaining compute nodes.
- Database – stores state information about the job queue and resource configuration for the solution.
- Blobs, Tables, Queues, Caching (optional) – many parallel algorithms persist intermediate and/or permanent data as a result of their processing. These fast, highly reliable, parallelizable storage options are all available to all the jobs being processed.
TrainingHere is a link to online Windows Azure training labs where you can learn more about the individual ingredients described above. (Note: The entire Windows Azure Training Kit can also be downloaded for offline use.)
See my Windows Azure Resource Guide for more guidance on how to get started, including links web portals, training kits, samples, and blogs related to Windows Azure.
Windows Azure HPC Scheduler (3 labs)
The Windows Azure HPC Scheduler includes modules and features that enable you to launch and manage high-performance computing (HPC) applications and other parallel workloads within a Windows Azure service. The scheduler supports parallel computational tasks such as parametric sweeps, Message Passing Interface (MPI) processes, and service-oriented architecture (SOA) requests across your computing resources in Windows Azure. With the Windows Azure HPC Scheduler SDK, developers can create Windows Azure deployments that support scalable, compute-intensive, parallel applications.
Sunday, June 10, 2012
Saturday, June 09, 2012
Melissa Butts' documentary Space Junk 3D is coming to the IMAX theater at Denver's Museum of Nature and Science on July 13th, 2012. This is an excellent film, narrated by Tom Wilkinson, on a subject we were discussing all the way back to my college research days. Are we reaching the tipping point of space debris floating around at Clarke orbit altitudes?
If you're in this neck of the woods, come on down for the show! Here's a link to other theaters showing the film.
Wednesday, June 06, 2012
Well, it seems Ray Bradbury has left us and the entire world seems a bit more silent, less poetic, more dreamless, and forever October-less without him in it.
I started reading his work when I was nine and it opened a up a visionary world of possibilities and feelings that were outside the norm in my home. He taught me a lot about the art of being a human being through his work.
In the early part of my life I pursued the arts and one lesson I learned through Bradbury was the limitations of media like film to communicate literary nuance and shading. Not only in the films attempted based on his original work, but also in the excellent screenplay adaptations he himself wrote like The Day the Earth Stood Still and Moby Dick.
But my admiration wasn't always from afar. By the time I was 22, I was lecturing on planetary science at the California Museum of Science and Industry (now the California science Center) and imagine my delight to find Ray Bradbury among the museum docents. It was a truly awesome experience (as in the correct use of the word) to provide text about an astronomy exhibit that Ray Bradbury was going to read through. He was generous, always.
I had kept all the books and short stories and later shared them with my children and Angie, and anyone else who would listen. It's always a joy to see someone fall in love the way you once fell in love.
I know he had gone through some illness for a while after I left California but I knew he had worked on an indie film with a young crew and hoped he'd never actually go away. After all, if Bradbury could pass away, what hope is there for the rest of us.
Thanks for the Martian, skin Illustrations, Dark Carnivals, and youth without youth, Mr. Bradbury. I couldn't have been me without them.