Showing posts with label clusters. Show all posts
Showing posts with label clusters. Show all posts

17 March 2009

Open Enterprise Interview: Mike Olson, Cloudera

Yesterday, I wrote about the launch of the open source company Cloudera. It's always hard to tell whether startups will flourish, but among the most critical factors for survival are the skills of the management team. The fact that less than three hours after I sent out some questions about Cloudera to Mike Olson, one of the company's founders, I had the answers back would seem to augur well in this respect.

Olson explains the background to the company, and to Hadoop, the software it is based on: what it does, and why business might want to use it; he talks about his company's services and business model, and why he thinks cloud computing is neither a threat nor an opportunity for open source.

On Open Enterprise blog.

15 November 2007

Adding Some Lustre to Supercomputing

Everybody knows that GNU/Linux absolutely dominates the top 500 supercomputing listings: in the latest survey it notches up an 85% share (Windows manages 1.2%). Less well-known - to me, at least - is the fact that Lustre, an open source cluster file system, also does well:

Lustre highlights include:

The #1 fastest supercomputer in the world.

Lustre is being used on 7 out of the top 10 fastest supercomputers in the world.

Out of the top 30 fastest supercomputers in the world - Lustre can be found on 16 of them.

10 January 2007

The Other Thunderbird

No, not that one, this one:

Sandia National Laboratories’ 8960-processor Thunderbird Linux cluster, developed in collaboration with Dell, Inc. and Cisco, maintained its sixth position in the Top500 Supercomputers by achieving an improved overall performance of 53.0 teraflops, an 18.5 percent increase in efficiency from last year's performance.

(Via Technocrat.)

20 November 2006

Is that an 8-Node Beowulf Cluster in Your Pocket...?

...or are you just glad to see me?

Little-Fe is a complete 4 to 8 node Beowulf style portable computational cluster. Little-Fe weighs less than 50 pounds, easily and safely travels via checked baggage on the airlines, and sets-up in 10 minutes wherever there is a 110V outlet and a wall to project an image on. By leveraging the Bootable Cluster CD project, and its associated curriculum modules, Little-Fe makes it possible to have a powerful ready-to-run computational science and HPC educational platform for under $2,500.

I want several of these, please. (Via KnowProSE.com.)

04 September 2006

Grokking Wikipedia

For a project that is beginning to assume an ever-greater importance in the intellectual landscape (to say nothing of the online landscape), relatively little is known about how Wikipedia actually works. There's lots of polemic flying around about how it should work, but precious little research into the facts.

This makes Aaron Swartz's piece "Who Writes Wikipedia?" valuable - and long overdue. The results are not what we have been led to suspect:

When you put it all together, the story become clear: an outsider makes one edit to add a chunk of information, then insiders make several edits tweaking and reformatting it. In addition, insiders rack up thousands of edits doing things like changing the name of a category across the entire site -- the kind of thing only insiders deeply care about. As a result, insiders account for the vast majority of the edits. But it's the outsiders who provide nearly all of the content.

And when you think about it, this makes perfect sense. Writing an encyclopedia is hard. To do anywhere near a decent job, you have to know a great deal of information about an incredibly wide variety of subjects. Writing so much text is difficult, but doing all the background research seems impossible.

On the other hand, everyone has a bunch of obscure things that, for one reason or another, they've come to know well. So they share them, clicking the edit link and adding a paragraph or two to Wikipedia. At the same time, a small number of people have become particularly involved in Wikipedia itself, learning its policies and special syntax, and spending their time tweaking the contributions of everybody else.

And you've got to love a story that includes the line

To investigate more formally, I purchased some time on a computer cluster and downloaded a copy of the Wikipedia archives.

As one does. (via BoingBoing.)