Insights into the Hacker Worldview

From David Miller, one of the most senior kernel hackers, comes this little story:

Say you've been doing nothing for the past few weeks except looking for a real nasty and hard to trigger bug. You think you're getting close and the one piece of debugging information is just around the corner, perheps the next build or the one after that will spit out the debugging message you need to find the bug. All the rest of your work is being blocked by this problem, you have to fix it.

You've been drinking coffee all day, and guzzling water as well.

So now you have to go REALLY BAD, you're about to pee your pants. What do you do? Do you go to the toilet and take care of things or you cross your legs as hard as humanly possible thinking "just one more build, just one more" for the next half hour?

If you're one of the ones who would go to the toilet you're not a programmer.

Learning from the Encyclopedia of Life

One of the great trends online is to pool data to create a whole that is greater than the sum of the parts. The Encyclopedia of Life is one example, but on a splendidly ambitious scale:

an ecosystem of websites that makes all key information about life on Earth accessible to anyone, anywhere in the world. Our goal is to create a constantly evolving encyclopedia that lives on the Internet, with contributions from scientists and amateurs alike. To transform the science of biology, and inspire a new generation of scientists, by aggregating all known data about every living species. And ultimately, to increase our collective understanding of life on Earth, and safeguard the richest possible spectrum of biodiversity.

Highly laudable, not least the last part. But I can't help feeling that something has gone wrong in the realisation of this grand project.

The opening page of the website is a huge image that takes a while to load even with a decent broadband connection, and which conveys absolutely nothing (it's a nice picture taken from space of the Earth from mesopotamia to poor oppressed Tibet: and?). The home page has a video on it (why?), and all the demo pages are PDFs (er, isn't this supposed to be a website - you know, groovy HTML stuff?). slow to load, presumably because they are over-coded.

All-in-all, then, a superb idea, but one that clearly needs a lot of tweaking - to say nothing of slimming down - if it is to be really useful.

13 AE 01 56 46 3C 13 30 2E 9E CA 2B 13 30 FE 14

No, it's not that number, it's my number:

First, we generate a fresh pseudorandom integer, just for you. Then we use your integer to encrypt a copyrighted haiku, thereby transforming your integer into a circumvention device capable of decrypting the haiku without your permission. We then give you all of our rights to decrypt the haiku using your integer. The DMCA does the rest.

The haiku is copyright 2007 by Edward W. Felten:

We own integers,
Says AACS LA.
You can own one too.

Here is your very own 128-bit integer, which we hereby deed to you:

13 AE 01 56 46 3C 13 30 2E 9E CA 2B 13 30 FE 14

Ubuntu Uber Alles

Can Ubuntu do no wrong? First Dell, now this:

To fulfil the aims of our mission and in response to the technical challenges that these devices pose, we are announcing the Ubuntu Mobile and Embedded project.

We will start more detailed planning at the Ubuntu Developer Summit next week in Seville and the first release of this edition will be in October with Ubuntu 7.10. If you are interested in the project, please get involved. We will be working through our normal development processes on Launchpad, the developer mailing lists and IRC.

Finally, we are delighted to be working with Intel on this version of Ubuntu. Intel are making significant contributions of technology, people and expertise to the project. We hope that others who are interested in producing an easy-to-use and open source environment for this class of device will join us in making this a success.

(Via Linux and Open Source Blog.)

Cory on the DRM'd BBC

I and many others have written about the pathetic moves by the BBC in terms of adopting Windows DRM, but you've got to give it to Cory, he has a way with words. In particular, he sums up nicely one aspect that I haven't covered here:

They also instructed the BBC to stop making MP3s of public-domain classical music available, because the classical music industry is "precarious." That's smart -- we'll improve the health of the classical music industry by making sure that no one under 35 with an iPod can listen to it. Nice one, Trustees.

Couldn't have put it better myself. And, in fact, I didn't.

Update: Nice piece by Bobby in the Guardian, too: good to see the rage is spreading. Shame on you, BBC.

The Chief Lizard Wrangler Speaketh

One of the unsung heroines of the open source movement is Mitch Baker, whose official job title is "Chief Lizard Wrangler" - the lizard in this case being Mozilla. I interviewed her for Rebel Code, a long time ago, about how she oversaw the transition of Netscape's browser code to open source (which included drawing up a couple of new open source licences such as the Mozilla Public Licence..)

At that time Mozilla was interesting historically but had relatively little impact on the wider world of computing. No more. To catch up with the why and the how, here's a useful - and rare - interview with her.

German Court Gets It Badly Wrong

Bad decision, bad news:

the Court states that operators of Internet forums are liable for all comments posted there, even if the operator has no knowledge of their content.

OK, we'll just close the Internet down, then.

Microsoft +Yahoo! = MegaHard!!!

Very interesting development here: Microsoft is starting to pursue Yahoo. This is completely logical: Microsoft is getting so utterly trounced by Google that it needs to bulk up fast in the online search sector and its related fields.

Of course, integrating two such companies would be a hugely challenging task, and might be disastrous for both. But assuming it happens and doesn't collapse under its own weight, such a merger would also have very interesting repercussions for open source.

After all, Google is pretty wedded to free software as a competitive weapon against Microsoft, whereas Yahoo is probably more neutral on the matter. If Microsoft got its mitts on Yahoo, that would undoubtedly change, and its offerings would become far more Windows-centric - at which point, things would start to get really nasty.

It's certainly a cool scoop for the New York Post, but I do wonder about their subs (maybe they trained on the Grauniad):

Microsoft and Yahoo! also feature complimentary offerings on the content side, with MSN drawing an older audience with its news focus.

I'm not sure their very complimentary at the moment, but doubtless they will become that way if Microsoft pulls this off.

Open Trading

One of the important benefits that flows from openness is that it allows decisions to be made on the basis of verifiable information. This allows "good" to be preferred, and "bad" deprecated (where "good" and "bad" would vary according to context and even personal viewpoint). That is, it allows a Darwinian natural selection to take place.

The results in the world of software are clear to see, but what's interesting is the extent to which it might be applicable in other fields.

Here's an interesting example:

Products would be tagged when they are made and further information added at each point in the production process, for example, how much the item cost the trader and how much it was sold on for. "You could work out whether the traders along the chain have been paying their workers a decent wage by looking at the profits they are reporting," says Light.

Fair trade based on facts, not faith. (Via weaverluke.)

Heavenly Mashups

One of the most important innovations of the Web 2.0 era has been the mashup. As I've noted before, mashups really need underlying meshes, and geographical ones are an obvious type. But the amazing Wikisky shows that in many ways heavenly mashups are even better than earthly ones:

The main purpose of WIKISKY is to consolidate astronomical, astrophysical and other information about different space objects and astrophysical facts.

We hope to achieve this purpose using the principle of visualization. When a person reads an article about a star, the star is only the abstraction for that reader. The person cannot emotionally feel the reality of the star without actually seeing it. We strive to create an extremely detailed sky map to help everybody to better understand the information gathering about any space object and various phenomena connected with those space objects.

Aside from the joy of being able to zoom around and into the sky just as you would over Google Earth, and the awe-inspiring sight of thousands - millions - of major structures there (the Sloan Digital Sky Survey is simply gob-smacking), where Wikisky really comes into its own is in its annotation.

As you mouse-over objects, a pop-up gives you basic information. Clicking on that object takes you to a page with links to detailed images and - most importantly - to relevant papers. This is one reason why the heavenly mashup is superior to mundane ones: there is already a huge quantity of relevant, neatly-packaged information available for the objects on the mesh in the form of published scientific papers.

The only problem is that not all of this information is freely available (though often the preprint versions are): some of the papers requires subscriptions or one-off payments. This shows, once more, why open access to research papers is vital if we are to get the full benefit of such amazing sites as Wikisky: without it, mashups are frankly messed-up. (Via Open (finds, minds, conversations).)

Something Rotten in the State of the BBC

This is beginning to look seriously bad.

First, the BBC makes a duff decision over adopting Windows DRM, and now this:

Erik Huggers, a senior director for Microsoft’s entertainment business, becomes controller in charge of overseeing program strategy. He had previously been responsible for strategy on “MSTV, eHome, Zune and more” and had previously been a senior director for the Windows client division. Huggers also has done a lot to get Windows Media adopted by European broadcasters.

So much for the BBC Trust's commitment to "auditing" the BBC's progress in working towards platform neutrality: you can audit until you're blue in the face, but if the man running an important part of the BBC's Future Media & Technology unit is someone who "has done a lot to get Windows Media adopted by European broadcasters", then clearly you're stuffed.

First Big Blue, Now True Blue Open Source

I remember well my shock - and delight - when IBM announced that it was throwing its weight behind GNU/Linux on 10 January 2000. I feel somewhat similar about news that the Tories are also planning to push free software really hard:

A Tory strategy to make more use of open source software in the public sector is likely to tackle the culture of secrecy in government procurement, according to early details released to The Register.

Planned for publication next month and stemming from shadow chancellor George Osborne's adoption of a West Coast attitude, the plans are also likely to encourage the adoption of open standards and promote an indigenous open source industry.
Click here to find out more!

Mark Thompson, a Cambridge University IT lecturer and businessman who is drawing up Osborne's request to make Britain the "open source leader of Europe", said that procurement - including the notoriously secretive gateway process - might be opened up so that it was easier for smaller firms to pay homage to the public purse.

Indeed, I find myself echoing the thoughts of the hackers interviewed by The Reg:

These ideas have created some excitement in the apolitical open source movement (the flossers). Those who spoke to The Register about the Tory promise found it necessary to say the same six words: "I am not a Tory, but...".

The Economics of Free

One of the central themes of this blog is that Internet has changed many things by allowing the distribution of digital objects for virtually no cost. This has enormous knock-on consequences: the software industry is where that is most evident, but content is being hugely affected too.

I tend to write analogically, drawing on my knowledge of free software (which goes back about 13 years now) to try to understand what is happening - and will happen - in other fields. An alternative approach is to look at this from the viewpoint of economic theory.

This is something that I am hugely unqualified to do, but fortunately Techdirt's Mike Marsnick has being doing an excellent job in this respect with a series of posts examining the economics of goods when scarcity is removed. He has now posted a summary to this series, together with consolidated links to the previous posts.

It's well worth reading, as are the comments on the above post - if only to see a fine display of people's misunderstanding of what's going on here. I was also pleased to see that the main example he uses - that of the recording industry, and how it can give away music and still make money from things like concerts, merchanise etc. - is precisely the one that I have been pointing to.

I hope that Mike turns all this into a book one day, since I, for one, would welcome and even more in-depth analysis of this important and fascinating area.

Open Source War - and Open Source

Another characteristically clear-sighted post from Jamais Cascio on the subject of open source war and the changing nature of power in a networked world:

Despite the end of the utility of conventional force, the lack of certainty as to what the next wave of global compellence power will look like will inevitably lead to strategic mistakes. As we look ahead, it's clear that if another state -- say, China -- decides to take America's place as the leading hegemonic power on the planet by emulating the current American model of extreme emphasis on conventional force projection, that state has already become another Lost Hegemon. The system has changed, and the meaning of power has changed.

Conversely, the first group that cracks this problem has the potential to leapfrog the others in assuming the role of global powerhouse. Given the speed with which technology and organizational models are evolving, we can't assume it will be a state. Corporations seemed poised to take on that role in the 1990s; non-governmental groups are the lead candidates today. It's entirely possible that the kind of social organization that will become the next hegemonic force has yet to be invented. One thing is clear: the next superpower, whoever or whatever it is, will be the actor that finally figures out the new meaning of power.

Well, the first people to understand this new kind of distributed, networked, evolving power were, of course, the coders: how about letting them run things for a change?

Defending the Street Tree

Another great commons under threat:

In towns and cities across the country, millions of other street trees are less lucky. Supersized lorries batter their crowns, utility companies dig up their roots, high-density developments squeeze them out, mobile-phone companies and CCTV operators demand they are trimmed back, water-main repairs shut off life-giving leaks, insurers claim they are causing building subsidence . . . and we, the public, sue councils when we trip on pavements made wonky by tree roots.

Sun Joins Mac Port of OpenOffice.org

Further signs of Sun's broad commitment to open source and OpenOffice.org:

I'm excited to let you all know that as of now Sun engineering will add its support to the ongoing Mac/Aqua porting effort.

The MacOSX porting history is basically as old as OpenOffice.org itself. Practically from the start there was the plan to have a native version for Mac, however as a first step the community decided to produce an X11 port which - since OOo already had several X11 ports from the start - seemed to be a good way to get a version quickly as temporary solution. As usual the "temporary solution" tended to be quite long lived (year 2000 bug anyone :-) ?).

...

Some may ask: Why is Sun joining the Mac porting project? If you look around at conferences and airport lounges, you will notice that more and more people are using Apple notebooks these days. Apple has a significant market share in the desktop space. We are supporting this port because of the interest and activity of the community wanting this port.

(Via Erwin Tenhumberg.)

(Not So) Mysterious Asia

Simon Phipps has some interesting numbers relating to open source in Asia:

It seems that a few years ago, more than 95% of the software market in China was foreign-sourced. Last year, however, 70% of the software their government was using was open source. That means a market over which western software companies were rubbing their hands with glee in 2003 (presumably awaiting the payout from the first hit that was free) now see the market potentially evaporating.

No Progeny for Progeny

Progeny's metabolic processes are now history. It's off the twig and has kicked the bucket, apparently. With its founder, Ian Murdock, safely ensconced at Sun, this represents the end of a chapter in the story that is the rise of GNU/Linux as a popular platform. Meanwhile, another chapter begins.

Why Their Number is Up

There is an incredible - nay, pivotal - event unfolding on Digg. And it all revolves around a number. As the excellent Brownian Emotion explains:

This number is the key to unlocking the encryption for all high-definition DVDs, the possible successor to the popular DVD format. Using this key in a special program could allow one to copy an HD-DVD, and would thus violate the DMCA and the copyright of the content owners who produce those HD-DVDs.

Of course, the existence of this number is further demonstration of the fact that those in the content industry really don't understand technology: it was bound to be found, and once found, disseminated. But where the story gets really interesting is after those behind the broken HD-DVD technology started trying to block the publication of that number. As we know (from about 15 years of Internet history), this can't be done. But it turns out that it's even better than that. People started posting links to the number on Digg; Digg was then hit with legal orders to take those posts down, which it did. Digg was then flooded - utterly flooded - with posts about that number and diggs for those posts, until finally, Digg's Kevin Rose decided to do the brave thing:

after seeing hundreds of stories and reading thousands of comments, you’ve made it clear. You’d rather see Digg go down fighting than bow down to a bigger company. We hear you, and effective immediately we won’t delete stories or comments containing the code and will deal with whatever the consequences might be. If we lose, then what the hell, at least we died trying. Digg on, Kevin

Kudos, Kev. As a result, the Digg front page is currently awash with stories that contain the number, most with huge levels of diggs (to which I am proud to have added my widow's mite). This shows two things. First, when the diggnation get it into their head to make a point, there's little even Kev can do about it, short of shutting down the site. Secondly, that attempts to stop the publication of this kind of information is even more doomed than it was ten years ago. The reason is not just that Web 2.0 has given even more power to the digital people, but because of the nature of what is being published. It's a number: - pure information. There is simply no way that a number can be kept secret, as all the witty Digg postings which just "happen" to mention that particular number, show. Since everything in the digital world, ultimately, is a number, this also shows why it is impossible to stop the copying of any digital artefact: it's just a number, that has no meaning of itself, only through context and interpretation. So while a number might be the digital representation of a document or song or picture to you, to me it's just my favourite number. There is currently no law against sharing favourite numbers. And the Digg revolt shows what will happen if anyone is foolish enough to bring one in. For all those trying to defend digital content against copying in this way, their number is truly up.

Now You're Talking

This is my kind of journal:

The Northwest Journal of Linguistics is dedicated to the description and analysis of the indigenous languages of northwestern North America.

Its first issue contains unputdownable papers such as "The Verbal Morphology of Santiam Kalapuya":

This work is a detailed description of the verbal morphology of Santiam Kalapuya, an extinct Native American language of Oregon. This work is the first in-depth grammatical analysis of this language.

De-licious, and open access to boot.

Dell Desktop Derby: And the Winner Is...

...Ubuntu.

Now there's a surprise.

Manifesto for Free Appliances

More open goodness:

Just as there is a need for Free Software, there is a need for free (as in speech) appliances.

Free Appliances can be modified or enhanced using GNU/Linux tools or other Open Source Software, preferably licensed as GPLv3. They have no binaries without source code. They adhere to generally accepted standards as much as possible. Their documentation is open. They favor open file formats since information in open file formats should not require DRM. They do not use proprietary components when there are generic ones widely available. (For example: batteries should be replaceable.)

We need to know that products that we use have no hidden functionality and that we can enjoy their full capability and value. Such devices must be open because that is the only way their functionality can be verified and audited. Procedures need to be available to assure that no malware has been introduced. In the event that user modifications go wrong, there must be a simple user reset of the device to its original state.

Examples include smart house, open telephone, wearable computer, emergency alarm and a "freed computer":

By now it should be possible to configure a computer which is completely free. It should have a free BIOS, hardware with open drivers, and a complete complement of freed software.

US Patents: Is the Tide Turning?

Maybe I'm an incorrigible optimist, but these look hopeful signs:

The U.S. Supreme Court made it easier to challenge patents for failing to introduce genuine innovations, siding with Intel Corp. and Cisco Systems Inc. and dealing a setback to the drug and biotechnology industries.

...

The decision extends a Supreme Court trend that has put new limits on patent rights. In today's case, the justices heeded arguments from large computer companies and automakers that the lower court test, which centered on the requirement that an invention be "non-obvious," had given too much power to developers of trivial technological improvements.

"Granting patent protection to advances that would occur in the ordinary course without real innovation retards progress," Justice Anthony Kennedy wrote for the court.

(Via Slashdot.)

All That (Non-DRM'd) Jazz

It's striking that more and more DRM-free sites are starting to achieve prominence - and, one hopes, profitability. Here's another, AllAboutJazz.com, which has a very clever sample system: you can hear all the track, at high quality, but only in 30 second bursts; cunning. But be warned: once you start listening to this stuff, you may have an irresistible urge to buy something from its online shop.... (Via Boing Boing.)

BBC Trust Blows It

The bad news:

we recognise and share the strength of feeling on platform neutrality. We do not consider it practicable to offer catch-up television over the internet on a platform neutral basis immediately. We consider it preferable to allow the BBC to provide value to a majority of users now rather than to wait until full platform neutrality can be achieved before providing catch-up television. We still require platform neutrality for seven-day catch-up television over the internet within a reasonable timeframe, but we have decided not to specify a deadline for achieving this. To counter-balance this, the Trust will take a more active role in holding the Executive to account on the issue by auditing its progress every six months.

Six-monthly audit, eh? Heavy - that's really going to make a difference.

The good news:

In our consultation, members of the public expressed strong feeling in large numbers that seven-day catch-up television over the internet should be available to consumers who are not using Microsoft software. 81 per cent (5,804) said this was very important and a further 5 per cent (355) said it was important. Such was the strength of feeling that respondents did not appreciate, or did not consider it relevant, that the Trust was proposing that the BBC achieves platform neutrality within a specified period. Any period of excluding other operating systems was apparently considered unacceptable by our public respondents.

OK, we lost, but it looks like a lot of us cared enough to act: that's good, not least for the future.

La vida es una lucha.