What Open Access Can Do for Open Content

One of the central ideas behind openness is re-use - the ability to build on what has gone before, rather than re-inventing the wheel. And yet, as this fascinating article demonstrates, there is sometimes surprisingly little sharing and re-use between the various opens:

This study demonstrates among a sample of 100 Wikipedia entries, which included 168 sources or references, only two percent of the entries provided links to open access research and scholarship. However, it proved possible to locate, using Google Scholar and other search engines, relevant examples of open access work for 60 percent of a sub-set of 20 Wikipedia entries. The results suggest that much more can be done to enrich and enhance this encyclopedia’s representation of the current state of knowledge. To assist in this process, the study provides a guide to help Wikipedia contributors locate and utilize open access research and scholarship in creating and editing encyclopedia entries.

I can't help feeling that there is a larger lesson here, and that all the various opens should be doing more to build on each other's strengths as well as their own. After all, it's partly what all this openness is about. Perhaps we need a meta-open movement?

Wisdom of the Mindless Sports Fans

Although PicksPal, a fantasy sports betting site, interests me not a jot, this is truly fascinating:

It’s all for fun, but the company started selling the top picks of its best users in October. For $10, you can get the collective picks of the top 30 users on five games. The idea was that people could use these for-fun picks to win bets in Vegas. The question was, would PicksPal be able to consistently beat Vegas odds, and the spread, with these picks.

So far, yes. By a lot. PicksPal’s overall record, against the spread, has been 562-338, or a 63% win rate. In college basketball, the win rate is 66%. In pro football, 62%. They are even getting a 52% win rate in pro hockey, their worst sport.

These look like incredibly strong results; it would be interesting to see how the results are in other areas where this idea is starting to be applied.

Dastardly DRM Plans for Digital Video Broadcasting

Alas, not many people care enough about the threat posed by DRM. But I suspect that quite a few care about their TV viewing, and the traditional freedoms they enjoy in that sphere. So maybe this chilling news will wake up a few people from their digital slumbers:

Today, consumers can digitally record their favorite television shows, move recordings to portable video players, excerpt a small clip to include in a home video, and much more. The digital television transition promises innovation and competition in even more great gadgets that will give consumers unparalleled control over their media.

But an inter-industry organization that creates television and video specifications used in Europe, Australia, and much of Africa and Asia is laying the foundation for a far different future -- one in which major content providers get a veto over innovation and consumers face draconian digital rights management (DRM) restrictions on the use of TV content. At the behest of American movie and television studios, the Digital Video Broadcasting Project (DVB) is devising standards to ensure that digital television devices obey content providers' commands rather than consumers' desires. These restrictions will take away consumers' rights and abilities to use lawfully-acquired content so that each use can be sold back to them piecemeal.

Dell is Listening...

... apparently:

Dell to Expand Linux Options

Your feedback on Dell IdeaStorm has been astounding. Thank you! We hear your requests for desktops and notebooks with Linux. We’re crafting product offerings in response, but we’d like a little more direct feedback from you: your preferences, your desires. We recognize some people prefer notebooks over desktops, high-end models over value models, your favorite Linux distribution, telephone-based support over community-based support, and so on. We can’t offer everything (all systems, all distributions, all support options), so we’ve crafted a survey (www.dell.com/linuxsurvey) to let you help us prioritize what we should deliver for you.

Fight! Fight! Fight!

It is a truth universally acknowlegded that there is only one thing more stupid than content producers suing little people with nothing in their piggy bank for alleged copyright infringement, and that is content producers suing someone with billions of dollars in their piggy-bank for alleged copyright infringement:

Viacom Inc. today announced that it has sued YouTube and Google in U.S. District Court for the Southern District of New York for massive intentional copyright infringement of Viacom’s entertainment properties. The suit seeks more than $1 billion in damages, as well as an injunction prohibiting Google and YouTube from further copyright infringement. The complaint contends that almost 160,000 unauthorized clips of Viacom’s programming have been available on YouTube and that these clips had been viewed more than 1.5 billion times.

Faster, Google. Kill! Kill!

Opening Our Eyes to OpenID

Sign-ons can be a real pain, as you are forced to create ever more accounts at sites. A single sign-on is the obvious solution, but getting everyone to agree on a standard is hard. So it's particularly good to see that OpenID is not only taking off, but an open standard to boot.

Here's one of the best introductions to OpenID that I've come across:

As the most basic level, your OpenID identity is a unique URL. It can be a URL that you directly control (such as that of your personal Web page or blog) or one provided to you by a third-party service, such as an OpenID provider. In that sense, a site's use of OpenID identities is no different than using email addresses as identifiers: they are unique to each user and are verifiable. But you can publicly display an OpenID identity without attracting spam.

Going Qwaqqers About Qwaq

Even though Second Life gets the lion's share of the attention, there are several other virtual world systems out there, including some that are fully open source. One such is Croquet:

Croquet is a powerful open source software development environment for the creation and large-scale distributed deployment of multi-user virtual 3D applications and metaverses that are (1) persistent (2) deeply collaborative, (3) interconnected and (4) interoperable. The Croquet architecture supports synchronous communication, collaboration, resource sharing and computation among large numbers of users on multiple platforms and multiple devices.

The ideas behind Croquet are undeniably powerful, but it's always looked a little clunky when I've investigated it, more like a research project than anything that you might use. In other words, a solution in search of a problem.

Well, the problem has just turned up, and involves creating a secure virtual workspace for distributed teams. In the corporate context, the Second Life gew-gaws are less important than functionality like security and the ability to collaborate on any application. A new company called Qwaq, which includes many of the key people from the Croquet project, has been set up to meet that need.

It adopts a hybrid approach for its licensing: the core code is Croquet, and hence open source, but Qwaq adds proprietary elements on top. Obviously, I'd prefer it if everything were free code from the start, but it's understandable if new companies are cautious when dabbling with this tricky open source stuff. The existence of Qwaq, which obviously has a vested interest in the survival and development of Croquet, is already good news for the latter, but I predict that in time the company will gradually open up more of its code in order to tap into the community that will grow around it.

Its business model could certainly cope with that: it offers two versions of its product - one as a hosted service, the other run on an intranet. Although it is true that other companies could also host and support the product in this case, Qwaq has a unique strength that comes from the people working for it (rather like the advantage that Red Hat's roster of kernel hackers confers.)

One of the benefits of using Croquet as the basis of its products is that the protocols are open, and this allows Croquet-compatible products to interoperate with Qwaq's. This means that the dynamics of the Croquet ecosystem are similar to that of the Web, which is never a bad thing.

At the time of writing, there's not much to see on Qwaq's site, but I imagine that will change soon, and I'll update this post to reflect that (and also be writing elsewhere about the technology and its applications). In the meantime, Qwaq's arrival is certainly welcome, since it signals a new phase in the roll-out and commercialisation of standards-based virtual spaces. I'm sure we'll see many more in the future.

Update: The Qwaq site has now gone live, with some info and a screenshot of the Qwaq Forums product, as well as a link to a datasheet. There is also a short press release available.

Opening Up the Euro-Augean Farms

Openness and governments go together like horses and horseless carriages, so I was heartened to come across what sounds like a major victory for open access to key information in the shape of FarmSubsidy.org:

Farmsubsidy.org uses freedom of information laws to force European governments to release detailed data on who gets what from Europe's €48.5 billion annual farm subsidy payments. We then make this data available online.

There's a good history of how this happened, which also provides something of a blueprint for further openness. (Via WorldChanging.)

Chilling Freedom of Speech on Polar Bears

Internal memorandums circulated in the Alaskan division of the Federal Fish and Wildlife Service appear to require government biologists or other employees traveling in countries around the Arctic not to discuss climate change, polar bears or sea ice if they are not designated to do so.

Like them, I am speechless.

All A-twitter about Twitter

Like many, I've been following Twitter with interest, if a certain bemusement: just what is the attraction of knowing that your mates are drinking a cup of coffee or taking the dog for a walk?

This post provides perhaps the best explanations so far as to why Twitter is important:

You use your social network as a filter, which helps both in scoping participation within a pull model of attention management, but also to Liz’s point that my friends are digesting the web for me and perhaps reducing my discovery costs. But the affordance within Twitter of both mobile and web, that not only lets Anil use it (he is Web-only) is what helps me manage attention overload. I can throttle back to web-only and curb interruptions, simply by texting off.

But will I use it? Not yet, although at some point I may dip a cyber-toe, as I have with LinkedIn: not because I need it, but because these social networks are indisputably an interesting trend.

Has Microsoft Blinked on Office formats?

Microsoft Corp's director of corporate standards has conceded that 'legitimate concerns' have been raised in response to its attempt to fast-track the approval of its Open XML format by ISO.

The level of criticism targeted at Microsoft's XML-based office productivity file formats is significant, raising the potential that Open XML might not gain ISO approval, but Microsoft's Jason Matusow insisted there is still a long way to go.

This is interesting: it's the first time that I've come across Microsoft expressing any kind of doubts about OOXML, its rival to ODF, romping home to become an ISO standard. I can only assume that there was a presumption on the company's part that for all the free software world's whingeing, the national bodies who have the right to object, wouldn't.

But they did. As Andy Updegrove explains:

14 of 20 responses were clearly negative, two indicated divisions of opinion, three were inconclusive or neutral, and one offered no objections.

This is very different from Microsoft's own summary:

"Of the 19 submissions, some are very supportive of XML and the process, some are neutral, and some had legitimate concerns that were raised."

Clearly, this is stretching the truth to breaking point. I get the impression the company's really getting worried over this one, as it begins to spin totally out of its control.

Open Geology

Once that open access, open data meme starts spreading, there's just no stopping it....

British scientists are leading an international effort to bring together all the known geological information about every country in the world. By making the data freely available and allowing researchers to track geological features across national boundaries, the project will make it easier to plan international projects, predict earthquakes and locate natural resources such as oil and gas.

Once the project, called OneGeology, is up and running the data will be searchable via the internet. "Geology has no respect for national frontiers," said Ian Jackson, who is coordinating the project for the British Geological Survey (BGS). "The data exists, but accessibility is the key."

Digital Memories of the Tibetan Uprising

I've written before about how digital technology can be applied by the oppressed and disenfranchised to help preserve their identity. It's good therefore to see new-ish technologies like YouTube being pressed into similar service for a mass online protest focussing on March 10:

On March 10, 1959, Tibetans took to the streets of Lhasa to actively resist the Chinese invasion of Tibet. Tens of thousands of Tibetans risked their lives to protect their nation and their beloved leader, His Holiness the Dalai Lama. They gave of themselves so that future generations could live to continue the fight and regain the freedom of Tibet.

This March 10, we will honor their memory and their sacrifice.

Metaweb, not Betterweb?

Is it just me, or does this sound like a horribly retrograde move?

A new company founded by a longtime technologist is setting out to create a vast public database intended to be read by computers rather than people, paving the way for a more automated Internet in which machines will routinely share information.

The company, Metaweb Technologies, is led by Danny Hillis, whose background includes a stint at Walt Disney Imagineering and who has long championed the idea of intelligent machines.

...

The idea of a centralized database storing all of the world’s digital information is a fundamental shift away from today’s World Wide Web, which is akin to a library of linked digital documents stored separately on millions of computers where search engines serve as the equivalent of a card catalog.

A single database for all the world's digital information? Since when did massive, centralised, single point-of-failure systems come back into vogue? Google's holdings are bad enough.

Thanks, but no thanks.

Update: To be fair, it seems to be adopting a sensible licensing policy, so maybe there's hope yet:

We want to make it possible for you to add high quality structured information to your websites, mashups and applications without worrying about restrictive corporate licenses. All data is licensed Creative Commons Attribution. We only ask that you link back to us.

In addition, Tim O'Reilly has a more upbeat (perhaps because better-informed) assessment here. I can see a little better what they're trying to do, but I'm still not convinced by the centralised nature of it. Opinions?

Open Source Business Models

As readers of this blog may recall, in general I'm not a big fan of analysts, since they seem to offer very little other than a re-statement of what was blindingly obvious six months ago. But there are honourable exceptions.

Take, for example, this insightful presentation by Brent Williams, a self-styled "(temporarily) Independent Equity Research Analyst". It's unusual because it manages to combine a good understanding of the open source model and world with some grown-up economics. The result is well-worth reading.

I don't think Williams will be independent for long. (Via Once more unto the breach.)

Urban Forest Tracker = Open Source 2.0?

Traditionally, open source has been most successful when applied to generic, mainstream software categories - operating systems, Web servers, browser etc. Specialised, vertical applications have not generally been thought suitable, because the pool of interested people who can contribute bug reports and fixes is small.

But the appearance of this open source urban forest tracking system suggests we may be entering a new phase:

In urban San Francisco, the public works department and nonprofit organizations work together to preserve and expand tree life as part of that city's efforts to create sustainability. The city today unveiled a new Web portal and open source application that will help those agencies, and the general public, keep tabs on a growing urban forest.

This new project will probably work not so much because there is a huge untapped group of urban forest tracking system hackers just waiting to hit some code, but because there are plenty of tree-huggers who will help debug the system and input data. In other words, these new kinds of open source projects - call them open source 2.0 - only require a small core of coders to maintain, but survive and thrive thanks to the larger group of suppliers of open data.

AllPeers Goes OP2Pen

I can't help feeling that P2P is so, well, you know, dotcom 1.0. And I must confess that I've never had the slightest urge to use the AllPeers Firefox extension, even though it sounds cool enough:

when we set out to create our Drag-n-Share Firefox extension, we didn’t just take the most direct route to deploying the functionality we felt our users would want. We also built a powerful platform with features that could be used by many types of next-generation web applications: a generic resource framework, a scalable data store and of course a full-fledged peer-to-peer network. By baking the tricky bits into the browser platform, we hope that AllPeers will simplify the deployment of applications that work with structured data (like microformats), store this data where it makes the most sense (whether on the user’s machine or on a centralized server) and make real-time communication between users a snap.

But news that it has seen the light and is going open source is nonetheless highly welcome. It will be interesting to see how it develops as a result.

The Tim O'Reilly of Open Access

I thought I knew open access history pretty well, but to my shame I seem to overlooked Melissa Hagemann:

Hagemann's strategic, behind-the-scenes planning on behalf of the Open Access movement during the past five years set in motion the series of events that have affected scholarship around the globe. It began in the summer of 2001, following critical developments in the Open Archives Initiative; the Public Library of Science petition advocating free access to research; and the establishment of BioMed Central. An environmental scan led her to layer her own assessment of what libraries and researchers needed on top of the varied, independent initiatives for free access underway among players in scholarly communication. She and her OSI colleagues brainstormed on a way to unify the movement under one umbrella – the umbrella of as yet-unnamed Open Access – and OSI gave her the go-ahead to convene the initial BOAI meeting.

BOAI refers to the Budapest Open Access Initiative; it was at this meeting that the phrase "open access" was coined and defined. In other words, it stand in the same relationship to the open access movement as the Freeware Summit does to open source. Which pretty much makes Hagemann the Tim O'Reilly of open access, I suppose. (Via Open Access News.)

Welcome to Topsy-Turvy Land

So let me get this straight: Labour, party of the left, seems locked in a loving embrace with that arch-capitalist, Bill Gates, while the Conservatives, party of the right, is smitten with that commie open source stuff:

The government could save more than £600 million a year if it used more open source software, the shadow chancellor has estimated.

George Osborne said the savings would cut 5% off Whitehall's annual IT bill.

He called for a more "level playing field" for all software companies, and urged "cultural change" in government.

China Virtually Clueless

Oh dear:

Worried that virtual currencies from online games could undermine the country’s financial system, Beijing has taken steps to restrict their conversion into yuan and use to buy real goods, and banned the opening of new Internet cafés.

Beijing is struggling to rein in the hot money flushing around of the country, hoping to keep the yuan from appreciating too fast against the dollar.

The measures against virtual currencies, announced by China’s state news agency Xinhua in a joint communiqué by 14 government agencies, were said to be aimed at preventing them from wreaking havoc on the real-world economy.

Titled, “A notice about further steps in strengthening the management of Internet cafés and Internet gaming,” it says that the redemption of virtual currencies in value exceeding their original purchasing prices will be banned to prevent attempts to realize profits. It also says they cannot be used to buy real goods, only virtual products and services provided by the gaming operators who issue the currencies.

Which means, of course, that as well as being virtual, all this dosh will now go undergound, making it even harder to control.

Remembrance of Sims Past

There's a fascinating post over on 3pointD.com, which exhumes some screenshots of sims as they were three years ago, and contrasts them with their present form. It's impressive to see how far Second Life has come in that time - and exciting to consider how far it might go in the next three years.

But seeing these old sims made me wonder whether we are in danger of losing our virtual past, since these screenshots are the exception, rather than the rule. When the history of virtual worlds comes to be written, vital data about how things looked in those days - nowadays, too - will have gone for ever.

Clearly, what we need is a kind of Internet Archive for virtual worlds that preserves not just the screenshots, but maybe the actual data files for "historic" and representative sims - a Virtual World Archive. Brewster Kahle, are you listening?

On the Social Use of Visualisations

I'm a sucker for anything meta, so I find these meta-analyses of data irresistible. The article is mainly about IBM's Many Eyes, but also mentions Swivel, which I've written about before, and Data360, which I haven't. The more the merrier, say I.

Sun's Darkstar Joins the GPL Light Side

Sun continues its progress through the ranks of open source supporters, hurtling fast towards top-spot as Richard Stallman's Number 1 friend. The latest move is the open sourcing of its Project Darkstar:

Sun Microsystems, Inc. announced plans today at the 2007 Game Developers Conference in San Francisco to open source Project Darkstar, a ground-breaking online game server platform written entirely in Java technology, at the 2007 Game Developers Conference in San Francisco. The company also announced the opening of registration for the Darkstar Playground, which will enable developers to create a wide variety of games that can be provisioned through a single server platform.

...

"Project Darkstar is proving to be an important technology foundation in the exploding multiplayer online game marketplace," said Chris Melissinos, chief gaming officer, Sun Microsystems. "By open sourcing Darkstar technology, we will help enable the widest possible market for online game developers and remove their burden of having to build enterprise-grade server solutions, leaving them to do what they do best—build great game experiences."

Game developers can download the latest version of Project Darkstar at www.projectdarkstar.com. This new release of Project Darkstar features a simpler programming interface for increased productivity; plug-in APIs to facilitate integration of third party extensions; and enhancements for scalability , robust performance, and fault-tolerant operation. The source code for Project Darkstar will become available under a GPL license in the coming months

Aside from underlining Sun's support for the GPL, this announcement is also interesting for the light that it shines on the increasingly mainstream nature of online games. The fact that Sun has such a project is surprising, but open-sourcing it makes a lot of sense in an increasingly competitive market. For one thing, it bolsters Java, which stands at a critical juncture in its development. If Sun can build up enough momentum behind it, Java could well enjoy something of a second coming.

Déjà Lu

See: it's not just me....

Although Microsoft’s attempt to exploit Google’s YouTube problems is understandable, it’s also slightly repulsive and reeks of desperation. The software titan is hoping to build itself up by tearing Google down, never a good long-term strategy for success. Microsoft might damage Google’s reputation in the short-term, but it’s highly doubtful that Google’s incredible usefulness, not to mention its solid legal footing, will slip over time.

In the meanwhile, Microsoft will still be Microsoft, still playing distant second to Google. I would argue that Microsoft has damaged its own reputation with this lambast, showing to the world how it’s willing to tear down rivals instead of building itself up. That’s just not classy.

Second Life's Second Innards

Talking of guts, here's a piece about Second Life's intestines. I've written about this in various places, but there are more details here:

Second Life runs on 2,000 Intel and AMD servers in two co-location facilities in San Francisco and Dallas. The company has a commitment to open source, with servers running Debian Linux and the MySQL database. Linden Lab chose Debian Linux because the software is suited to scaling massively with a small IT staff, said Linden Lab CTO Cory Ondrejka. MySQL allows the server farms to scale horizontally, by adding large numbers of low-power servers as needed, rather than vertically, which would have required Second Life to run on a few, powerful systems, Miller said.