For People with Large Data Sets

Strange but interesting:

This is a site for large data sets and the people who love them: the scrapers and crawlers who collect them, the academics and geeks who process them, the designers and artists who visualize them. It's a place where they can exchange tips and tricks, develop and share tools together, and begin to integrate their particular projects.

Let Us Now Praise...Facebook

Facebook has been getting a lot of stick recently over its Beacon system, so I thought I'd be contrarian by pointing out what a good open source citizen the company is:

Facebook has been developed from the ground up using open source software, and we are proud to give back to the open source community through various open source projects.

It's generally taken for granted that Web 2.0 companies will be based on free software, but we hear far less about who does and who doesn't contribute back, which is a pity. (Via RedWriteWeb.)

The New China Syndrome

Here's a fascinating article about how China's $1.4 trillion - yes, that's a trillion - holdings of dollars are subsidizing the American way of life, keeping its own people poorer than they might be, and what it all means for the US, China and the rest of us. I was particularly struck by the following the following:

The fair reason for concern is, again, the transparency problem. Twice in the past year, China has in nonfinancial ways demonstrated the ripples that a nontransparent policy creates. Last January, its military intentionally shot down one of its own satellites, filling orbital paths with debris. The exercise greatly alarmed the U.S. military, because of what seemed to be an implied threat to America’s crucial space sensors. For several days, the Chinese government said nothing at all about the test, and nearly a year later, foreign analysts still debate whether it was a deliberate provocation, the result of a misunderstanding, or a freelance effort by the military. In November, China denied a U.S. Navy aircraft carrier, the Kitty Hawk, routine permission to dock in Hong Kong for Thanksgiving, even though many Navy families had gone there for a reunion. In each case, the most ominous aspect is that outsiders could not really be sure what the Chinese leadership had in mind. Were these deliberate taunts or shows of strength? The results of factional feuding within the leadership? Simple miscalculations? In the absence of clear official explanations no one really knew, and many assumed the worst.

Openness: the solution to everything (well, almost)....

GNU/Linux: The Great Unifier

Well, maybe:

South Korea is one of Linux's biggest converts. Since discovering the free operating system in 2003, officials have unveiled plans to switch all government-run offices to Linux. Now under the terms of the agreement signed between the two states, South Korea will set up Linux training centres in North Korea.

Because:

Under the banner of "Hana Linux" - literally "One" Linux - the two countries have agreed to work on a groundbreaking IT development project that might shatter the final Cold War boundary.

Update: But Gen Kanai points out that there are problems with this rosy picture.

Gone for a Burton

On Open Enterprise blog.

Free Knowledge Institute

More reinforcements are arriving all the time:

The Free Knowledge Institute (www.freeknowledge.eu) is an initiative from three Amsterdam-based professionals who currently work for Internet Society Netherlands. In the past years ISOC.nl coordinated a large-scale EU-project SELF which embraced the same objectives. The need to share knowledge freely has become so important that the institute now turns into an independent organisation.

"More and more governments realise the benefits of free knowledge and free information technology", says Wouter Tebbens, the president of the new institute. The Free Knowledge Institute intends to be a knowledge partner helping to show the way in available free knowledge and technology. "That way, we can elaborate on the existing pool of free knowledge and free software, which is growing enormously. Look at projects such as Wikipedia, Linux, and the internet itself", Tebbens states. "Why reinvent the wheel yet again?"

Its main lines of activity are Free Knowledge in technology, education, culture and science. Free Knowledge in education focuses on the production and dissemination of free educational materials; Free Knowledge in IT mainly refers to free software, open standards and open hardware; Free Knowledge in culture includes open content; and Free Knowledge in science includes open access and anti-privatisation of scientific knowledge.

The actionplan 'Netherlands Open in Connection', initiated by the Dutch ministries of Economic Affairs and Interior and Kingdom Relations (BZK), reflects the momentum of sharing knowledge. State secretary Bijleveld from BZK emphasized in December 2007 that sharing of knowledge is essential for further progress and development of society. The statesecretary committed to pay more attention to the valuable use of free software and open standards in education, government and business.

It's happening, people, it's happening.

Airheads

I'm a not a Apple fanboy - no, really. So the announcement of the Macbook Air left me, well, underwhelmed. But I was having difficulty putting my finger on what exactly the problem was. And then I read this:

Thinness is an aesthetic criterion, not a utilitarian one. Art triumphs over usefulness yet again, driven by Steve “One Button” Jobs.

Yup.

Extinguishing LAMP: Sun Buys MySQL

On Open Enterprise blog.

Openads Who?

On Open Enterprise blog.

Fighting for Open Access in Russia

The UK is apparently not the only country where there is a fight going on for open access to government information:

The Institute for Information Freedom Development (IIFD) fighting for the state standards to be available in the internet has managed to persuade the Russian government in its rightness. On the eve of the New Year’s holidays the decree of the RF cabinet of ministers setting the procedure to publish the national standards on the site of the Federal Agency for Metrology and Technical Regulation (Rostehregulirovanie) has been enforced. The document foresees the standards to be open and available free of charge. However, the officials do not intend to give up.

...

The institute hopes if will be hard for the officials to question the official document. ‘The public servants, who are used to selling the state standards, have no loopholes this time, as the document highlights the access should be free of charge. The term ‘open access’ left some room for manoeuvre. However, now many will have to accept the fact that their profitable business exists no longer’, - Ivan Pavlov says.

In fact, it sounds as if things are rather better in Russia than in the UK....

Whatever Happened to the GFDL?

With all the excitement last year over the GNU GPLv3, the Cinderella of the FSF licences, the GNU Free Documentation Licence (GFDL) has been rather overshadowed. And yet, as this post reminds us, the GFDL is being revised too:

Although quiet, the consultation for drafting the next version of the GNU Free Documentation Licence, plus the new GNU Simpler Free Documentation License, are still ongoing:

* http://gplv3.fsf.org/doclic-dd1-guide.html

The online draft of GFDLv2 still has Invariant Sections. The proposed GSFDL is a documentation licence without Invariant Sections.

I don't have information about the timeline for the GFDL and GSFDL, so all I can recommend is that comments be made as soon as possible.

Adding Some SPARQL to the Semantic Web

On Open Enterprise blog.

Freeing The Future of Ideas

Larry Lessig's The Future of Ideas is one of the key books of the open content world, so it's particularly appropriate that it should now be freely available as a download.

Read it. Now.

Open Politics

One sphere where openness is generally acknowledged as indispensable is politics: true democracy can never be opaque. In the past, providing that transparency has been hard, but with the advent of Web access and powerful search technologies, it has become markedly easier. Despite that, there are still very limited resources for searching through the raw stuff of politics.

A new pilot project, called Hansard Prototype, may help to change that:

This site is generated from a sample of information from Hansard, the Official Report of Parliament. It is not a complete nor an official record. Material from this site should not be used as a reference to or cited as Hansard. The material on this site cannot be held to be authoritative. Material on this site falls under Crown and Parliamentary Copyright. Within these copyright constraints, you are encouraged to use and to explore the information provided here. We would be especially interested in requests for functionality you have.

Even though it's still limited in its reach, playing with it is instructive. For example this search for "genome" not only throws up various hits, but also shows graphically when they occurred, and ranks the names of speakers.

It's also got the right approach to code:

What technology has been used to build and run this site? Code: Visible Red, Moving Flow. Hosting: Joyent Accelerators. Server OS: OpenSolaris. Database: MySQL. Web server: Apache. Application server: Mongrel. Code framework: Ruby on Rails. Source code control: Subversion. Search engine: Lucene, Solr. Backup: Joyent Bingodisk. Development and deployment platforms: Mac OS X, Ubuntu.

The source code for this site will be made available under an open licence.

More please. (Via James Governor's Monkchips.)

Ohloh Opens Up

On Open Enterprise blog.

Bring on the Ferrets

A dissertation on copyright in 19th-century America may not sound exactly like beach reading, but the fact is that US law in this area affects the rest of the world - not least because of the US's heavy-handed attempts to extend its application around the globe:

With the rise of digital reproduction and the expansion of the Internet, copyright issues have assumed tremendous prominence in contemporary society. Domestically, the United States is awash in copyright-related lawsuits. Internationally, fears of copyright violation strongly influence U.S. foreign policy, especially with China. Hardly a week goes by without some new copyright-related headline in the news. In a globalized world with cheap digital reproduction, copyright matters.

That law has been shaped by the 19th-century experience. And what a century:

The bill in substance provides that […] copyright patents shall be granted to foreigners; they may hold these monopolies for forty-two years; the assigns of foreigners may also obtain copyrights; all postmasters and customs officers throughout the United States are constituted pimps and ferrets for these foreigners; it is made the duty of postmasters to spy out and seize all books going though the mails that infringe the copyrights of foreigners; if an American citizen coming home brings with him a purchased book, it is to be seized on landing unless he can produce the written consent of the man who owns the copyright, signed by two witnesses. Who the said owner may be, in what part of the world he lives, the innocent citizen must find out as best he can, or be despoiled of his property.

The source of this heated prose of pimps and ferrets? The May 19, 1888 issue of Scientific American.

Novell's One Big Thing

On Open Enterprise blog.

Linux-Powered Toasters?

Well, not quite, but here's a Linux-powered picture frame:

Sagem Communications and Freescale Semiconductor today announced the deployment of the new AgfaPhoto AF5080W digital photoframe, the latest product from their broad collaboration based on Freescale’s i.MX multimedia processors and Linux multimedia applications.

(Via Linux and Open Source blog.)

Wackypedia: the Wikipedia fork

On Linux Journal.

The Real Big Switch

An eloquent statement by John Wilbanks about the commons, sharing and solving complex problems:

One of the reasons I believe so deeply in the commons approach (by which i mean: contractually constructed regimes that tilt the field towards sharing and reuse, technological enablements that make public knowledge easy to find and use, and default policy rules that create incentives to share and reuse) is that I think it is one of the only non-miraculous ways to defeat complexity. If we can get more people working on individual issues – which are each alone not so complex – and the outputs of research snap together, and smart people can work on the compiled output as well – then it stands to reason that the odds of meaningful discoveries increase in spite of overall systemic complexity.

He concludes:

It is not easy. But it is, in a way, a very simple change. It just requires the flipping of a switch, from a default rule of “sharing doesn’t matter” to one of “sharing matters enormously”.

That's what it's all about, people.

Mark My Words

On Open Enterprise blog.

OBOOE Makes a Noise about Open Source

On Open Enterprise blog.

De-Commodifying an Enclosed Commons

Confused? You will be:

in today’s world, the crush of branded meanings has become overwhelming. The cultural space is too cluttered with signifiers, and words are losing their credibility. And marketing itself is so ubiquitous that it is difficult for a super-elite establishment to convey that it is “above it all” -- grandly indifferent to the market. Clearly the next step is to de-commodify the product or service that was sold in the market, and previously belonged to the commons, and make it a proprietary gift! Ah, now that’s really luxury!

EU vs. MS 2.0?

The European Commission opened a new antitrust probe against Microsoft on Monday into whether it unfairly tied its Web browser to the Windows operating system and made it harder for rival software to work with Windows.

But the good news is:

"This initiation of proceedings does not imply that the Commission has proof of an infringement. It only signifies that the Commission will further investigate the case as a matter of priority," the Commission said.

Oh, that's alright, then.

Gaining Focus

Focus is one of the two main German-language weekly news magazines (the other being Der Spiegel), so the announcement that it is opening up its full 15-year archive for free access is most welcome. Let's hope that Der Spiegel, err, mirrors the move.