An Open Government Data Licence for the World?

As I've noted before, the UK government is now arguably the leader when it comes to open data. Of course, that's not really the point: this isn't a competition with winners and losers, but a global effort to open things up. As such, it would be nice if there were more collaboration between the different governments - things like this, for example:

On Open Enterprise blog.

Spreading the Word about Open Government Data

One of the most amazing - and heartening - developments in the world of openness recently has been the emergence of the open government movement. Although still in its early stages, this will potentially have important ramifications for business, since one of the ideas at its heart is the opening up of government datasets for anyone to use and build on - including for commercial purposes (depending on the particular licences). The UK and US are leading the way in this sphere, and an important question is to what extent the experiences of these two countries can be generalised.

On Open Enterprise blog.

Building on Open Data

One of the great things about openness is that it lets people do incredible things by adding to it in a multiplicity of ways. The beatuy is that those releasing material don't need to try to anticipate future uses: it's enough that they make it as open as possible Indeed, the more open they make it, the more exciting the re-uses will be.

Here's an unusual example from the field of open data, specifically, the US government data held on Data.gov:

The purpose of Data.gov is to increase public access to high value, machine readable datasets generated by the Executive Branch of the Federal Government. Although the initial launch of Data.gov provides a limited portion of the rich variety of Federal datasets presently available, we invite you to actively participate in shaping the future of Data.gov by suggesting additional datasets and site enhancements to provide seamless access and use of your Federal data. Visit today with us, but come back often. With your help, Data.gov will continue to grow and change in the weeks, months, and years ahead.

Here's how someone intends to go even further:

Today I’m happy to announce Sunlight Labs is stealing an idea from our government. Data.gov is an incredible concept, and the implementation of it has been remarkable. We’re going to steal that idea and make it better. Because of politics and scale there’s only so much the government is going to be able to do. There are legal hurdles and boundaries the government can’t cross that we can. For instance: there’s no legislative or judicial branch data inside Data.gov and while Data.gov links off to state data catalogs, entries aren’t in the same place or format as the rest of the catalog. Community documentation and collaboration are virtual impossibilities because of the regulations that impact the way Government interacts with people on the web.

We think we can add value on top of things like Data.gov and the municipal data catalogs by autonomously bringing them into one system, manually curating and adding other data sources and providing features that, well, Government just can’t do. There’ll be community participation so that people can submit their own data sources, and we’ll also catalog non-commercial data that is derivative of government data like OpenSecrets. We’ll make it so that people can create their own documentation for much of the undocumented data that government puts out and link to external projects that work with the data being provided.

This the future.

Follow me @glynmoody on Twitter or identi.ca.

Opening up: New York Senate's Doing It *Now*

Vancouver may have promised that it will do it, the New York Senate is actually opening up completely now:

Welcome to the Open NYSenate

To pursue its commitment to transparency and openness the New York State Senate is undertaking a cutting-edge program to not only release data, but help empower citizens and give back to the community. Under this program the New York Senate will, for the first time ever, give developers and other users direct access to its data through APIs and release its original software to the public. By placing the data and technological developments generated by the Senate in the public domain, the New York Senate hopes to invigorate, empower and engage citizens in policy creation and dialogue.

...

Original Software

As a user of Open-Source software the New York Senate wants to help give back to the community that has given it so much - including this website. To meet its needs the Senate is constantly devleoping new code and fixing existing bugs. Not only does the Senate recognize that it has a responsibility to give back to the Open Source community, but public developments, made with public money should be public.

...

Data Sets

The New York Senate's Open Data page is the official repository of all government data. There you can browse through data produced by and considered by the Senate in their original forms as well as various other file types created for your convenience; including but not limited to: Excel spreadsheets, .csv, text files and PDFs. To supplement the source data it is making available, the Senate has also created the Plain Language Initiative designed to help explain complex data sets and legal terms in plain language.

...

Open-Source Software & Software Licenses

In order to make the Senate's information and software as public as possible, it is has adopted unique system using two types of licenses - GNU General Public License as well as the BSD License. This system is meant to ensure the most public license is used in each specific case such that:

(i) Any Software released containing components with preexisting GPL copyrights must be released pursuant to a GPL v3 copyright restriction.

(ii) Any Software created independently by the Senate without any preexisting licensing restrictions on any of its components shall be released under dual licensing and take one of two forms: (a) a BSD license, or (b) a GPL v3 license. The ultimate user of such Software shall choose which form of licensing makes the most sense for his or her project.

This is getting too easy: I want more of a challenge to opening up government.

Anyway, kudos to all involved - great move.

Follow me @glynmoody on Twitter or identi.ca.

Towards Open Government Data

One of the premises of this blog is that openness - radiating out from open source through open content, open access, open data and the rest - is more than a technical issue. Ultimately it is something that will touch every aspect of our lives.

One manifestation of this is the move to obtain free access to government data. In the UK, the Guardian has been a leading campaigner, and here's some news of what going on the other side of the pond:

I got a sense for the importance of the task talking with Dan O’Neil, who is “people person” for Everyblock.com, a remarkable project headed by Adrian Holovaty designed to be a “one-stop shop” for information about urban neighborhoods, including building permits, crime reports, planned improvements, school information, etc. Dan’s job is to negotiate with government officials in the twenty cities Everyblock seeks to map, and gain access to vast geocoded data sets. Armed with a set of principles and best practices that government geeks can show to their bosses, his job would be a lot easier than it is right now.

Most significant, perhaps, is the definition of what constitutes open government data:

Government data shall be considered open if it is made public in a way that complies with the principles below:

1. Complete
All public data is made available. Public data is data that is not subject to valid privacy, security or privilege limitations.

2. Primary
Data is as collected at the source, with the highest possible level of granularity, not in aggregate or modified forms.

3. Timely
Data is made available as quickly as necessary to preserve the value of the data.

4. Accessible
Data is available to the widest range of users for the widest range of purposes.

5. Machine processable
Data is reasonably structured to allow automated processing.

6. Non-discriminatory
Data is available to anyone, with no requirement of registration.

7. Non-proprietary
Data is available in a format over which no entity has exclusive control.

8. License-free
Data is not subject to any copyright, patent, trademark or trade secret regulation. Reasonable privacy, security and privilege restrictions may be allowed.