For People with Large Data Sets

Strange but interesting:

This is a site for large data sets and the people who love them: the scrapers and crawlers who collect them, the academics and geeks who process them, the designers and artists who visualize them. It's a place where they can exchange tips and tricks, develop and share tools together, and begin to integrate their particular projects.

In a Bit of a Scrape

"Mix and mash" lies at the heart of the power of openness: it allows people to come up with new, often better, uses of data, notably by cross-referencing it with yet more of the stuff to create higher levels of information. But as this Wired feature details, there is a tension between what the scrapers and the scraped want:

there's an awkward dance going on, an unregulated give-and-take of information for which the rules are still being worked out. And in many cases, some of the big guys that have been the source of that data are finding they can't — or simply don't want to — allow everyone to access their information, Web2.0 dogma be damned. The result: a generation of businesses that depend upon the continued good graces of a relatively small group of Internet powerhouses that philosophically agree information should be free — until suddenly it isn't.

Striking the right balance is tricky, but I think there's a way out. After all, if everyone can use everyone's data, there's a quid pro quo. The problem is when some give and others only take. (Via ReadWriteWeb.)