Municipal Vaporware: Why NYC's Data Mine is A Data Dump

This morning, Mayor Mike Bloomberg unveiled New York City's long-awaited Big Apps contest. Big Apps seeks to promote the Internet industry in the Big Apple (it's sponsored by the New York City Economic Development Corporation) and make local government more transparent.I've been following the evolution of open data initiatives at the municipal level for about a year now, and was really hoping that New York was going to set the bar for future efforts across the country. It doesn't. In fact it's hard to understand why some notable local tech superstars like investors Fred Wilson and John Borthwick would sign on to such a lame effort.

2 minute read

October 6, 2009, 11:55 AM PDT

By Anthony Townsend


This morning, Mayor Mike Bloomberg unveiled New York City's long-awaited Big Apps contest. Big Apps seeks to promote the Internet industry in the Big Apple (it's sponsored by the New York City Economic Development Corporation) and make local government more transparent.

I've been following the evolution of open data initiatives at the municipal level for about a year now, and was really hoping that New York was going to set the bar for future efforts across the country. It doesn't. In fact it's hard to understand why some notable local tech superstars like investors Fred Wilson and John Borthwick would sign on to such a lame effort.

First of all, the prize structure doesn't make sense. First prize is $5,000 and dinner with Bloomie himself. No commitment to fund, adopt, promote or license the app for citywide use. People that build city apps want to engage the public and the investor community, not the city's political elite. I bet they'd rather have dinner with Andrew Raisej.

Second, despite the fact that the project is primarily aimed at stimulating new business development (it's coming from the econ dev folks) the rules require all entrants to grant the city a one-year license to distribute the app freely. So anyone thinking of building a paid iPhone app, you're shit out of luck.

Finally, and most importantly, the NYC Data Mine that is supposed to be the raw materials for these apps, is more of an NYC Data Dump than anything else. Browsing through the 100+ datasets posted this afternoon to the city's site, you see that about half are just boundary shapefiles easily downloaded or licensed through existing channels. The other half are a dog's breakfast of static datasets (New! Updated monthly!) in every format from Excel to Access to (gag!) SAS. Hello, people, its 2009. API+XML FTW! Just to take one example, I can't wait to see what fascinating mashups stem from the historic release of the Department of Consumer Affairs' list of licensed electronic shops. Because what the world is really lacking is more information about the location of electronics retailers. What this Data Dump looks like is the collected attachments received in reponse to the poor bureaucrat who had to twist every department's arms for one dataset, so the city could say every department contributed.

As someone who's spent time brainstorming with government agencies about open data ecosystems, I'm saddened to see that the city has engineered this program for maximum political impact, minimal risk and mediocre innovation. It's municipal vaporware.

p.s. Guys, you forgot to the the website URL in your press release. p.p.s The one cool thing they did was used Challenge Post to host the site. Thanks BetaWorks!


Anthony Townsend

Anthony has been researching the implications of new technology on cities and public institutions for over a decade. As Research Director at the Institute for the Future (IFTF) in Palo Alto, California, Anthony's work focuses on several inter-related topics: pervasive computing, the urban environment, economics and demographics, public and nonprofit organizations, and the media industry.

portrait of professional woman

I love the variety of courses, many practical, and all richly illustrated. They have inspired many ideas that I've applied in practice, and in my own teaching. Mary G., Urban Planner

I love the variety of courses, many practical, and all richly illustrated. They have inspired many ideas that I've applied in practice, and in my own teaching.

Mary G., Urban Planner

Get top-rated, practical training

High-rise apartment buildings in Waikiki, Hawaii with steep green mountains in background.

Study: Maui’s Plan to Convert Vacation Rentals to Long-Term Housing Could Cause Nearly $1 Billion Economic Loss

The plan would reduce visitor accommodation by 25,% resulting in 1,900 jobs lost.

April 6, 2025 - Honolulu Civil Beat

Two yellow and white Dallas Area Rapid Transit light rail streetcars at station in Dallas, Texas.

North Texas Transit Leaders Tout Benefits of TOD for Growing Region

At a summit focused on transit-oriented development, policymakers discussed how North Texas’ expanded light rail system can serve as a tool for economic growth.

April 3, 2025 - KERA News

Rusty abandoned oil well and equipment with prickly pear cactus next to it in West Texas.

Using Old Oil and Gas Wells for Green Energy Storage

Penn State researchers have found that repurposing abandoned oil and gas wells for geothermal-assisted compressed-air energy storage can boost efficiency, reduce environmental risks, and support clean energy and job transitions.

March 31, 2025 - Pennsylvania State University

Green and white interstate freeway signs pointing to Hayward and San Mateo and Half Moon Bay exits in Northern California.

San Mateo Formally Opposes Freeway Project

The city council will send a letter to Caltrans urging the agency to reconsider a plan to expand the 101 through the city of San Mateo.

45 minutes ago - Streetsblog San Francisco

Kingsbridge Armory, large hangar-like brick building in the Bronx, New York City with brick lower floors and glass/metal curved roof..

A Bronx Community Fights to Have its Voice Heard

After organizing and giving input for decades, the community around the Kingsbridge Armory might actually see it redeveloped — and they want to continue to have a say in how it goes.

1 hour ago - Shelterforce Magazine

Close-up of white sign with black text; line drawing of bike and 'BIKE LANE'

Houston Mayor Promises Dedicated Austin Street Bike Lane After Public Backlash

Although the one-way bike lane won’t be protected by physical barriers, the proposal is an improvement over the mayor’s initial plan to only include sharrows on the Austin Street project.

2 hours ago - Houston Chronicle