Nick Grossman

At OpenPlans, we’re busy signing up new clients for our products & services, and we’re also spending a lot of time fundraising (from individual donors, foundations, etc.).  As such, I’ve been thinking about how we pitch our organization, and have recently spent some time over the past few days reading some of the great stuff over at VentureHacks. Their book, Pitching Hacks covers the fundamentals, from what matter to investors (traction), to how to get introductions, to how to structure your pitches (whether high-concept, elevator, or slide deck).

Then, this morning while reading Hacker News (or more specifically Nirmal J. Patel’s full-content RSS of Hacker News), I came across this posting which caught my eye:

Technical co-founder wanted for disrupting the wedding industry.

Hi, my name is Tracy. The wedding industry is huge, overpriced, and with insane profit margins. I’m looking to disrupt it with WeddingType.

In wedding invitations alone, there are two options: spend hundreds of dollars for custom designed invitations (expensive but pretty), or do-it-yourself (cheap but ugly). I want to build a web application catering to the price sensitive couples who have an aversion to Comic Sans.

A do-it-yourself wedding invitation kit costs $45, while professional wedding invitations are hundreds or thousands of dollars. With WeddingType, the service will guide the user through a constrained flow of inputs which will populate a set of pre-designed templates with professional typography that they can print out and get hitched. The completely automated service will charge $25 and send the user a PDF by email.

My goal is to get this out really fast and start making revenue from the start, then see how big we can grow it. From here, there are multiple ways of increasing value and revenue — licensing to wedding invitation template manufacturers, selling custom design solutions, offering templates through the site, etc. Large scale, could sell templates through the site, printing and mailing like Moo.com.

I freelanced and worked at a startup for five years as the primary designer/jack-of-all-trades for everything relating to their web properties, including analytics, usability, design, HTML/CSS, and multivariate/AB testing. I need a technical partner who is enthusiastic about the business and a web programming whiz. Preferably in the Bay Area, and if everything goes right, we’ll apply to Y Combinator for the next Winter session.

Intrigued? I’d love to meet you, perhaps work on a small project together.

This is not a perfect pitch, by my or VentureHacks’ standards — in fact, I am not fully convinced by it after the first paragraph. However, I think the title and first line are good, and they are what drew me in.

Speaking from recent experience of getting married (in 2005) and having a baby (last year), I can say with absolute certainty that these are both huge markets where there’s an opportunity to be smart and offer products that will serve people well, save them money, and be profitable.  In this pitch, it was the problem/opportunity statement (“The wedding industry is huge, overpriced, and with insane profit margins”) that got me.  I certainly agree with that part.  Wedding invitations are one piece, and there are many others.  My wife has a million ideas for businesses in this space.  If I were an investor in XX Combinator, I’d definitely start here.

In her bathroom, a friend of mine has some really beautiful illustrations of posts from the Craigslist Missed Connections section.  If you’ve never looked at missed connections, you should — there are some really wonderful notes in there (also some sketchy ones).  Here’s a beautiful one from today:

7 train glances on monday – w4m – 20 (7 train Queensbound)

We were sitting opposite each other on the train. We caught eyes early in the ride, but you nodded off through most of it, but looked up as I was getting off. As the train moved you kept looking at me walking to the stairs.

All I want to tell you is that you have the most beautiful clear blue grey eyes.

What’s striking is how many of the missed connections take place in the subway.  I’ve said before that transit is a uniter not a divider; these posts confirm that, and are a really nice view into that slice of NYC life.

The “ad hoc groupings” that take place on the subway also really resonate with the ideas in Dave Weinberger’s Small Pieces Loosely Joined, which I’m reading right now.  Dave talks about how on the web, groups take on a new meaning — they form and unform quickly, and can be formed by very loose connections (such as commenters on a blog post).  The city is the same way — the people I’m standing with on the subway are an ad-hoc group that unforms just as fast as it forms.  But there’s definitely a connection. Typically, it takes an event of some kind, like a man talking into a banana phone or two people having a loud argument, to draw more outward communications among riders.  But underneath it all, there’s a hidden set of communications going on, and it’s really beautiful to see it unearthed through Missed Connections.

It turns out the posters are by a Brooklyn-based artist named Sophie Blackall, who has a whole poster series + a blog on Missed Connections.  Really nice.

I love music, but I am really bad about keeping up with new stuff.  My iTunes library is only so-so, so I spend most of my time listening to playlists on 8tracks.  This is good for variety, and great for finding the right background music for a BBQ or party, but there’s something missing: my friends.

I have a few friends who have great taste in music, and who are totally on top of what’s new and good.  As it works now, every once in a while I’ll get a recommendation from one of them, I’ll buy the album on Amazon, and then I’ll listen to it non-stop for a few weeks.  It’s great when it happens, but it doesn’t happen that often.  I want something more automated and frequent.

A few of these friends publish their music on the web (see Piecemaker and My Brooklyn is Better).  Problem is, they each use different platforms to publish, and as far as I can tell, there’s not a great way to combine these into one stream.  Piecemaker uses WordPress and outputs a standard podcast feed, and My Brooklyn is Better uses Tumblr, which embeds a flash player and forbids linking directly to the audio file.  I’m sure I have other friends who are publishing on platforms (Last.fm, 8tracks, Facebook?) that I don’t know about yet).

So, what I want is a way to take these streams, regardless of platform or format, and create a mixed feed or webpage.  I don’t care about actually downloading the music; I just want to be able to listen on the web, keep track of the ones I like, and have the option to buy the albums later.

I’m sure this is possible using some combination of tools that are already out there.  For starters, I’m playing around with Yahoo Pipes to see if I can mash something up to my liking, with an eye towards playing it on the web using StreamPad.  We’ll see if that works.  But is there something out there that I’m missing that already does this in a more straightforward way?  Seems like there must be, but I haven’t found it yet.

This week, we’re on vacation in Cape Cod with my wife’s family.  They’ve been renting the same tiny cabin by the beach for the past 35 years, and coming here is pretty much the highlight of our summer each year.  Last summer, we brought Theo here when he was just three weeks old.  This morning, he and I took a walk along the harbor in Provincetown at low tide — he thinks of each beached boat as a giant bucket, just waiting to be filled with sand.

The problem is, whenever we’re on vacation, I have a hard time finding the right balance between “unplugging” and staying engaged with the real world.  One the one hand, I want to remain connected with work and friends, on the other, I just want to tune out, relax, and be with the people I’m with.  Inevitably, I end up fighting the struggle each day, carving out some time for the important stuff at work, and forcing myself (with limited success) not to stress about it too much the rest of the time.  It’s tough, and to some extent I feel like I achieve the worst of both worlds: neither able to fully enjoy my break, nor be fully present for important happenings at the office.

This has become more of an issue as technology has evolved.  Here at the cabin there’s never been any phone or TV.  Then there were cell phones.  Next, internet down the road at the town library. Then, iPhone and blackberries.  Now, this year we have a mobile broadband connection for our laptops, so we’re as connected as we can be.  For certain things, it’s great: we watched the World Cup final online last weekend, and yesterday my father-in-law did an interview via Skype, which saved him a day-long trip up to Maine.  But, work email and things to do are now within arms reach at all times.

I suppose the vacation case is just a microcosm of the larger question of how to balance real-world face time with online time.  Fred Wilson, one of my favorite bloggers, covers this topic frequently, and I’m really amazed the extent to which he’s able to stay engaged with the networked world without driving his family crazy.  In our case, the family is only semi-digitally integrated; it’s just not part of our culture to always be connected.  Maybe getting an iPad would push that culture change in a good way.

Lastly, I think it also comes back to information fitness — using online (all?) time to do the most important and productive things, and not just consume endlessly as you might in a less online constrained environment.  And of course, one of these days I’ll be able to plan ahead enough so that everything is under control at the office and I don’t have to worry about anything.  But I’m sure if I did that, I’d find reasons to plug back in…

This morning, I drove from Boston to Cape Cod, alone with my thoughts except for Theo sleeping in the back seat.  Once we were out of the city and smoothly on the highway, I got to thinking about work, and things really started clicking.  I found myself reaching for my iPhone to record voice memos about once every minute.  I may have even cracked an important nut; we’ll see.

I can’t remember where, but I once heard the phrase the optimism of the traveler, and the idea has really stuck with me.  For me, this manifests itself in the fit of ideastorming I usually find myself in whenever I’m on a plane or train (and sometimes when I’m in a car).  Some of my most creative and productive times have been in these situations.  And it’s not just about volume of ideas — there’s a different sort of excitement and hopefulness that happens during these times.

So, what is it about traveling that produces such excitement?

Is it being away from the internet, and therefore being forced to digest some ideas and not just consume at will?  Or maybe it’s less about attention, and more about being in that middle place between destinations, where anything is possible? Whatever it is, it’s really great.  Of course, the hard part is putting those ideas into motion once you’re feet are back on the ground…

// Photo by Tjeerd on Flickr

I’ve been thinking a lot about fitness lately, mostly spurred on by the great stuff coming out of Clay Johnson’s new blog, InfoVegan. Clay has been drawing a parallel between physical obesity and information obesity, and has been diving deep on what it means to have a “healthy information diet.”  It’s inspiring stuff, and definitely worth keeping up on.

The takeaway for me is that fitness (of any type) is largely about producing, not just consuming.  You need to write to properly digest what you’ve read, and you need to exercise to properly digest what you’ve eaten.  My favorite characterization of this is David Eaves’ “if writing is a muscle, this is my gym” tagline on his blog.

So in the spirit of fitness, yesterday I went for a run and today I wrote this post

I spend a fair amount of time thinking about LifeHacking.  Getting my inbox filters just right so I can get to “inbox double-zero,” syncing my iPhone and my Google Calendar, setting up ssh keys in all the right places, etc.

But something I’m still not that good at is “LifePruning,” that is, the continual process of getting rid of all the old / no longer relevant shit in my life, the stuff that, if left untended, will crowd out all the good stuff.  It’s kind of hard for me, as I have natural hoarding tendencies, but I’m trying to live by a new code: prune first, ask questions later.

This weekend, with an impending move from NYC -> Boston, I’ve been doing some pruning, and boy does it feel good.  Huge bang for the buck.  I’m going to try and make this more of a regular routine.

Here’s the quick rundown of the LifePruning I’ve done, this week alone:

• Cleaned out my clothes closet and donated all the things I never wear anymore / don’t fit.  Amazingly, getting rid of those uncovered some real gems that I had forgotten about.
• Got a new computer and transferred my data and applications.  Not all of them, mind you; just the ones I really need.  The result is a leaner, meaner, faster machine.  (Note: getting a new computer is not required to do this, but it helps)
• Went through my Google Reader and deleted all the feeds I no longer read, or are just less into these days.  That means less distraction from the awesome ones I want to make sure I actually read every day.

I know that good things will come of this pruning, and I’ll try and keep track as they do.  For example, I’m sure I’ll read a great post I would have otherwise missed thanks to my RSS pruning, and I’ll look sweet at the office in that shirt I found in my closet (not sure of the practical usefulness of that), and so on.

This is just a start.  I’m going to keep an eye out for more LifePruning opportunities, and I’ll post them here as I do.  If you have a good life pruning suggestion, let me know.

Update: SVN has a post today on this topic: The Art of Taking Things Away.

// Pruning grahpic via Agriculture Guide

Next Wednesday, I’ll be on a panel at the MTA Developers Unconference.  I’m very much looking forward to the event, because among other things, one of my fellow panelists will be the new MTA Chief, Jay Walder.  Here, I’ll give an overview of what I’m hoping to discuss on the panel; any feedback would  be greatly appreciated.

Before I get to that, though, I should note that it’s been an interesting journey working with MTA on its open data and developer relations policies over the past year.  In a nutshell, it’s gone from a highly contentious situation, to an atmosphere of open collaboration.

Almost exactly one year ago, here at OpenPlans we were beginning to experiment with the problem of tracking buses through the city.  That led us to dip our toes in the world of transit data — since you need to know the routes and schedules to do tracking and predicting — and introduced us to some of the challenges in getting accurate and up-to-date NYC bus schedule data.  Over the next 9 months, we engaged with the NYC transit developer community and the MTA to help work through the issues standing in the way of open MTA data.  We were very pleased when they announced in January that they’d be launching a developer outreach and open data program.

We believe that most of the credit for making this dramatic change happen goes to Chairman Walder and his conviction that open data would lead to innovation and ultimately better service for riders.  In his words at the time of the MTA dev center launch: “We need to get out of our own way and instead get out in front of the data sharing revolution” (via Second Avenue Sagas).

But I’d also like to personally thank Nick Bergson-Shilcock, David Turner, and the rest of the transit team here at OpenPlans for their hard and important work in helping to organize the NYC transit developer community, and in helping to identify and work through the sticking points regarding open data policy with the MTA.  Back in August 2009, I got an email from Nick to the effect of “This is going to be really big, and we need to step up and get involved.”  That prompted us to start the NY Transit Data Meetup, and develop a more serious and structured conversation about open data with the MTA and the developer community.  Thanks Nick; you were right (as usual), and I’m really happy that I listened to you (as usual).

Fast forward to today.  MTA has open data, a growing developer community, and is iterating.  From our perspective, they seem to be heading in the right direction.  So, that begs the question, what should they focus on next?  Here are a few things that I’ll be interested in hearing about & talking about on Wednesday:

• Within MTA, which datasets would be the next easiest to expose? Of those, which would be the most interesting to developers?
• What can we do to increase data sharing among other regional transit agencies? Last I checked, NJ Transit was the largest agency without open data according to City-Go-Round.
• Let’s think beyond just transit data to transportation data. When it comes to planning trips, modes should be abstracted out of search.  What other datasets (outside of the ones in the MTA’s control) would be required to make some really interesting things possible?  (I’m thinking DOT for traffic, TLC for taxi data, paratransit, etc.)
• Real-time. MTA has been piloting real-time bus location data on 34th street.  Would love to see the L train and 6 train in future pilots.
• (Imaginary readers out there…) If you could ask Chairman Walder one question, what would it be?

That’s it.  Have a great weekend, and here’s to smart transportation and open, interoperable cities…

// Heart shaped subway map by ZEROPERZERO

After many moons of plotting and scheming, yesterday we announced our organizational rebranding: The organization formerly known as The Open Planning Project (or TOPP) is now OpenPlans.  I am excited, and I think this is a welcome development.

For years, there has been mass confusion (chaos! pandemonium!) around our name.  Our emails were @openplans.org, our website was topp.openplans.org (until 2009), and our name was the Open Planning Project.  To top it off, for several years, we ran a separate web service called OpenPlans (now under new management as CoActivate).  As I’ve mentioned before, I’ve never been comfortable with these conflicting brands and identities, and I’m psyched that we’ve finally made the leap.

Here’s a quick look into where we ended up, and how we got there.

First, we’ve updated our logo.  Designed by the spectacularly fabulous Andy Cochran, it’s similar to our old logo, but with cleaner lines and more meaning.  It probably goes without saying, but we’ve got the “O” and the “P” in there, and the shape is a broken circle, evoking open processes:

For comparison, here’s the logo that we’d been using for the past year or so.  In order to minimize confusion between OpenPlans (the service) and The Open Planning Project the organization, we spent most of 2009 using our organizational nickname, TOPP, more prominently in our identity.  While “TOPP” is easy to say and remember, as with most acronyms, it’s pretty meaningless on its own.  I’m sure it will take us a while to erase TOPP from our vocabularies, but I think it’s the right move.

To round out the logo history, here’s the one that was in service through 2008.  I like it, however for the twenty- and thirty-somethings in the room, “OPP” means something a bit different (can you say “harm me with harmony”?).

Of course, to go along with the rebrand, we’ve updated the OpenPlans website, attempting to streamline our messaging along with our logo & brand.

We’ve been struggling with a meaningful, succinct tagline for quite some time, and for now have settled on “We make cities work better.”  A while back, I wrote about the idea of “making cities easier to use” — since then, we’ve taken that idea and adapted it a bit.  Making cities work better is a better representation of our intentions, as it’s multi-directional (i.e., we’re not just “using” cities), and it hints at the digital infrastructure that we’re building.

Also, for the first time, I think we’ve successfully articulated how our software development, technology strategy and journalism activities are connected, as part of what we’re calling “the new civic infrastructure.”

Lastly, a major goal of the redesign was to make it more clear what we do and how people can work with us.  I guess now we just sit back and wait for the contracts to roll in…

Here’s what the website looks like today:

And for another trip on the Wayback Machine, here’s a look at 2009:

2008:

and 2007:

That’s it.  Hello, OpenPlans.  Nice to meet you.

A few months ago, I did a short interview for the Engadget Show on the state of real-time bus information here in NYC.  The interview was for a video segment which led into a live interview with the reporter I worked with, Rick Karr.  The whole episode is now available online.  Before our section is an interview with Nicholas Negroponte, talking about OLPC and visions for the future.

35 min into the show is our part.  We’re standing right outside of Penn Station, checking out the real-time bus information that’s available now on 34th Street via dynamic signage.  We talk a bit about the current state of real-time on NYC buses and the challenges that the MTA has faced getting real-time implemented thus far.  In the live interview, Rick mentioned some of the work we’ve been doing at The Open Planning Project, including the iPhone-based OpenBusTracker experiment we did last summer, and our general belief that real-time can be implemented for less than you’d expect using commodity hardware and open source software.

Of course, it’s tough to watch yourself on video, and it’s even tougher to hear your own edited answers.  Note to self: work on snappier soundbites!  But it was really fun doing the interview, and great to get the real-time transit discussion out there to a wider audience.

Earlier this summer, I had the pleasure of speaking at the Future of News and Civic Media conference at MIT.  It was great to be around such a creative and talented group of people, and as usual, this year brought with it a new batch of Knight News Challenge winners. (For a roundup of some conference takeaways, see Paul’s post).

The topic for my talk was “Data into Action” — in other words, how can we build on transparency and use data to create social and political impact?

This was the question posed by Chris Csikszentmihalyi, the director of MIT’s Center for Future Civic Media, and the host of the conference.  It’s a particularly relevant question now, because the past few years have seen a real explosion in public open data, including countless websites and apps that make use of it.  Built into Chris’ question is the assertion that perhaps we don’t fully know how best to make use of all of this data that’s becoming available to us.

My guess is that we are going see a big increase in the number of tools that make public data actionable.  Below is my initial take on how (you can also see the video and the slides from the conference).  This is admittedly not fully formed: I don’t claim to know how to “turn data into action” — rather, I just have a few ideas about some of the factors and how they’re shaping the “data into action” landscape.

Making data actionable

Making data actionable requires focused effort; data on its own isn’t enough.  So where does that effort come from and how does it help?   Each of the following groups can play a part, and I hope to see more initiatives involving collaboration among them:

• Government. Government can play a role, not only in producing data and making it available to the public, but also in accepting data in new ways.  Efforts like Open311 are attempting to create standards for read/write government APIs, and the idea of “government as a platform” is largely about considering and building out these data sets and APIs.  In most cases government alone cannot make data actionable, but they play a hugely important role in making it possible.  Side note: it’s worth mentioning that simply publishing a data set is not enough: in order to produce worthwhile action (and justify the expense of opening data), governments need to cultivate communities of users/developers around their data sets.
• Civic Hackers. In recent years, civic data mashup sites have provided new views into how cities and governments operate.  GovTrack is one of the most mature: a congressional data site that combines many datasets in order to provide insights into what’s happening in congress, it makes that data actionable by providing ways for people to stay apprised of updates (called “trackers”), and provides an API which many other sites have used. On more of a personal utility level, a new application called CabSense takes historical NYC taxi pickup and dropoff data, and uses it to provide recommendations on where best to catch a taxi.  For every corner of life, civically conscious and entrepreneurial endeavors are popping up to make data more actionable (GovTrack in fact runs a modest profit from ad revenue).
• Journalists. Journalists have always used research to provide consumer- or citizen-friendly insights.  In the age of mass data, the need for this hasn’t changed, though some of the methods have.  For instance: the Washington Post recently launched its “Daily Gripe” column, which uses incoming SeeClickFix issue reports as a basis for follow-up reporting.  The NY Times recently did an in-depth analysis of the same taxi data that powers CabSense.  As news organizations start using more real-time data, we can expect to see a big increase in interpretive data analysis.
• Nonprofits & interest groups. Like journalists, nonprofits and interest groups are particularly motivated to produce action out of data. Uncivil Servants, a 2007 project by OpenPlans, Greg Whalin (a dot-com startupper by day and civic hacker by night) and NYC’s bike/ped advocacy group Transportation Alternatives is an example of this working to great effect.  The website  crowdsourced illegal use of city-issued parking placards, and TA followed up on those reports with the city as part of their “Above the Law” [PDF] campaign.  The result was a major restructuring of parking placard policy in NYC.

Each of these groups — and I’m sure there are others I’m missing — can add layers of meaning and actionability to raw data sets, and is a critical part of the “data into action” ecosystem.

Combining the lessons from “data sites” and “action sites”

Above: screenshot from the Haiti Crisis Map

For the most part, we’ve seen innovation along these two separate, parallel tracks: sites that mash data up in creative ways (for example: Outside.in, Everyblock, BigAppleEd, and many of the sites I mentioned above), and sites that imagine new ways for people to interact and collaborate with one another (examples: The Extraordinaries, The Point, PledgeBank, GroundCrew, and on).  I believe that we’ll begin to see a convergence of automated “data sites” and social “action sites.” A frequent thread of criticism about data sites is that they can feel cold and lifeless; I expect that will change as the convergence happens.

That these are largely separate is of course not a hard and fast rule: tools are emerging that combine the two: most notably Ushahidi, InSTEDD and others’ response to the Haiti Earthquake in January.  And here in the US, SeeClickFix’s ”watch areas” are a clever way to make citizen issue reports actionable.  I know there are more examples like these (please link to the best ones in the comments).

The challenges in how to “do data” and how to get people to collaborate are substantial, and it’s understandable that they’ve been tackled mostly independently.  But I think the timing is such that more and more folks will begin drawing the lessons that each class of sites has demonstrated, and start tying the approaches together.

Bridging the civic divide

My last hypothesis is that we can “piggy back” higher-level civic engagement on top of more personally-oriented tasks.

I see perhaps the biggest opportunity for converting data into action in attaching “civic actions” to services that people use for personal reasons.  For instance: “where’s the bus?” has been a huge topic over the past two years — transit has been one of the hottest sectors of open government data, precisely because it serves a very important personal need: how to get around.  Rather than viewing this as an insignificant development, I prefer to view it as an opportunity to draw people in to more civically significant activities.

Washington DC is taking an interesting approach to this: at last month’s Online Engagement for Sustainable Urban Mobility event, DC CTO Bryan Sivak announced that they will be building out a network of QR codes on the DC Circulator bus system (another example of government building the “platform”, or laying the foundation for innovation).  These codes will allow for the expected location-specific interactions between bus riders and the bus system. But it’s only a short step to imagine piggy-backing on those interactions to introduce questions like “which of these changes to the bus system would be most helpful to you?”.

A more subtle example is WalkScore. I recently moved from NYC to Boston, and I used WalkScore to help decide where to live.  This data (how walkable are certain locations?) is immediately actionable (where do I choose to live?).  What’s especially clever is that WalkScore uses this helpful-on-a-personal-level data to stealthily introduce the civic action that they’re advocating (reducing car dependence and encouraging alternative transportation).

Like Maslow’s Hierarchy of Needs, people have a hierarchy of civic needs.  The basics need to be taken care of before “civic self actualization” is possible.  By building a foundation of engagements, beginning with the most personal and necessary, we can build a ladder to more significant civic actions.

What’s next

So, I think this is an interesting topic, and one that’s worth thinking about (and working on) in more detail.

I’ve been talking to Joe Edelman, CEO of Citizen Logistics (the makers of the awesome GroundCrew real-time organizing platform), and Chris Csikszentmihalyi from MIT about ideas for follow up.  The three of us would like to host an ongoing conversation on this topic, and invite others who are working in this space to join in.

To that end, we’re happy to announce the new Data into Action tumblog:

http://dataintoaction.org

We’ll be posting there as we traverse the interwebs; please also feel free to submit your own posts, or if you prefer tag sites on delicious with “dataintoaction.”  We’ve also established a Data Into Action google group, for open discussion:

http://groups.google.com/group/dataintoaction

That’s it; we will see you out there….

StreetFilms has produced a great video highlighting the case studies and benefits of open transit data and how that relates to the broader movement around Gov2.0. Along with websites like CityGoRound.org and the developer resources exemplified by transit agencies like Trimet, BART, MBTA, and the MTA this video does a great deal to show what can be done and what is being done to leverage more innovation and access to information around public transit. If you know of a transit agency or a developer that could use this kind of insight and inspiration, please pass it on. The video concludes by looking further into the whole transportation network by asking what else we could do with access to better data in regards to traffic, safety, and more.

The video features Chris Dempsey and Joshua Robin of the MBTA, MTA Chair Jay Walder, O’Reilly Media founder and gov2.0/web2.0 thought leader Tim O’Reilly, Zipcar co-founder Robin Chase, NYC Councilwoman Gale Brewer, Paul Steely White of Transportation Alternatives, as well as Nick Grossman and Nicholas Bergson-Shilcock of OpenPlans.

Please take a look and spread the word: http://www.streetfilms.org/a-case-for-open-data-in-transit/

Yesterday morning Nick Grossman and I attended a developers’ meeting at the NYC Department of Transportation to brainstorm some ideas to better enhance the open data movement at the agency.  The room was very well-balanced in terms of attendance between developers and DOT officials, and there were some interesting requests from the development/programming community.

Real-time data and the consolidation/aggregation of NYC transportation data were two general areas of importance to the DOT and development/academic community.  In the long run, the DOT hopes to provide real-time traffic information along with improving delivery truck routing around low bridges on their data feed portal.  They mentioned that like many New Yorkers, Mayor Michael Bloomberg would prefer knowing the traffic conditions ahead of time and not getting delayed for meetings and events in Midtown traffic.  Better real-time traffic data will be the foundation for building apps to help New Yorkers navigate congested streets.  Moreover, better transportation apps could help people make more informed transportation choices, thereby building a more sustainable city.

Thus, the DOT is seeking the talents in the developer community to help build solutions.

The DOT has made good progress in unlocking their data feeds.  They are now tapping into the developer community to discuss the objectives and  strategies for future projects with DOT data.  The data feed portal contains advisories, speed restrictions, alternate side parking and  real time camera feeds.  To the extent that it’s possible, the DOT has shown interest in working with other agencies, such as the TLC and the MTA to share data.

• synchronized police investigations alerts
• taxi locations
• traffic light timing
• real-time street closure updates, ranging from construction sites to cultural streetfairs (probably through the DOT currently-internal Citywide Event Coordination and Management database)

This is rather a short list, but it would more interesting what other application ideas developers and the DOT can come up with.  Perhaps, some sort Uservoice or Ideascale page to keep track of a “wishlist” of applications the DOT and developers want to develop with the available data (similar to the one in Portland for CivicApps, Edmonton’s AppsforEdmonton or NYC’s own BigApps).  At a recent Gov2.0 event, Sarah Kaufman, a Projects Coordinator at MTA NYC Transit, mentioned that a developers’ wishlist will be published based on the MTA’s datasets.

While there is no existing executive or legislative mandate by the Mayor or City Council to standardize data for all agencies (yet), the DOT is moving ahead to release more datasets in preparation for BigApps II set for Fall 2010, following a very successful BigApps I launch last year.  DOT has highlighted that some of its difficulties will be digging through older or unformatted data, but they are willing to work with developers on data delivery and data content to make NYC traffic more sustainable and user-friendly.

To continue the conversation from the meeting, the DOT has established a Google Group for developers, just like the thriving MTA Developers Group.  Feel free to chime in with ideas to improve the datasets (like Steven Romalewski’s excellent MTA dataset post) or request datasets for application development.  This is an integral step for the DOT to gain momentum going forward and increase their presence in the development community.

We applaud the DOT’s effort in leading this initiative and becoming a leader in open transportation data.  It is a welcome commitment to empowering smarter transportation choices in New York City.

Last month, we hosted a one-day workshop with Manhattan Borough President Scott Stringer’s office called Speak Up, New York.  The purpose of the event was to bring together NYC community groups and “civic hackers” to discuss how community groups are using technology to organize and engage.  With a keynote from Deputy US CTO for Open Government Beth Noveck, presentations from E-Democracy, Neighbors for Neighbors, Transportation Alternatives, and others, and representation from many NYC community boards as well as projects like Localocracy and SeeClickFix, it was a great opening discussion.

In the spirit of building community, our first step is to continue to bring together the people who are interested in these issues, to see what kinds of things we can do together, starting right now.  Long term, OpenPlans and the MBPO are also interested in  building a series of web tools to empower community organizing in NYC, but the more important step is to build connections among the community of people we intend to serve.

With that goal in mind, we are kicking off a series of monthly meetups, where we’ll work together to develop tools and resources to empower local community organizing in NYC.  The next meetup is this coming Monday, July 26th, 6:30-8:30pm, here at OpenPlans.  Projects for Monday’s meetup will include (please click through to vote or leave a comment on each idea):

• Mapping out the communication tools that community groups are using today
• Creating a “how to guide” for starting a community group
• Creating a Public Registry of Community Organizations

To join the group and to RSVP for next week’s meetup, check out the meetup group here:

http://meetup.com/SpeakUpNY

We are excited to move forward with this great group of people, and we hope you can join us!

// Photo from the June 11 Speak Up, NY workshop by Robin Smith

Pioneering an open data policy on the government level is not the easiest initiative without support, according to a recent study by the Open Society Institute. It takes various levels of negotiations among parties of the public, elected officials and “civic hackers”.  Furthermore, some government administrations are more risk adverse than others, unsure on how to proceed from being closed to being open in the most cost-effective manner.   Most seek to replicate best practices from successful initiatives and improve on others through news stories and conferences, but never some thing tangible; a resource guide, such as our own OpenMuni wiki (still in development), could be more purposeful in understanding the processes of unlocking accessible and quality data.

The report, commissioned by Open Society Institute’s Transparency and Accountability Initiative and written by Becky Hogge, provided insights on the UK and US processes to unlocking their data to their respective data.gov’s.   The report at the outset seeks to define the feasibility of open data initiatives from both sides to Atlantic on middle and developing countries (such as China and South Africa).  The World Bank and United Nations data are already available (and they also shifted to more openness), but data from the source (the nation and various cities) would be nice.  Building from the U.S. and UK models, can cities and developing nations pursue the same strategies to open government data?

The report concludes that the US and UK approached a three-tiered system to successfully implement their open data initiatives:

1. Motivation from civic hackers or good government groups
2. An efficient and engaged “middle government” workforce (agencies, departments of the government)
3. Top-level support and mandate to encourage this change

While this approach may work for most developed nations or nations close to an economic steady state (neoclassical theory), Hogge suggests, through interviews with international leaders pursuing similar goals, that developing nations will need funding and guidance from international aid donors to achieve the inspiration and successful implementation.  These contributions can help deploy the initiative by creating competitions and educating the next generations of policy wonks and developers.   Many cities (even in the U.S.) lack a developer-base and are holding competitions to entice outside developers to fill the gap and generate open data-driven web applications after the release of several highly demanded datasets.  The economic impact has convinced many cities to release their data, but even this can vary from government to government.  Not many studies have been done to show significant evidence on the ROI of open data.   I recommend reading Dan McQuillian’s observations on the open data movement so we don’t approach an “emperor’s new clothes” (c.f. p. 23 of Hogge) and actually offer the social change we really need.

Nonetheless, Hogge argues that important part of any open data movement is the resulting utility of the data rather than the amount of users downloading (p. 19).    As in economics, one should also seek to maximize the social benefits through utility.  Applications that promote the closure of the digital divide will usually have the greatest impact.  For example, Chicago was awarded for the sustainable adoption segment of the Broadband Technology Opportunities Program (BTOP) of the federal stimulus package in order to assimilate populations without a computer or internet connection.  As Gov 2.0 expands, Chicago’s Civic 2.0 will focus on civic and public uses of the Internet, and it will teach adults and parents how to access civic data for local community improvement purposes and the use digital media tools for community organizing purposes.  An open data movement here can provide new apps and also evaluate the quality of life improvement from data collected.

Hogge’s study is a good start to the growing movement.  Inspired cities can create open cities with some help—collaboration. These cities will have to evaluate available resources before crossing the river. Having a wiki or central list of best practices (OpenMuni and Government 2.0 Wiki, for example) will be an invaluable instrument for cities to explore the various models of open data and then develop their own unique initiatives through civic engagement and collaboration.  The resulting trajectory builds a strong data eco-system towards greater social and economic gains.

You can read Becky Hogge’s Open Data Study in full at http://www.soros.org/initiatives/information/focus/communication/articles_publications/publications/open-data-study-20100519.

Sam Wong is a summer intern at OpenPlans, researching best practices in government open source and open data as part of our OpenMuni.org initiative. Sam previously served as Legislative Aide on Technology in Government for the New York City Council.

Localocracy has a nice way of expanding into new communities.  They avoid the “tumbleweeds” problem by building support for the initiative before it starts, in a kickstarter-ish sort of way.  This is, of course, not a new idea, but I think Localocracy does a nice job of executing on it.  E-Democracy has long used a similar system for building interest before groups launch.  It’s also reminiscent of the genius way that Threadless builds demand for t-shirts before deciding to print them.  I like the way that Localocracy uses the approach to both build excitement and guarantee some level of engagement once the sites go live.

Last night at an event here at OpenPlans, I spent a few minutes talking to Boštjan “Bos” Špetic, the founder of a web startup called Zemanta (a tool for finding related content to blog posts — for writers as well as readers).  Most of Bos’ team is based in Slovenia, where he is from.

We got to talking about OpenPlans’ work and the issue of Open Government in general. As it happens, Bos is on an advisory committee to the Slovenian government on Open Government, and will have an opportunity, come fall, to deliver recommendations on where they should direct their efforts.  He is looking for information on where to start, as it’s pretty much a blank slate for them right now.

First off, I don’t know anything about Slovenia’s government, policies, or infrastructure.  All I can do is point to some resources that are beginning to be developed here in the US, after a few years of real traction towards open government:

Coming from the top is the White House’s Open Government Initiative .  I can testify to the impact that this high-level mandate has had throughout the country; we see language from it in new initiatives, RFPs, etc every day.  Next, there are a number of books, notably O’Reilly’s recent Open Government, Beth Noveck’s excellent Wiki Government (which focuses on collaborative governance) and Personal Democracy Forum’s Rebooting America. And of course, there are a number of evolving online resources, including the Open Government Playbook, which acts as an index to lots of open government documentation, and the (very rough) Open Government Guidebook that’s being developed as part of our OpenMuni effort, and aims to become a step-by-step how to for some processes.

One of my favorite open government resources, that’s now admittedly a bit out of date, is the Public Transit Openness Index, a screenshot of which is at the top of this post.  What it does nicely is breaks the concept of “open” down into concrete, measurable steps, which can be compared across agencies.  It would be great to see something like this for open government more broadly, across functions and jurisdictions.

The White House’s Open Government Directive offers a start, and they’ve begun to track agencies’ progress, but what I’d love to see is an organic document that breaks open government down into pieces, and links it up to efforts that are underway or have already taken place.  Maybe this already exists?  The Playbook and Guidebook, above, are both moving in this direction, but I’ve yet to see a more granular and hyperlinked checklist like the Transit Openness Index. Checklists are great, and social checklists are even better.  Perhaps this is a project for WikiHow (which doesn’t yet have a government section), or maybe it’s something new.

Regardless, it’s clear that there’s still work to be done in packaging the learnings of open government, for ourselves and for folks around the world who are looking for models to follow.

Update: I neglected to mention Phil Ashlock’s excellent recent post covering the State of Open Government which covers this question in much more detail than I did here.

Tomorrow morning, NYC DOT is inviting developers to come and discuss what transportation data sets they’d like to see opened up.  From their invitation:

The New York City Department of Transportation needs your help! We want to provide more and more useful information to the traveling public about traffic and transportation. We know we’ve got a lot of the raw data, we need you to help us separate the wheat from the chaff.

Here at the DOT we’re plugged into all of the comings and goings of the city – we’re constantly monitoring highways, ferries, traffic cameras, bridges and road work. This means that we create a ton of data, some of which we share publically on our data feeds page. However, most of our data isn’t currently public.

There are many reasons why you (outside of the walls of government bureaucracy) will be able to build better apps, at ten times the speed and efficiency than we will ever be able to. We see our role as opening up and cleaning up our data to make it easier for you. Together we can provide the public with the information they hunger for, to make better decisions about how to move around the City.

To get started on this, we need your help to identify where the hot spots of demand are, so we can prioritize where direct our efforts to format and open up data. We also need you to help us start assessing where the gaps are between the data we have and the data we’d need to create truly useful “real-time traffic” apps. We’re at the beginning of this process, and the first step is to have an informal brainstorming meetup with developers. We’ll talk about some of the data feeds that we have, and hopefully you’ll come with some questions we haven’t asked yet.

The meeting is full and RSVPs are closed, but it’s not too late to get ideas in.  At the meeting tomorrow, I’ll also be encouraging DOT to host some sort of idea sourcing tool online.

Leave any ideas in the comments section here, or on today’s post on Streetsblog (where there are already a few comments coming in).

If you’re interested in the OpenBlock “hyper-local news” project, we want your help!

Our first goal is to make the OpenBlock software easier to install and use for newspapers in the 25k-100k circulation range.  If you or somebody you know works at such a paper, please take a look at this short survey. The results will help us plan our work in the first few months of the project.

Thanks!

The MTA recently released a new dataset with exact latitude and longitude coordinates of station entrances and exits. This was a highly requested dataset for many transit developers and showcases the lastest development in the MTA’s transition from a data licensing model toward community collaboration in pursuit of more innovative applications. This shift has not only inspired programmers to develop much-needed applications that help citizens navigate the subway system, but is also a great example of confidence in the community’s ability to provide low cost innovations while many public transit agencies are facing fiscal challenges.

Last year, the MTA was exploring an exclusive data sharing contract with Google in order to better manage the usage and distribution of MTA transit data. At the same time, the delivery of transit data to private developers (often smaller and more local to NYC) was viewed as cumbersome because the data was only provided in CD-ROM format. This made it challenging to retrieve and keep the data updated in an efficient way. Seeing that other cities were finding some cost-savings by making data public, the MTA began to accommodate an emerging open data movement and leverage the expertise of the developer community.

Under the new MTA leadership of Chairman Jay Walder, the MTA has unveiled more than 50 datasets and held a developer  unconference. This event included software developers, good government advocates, and policymakers in order to facilitate an open exchange between the MTA and the developer community. At the unconference, Walder spoke of how access to information and technology will usher in a new era of mass transit for New Yorkers. Analogous to the “See Something, Say Something” announcements, Walder sought help from developers and promised to work with the community to release more data.

In the week before June 28 when new service modifications were implemented, the MTA released updated timetables and other schedule-related materials to developers to ensure applications would run smoothly through the change, and on July 2nd the oft-requested (and contentious) latitude and longitude coordinates for all individual subway station entrances and exits was released.

Here’s a look at what it contains:

• Longitude (to the sixth decimal place)
• Latitude (to the sixth decimal place)
• Division (BMT, IND, IRT)
• Line (by branches)
• Station name
• Entrance Type (Stair, Easement, Elevator)
• Route (letters and numbers)
• ADA (Yes/No)
• Low Turnstiles
• Hi Turnstiles
• Cross Sections relative to the Street Level (N/S, E/W)

The release of this data had apparently been contested for some time because of perceived security risks. The MTA has declined comment, but it is believed that the NYPD had seen the potential for malicious use of the data. What had confused many about this position was that the data was already displayed in many forms such as on NYCityMap, but was simply not available in raw digital form. Undercover emergency exits and tunnel evacuation locations remain withheld for safety reasons, but the main entrances and exits to the street level and closest ADA drop-off points are now available for developers to integrate into their applications and help riders better navigate the 660 miles of subway lines.

The benefits outweigh the overall concerns about this data. After all, that’s the purpose of the open data movement—releasing data that will enhance citizen use of public services but not put the public at risk. Previously, transit applications and mapping systems like Google Maps could only display the centerpoint of a station and direct riders to the general vicinity, but now applications can provide directions based on the specific entrances and exits of stations. With this additional dataset, we can plan our trips more accurately and even save the frustration of getting off the wrong car or at the wrong exit. Occasionally, this would also be helpful in getting to transfer points faster, especially buses. Such a dataset can also bring public input to topics such as improving station exits or re-evaluations of traffic flow (possibly combined with the turnstile data). Applications such as Exit Strategy and WayFinder have already exceeded expectations but could now do even more by providing true door to door directions. Ultimately, the best use of this data is likely to be an unexpected one, something that combines this information with the growing ecosystem of new data and applications.

At a recent Gov2.0 event Sarah Kaufman, a Projects Coordinator for MTA New York City Transit noted that the MTA will soon release a “wish list” of applications they hope the developer community to build with all the data they have released. Sarah provided a glimpse at this wishlist by emphasizing the need for better visualizations.

MTA data, such as exits and entrances, holds vast potential for new and creative mobile-based transit solutions. We look forward to the ongoing improvement of New York’s transit experience through collaboration with developers, commuters and the MTA.

Sam Wong is a summer intern at OpenPlans, researching best practices in government open source and open data as part of our OpenMuni.org initiative. Sam previously served as Legislative Aide on Technology in Government for the New York City Council.