Predictive Analytics and Cities

It's been a big year for predictive analytics.   I've been following Nate Silver's blog on the election, and his deep data analysis cut through the noise, was consistent, and ultimately proved correct.   And to look at another (eerily prescient) example, look at this 2006 prediction of what a major coastal storm could do to the East Coast. We have lots and lots of data about what has happened, and we're just starting to figure out how to use it. Tomorrow, I'm attending a conference on Innovation and Cities at Harvard's Kennedy School, and I'll be speaking on a panel on predictive analytics and cities.  I'll be joined by New York City's Director of Analytics, Michael Flowers and Chicago's (first ever) Chief Data Officer, Brett Goldstein.  Both Brett and Michael are way deeper on this subject than I am, so my hope is to simply ask some provocative questions, and perhaps give some examples from outside the civic sector. A few weeks ago at the Ford Foundation's Wired for Change conference, MIT's Cesar Hidalgo gave a thought provoking talk on the power of big data and predictive analytics.  A big takeaway from his talk was that by looking at how data is connected -- i.e., focusing on a few of data as a network, rather than as sums of numbers -- we can quickly and compellingly start to see new trends, tell new stories, and predict future outcomes. Cesar presented some research that looked at national exports in terms of connections between products and industries.  By creating such a "map" of the ecosystem, using historical data, it actually becomes relatively easy to guess which sectors will continue to grow and how.  For example, here is a look at South Korea's export economy over time: This simple, but profound, change in approach holds tons of potential for us to understand what's going on in our cities and countries, and better prepare (for economic changes, natural disasters, etc.).  You can play with more visualizations of world economic data at MIT's Observatory of Economic Complexity. So, looking ahead to tomorrow's conversation: the specific topic of conversation is:

Predictive analytics cut across issues and datasets. When it comes to potential new forms of analytics, what are the low-hanging fruit? What are ambitious, longer-term ideas of new ways to use predictive analytics to tackle urban issues? What could/should cities do together?

I have some ideas -- for instance, generally taking an open data and open standards approach at the foundational level (to widen the audience of potential data miners).  Looking for data sets that tell us a lot about how the city works, but might not be the first ones we think of (such as taxi drop off locations, long-distance call originations, tweets, supermarket and other consumer spending data, etc.).  I'll keep noodling on it today and tonight. What do you think?

Community, and Why Halloween is the Best Holiday

I love halloween. I think it's my favorite holiday.

The thing that I like about it the most is that it's one of the only days of the year where you have a reason to go out and meet all of your neighbors.  I spent a while last night walking around the neighborhood with Theo and Brieza, having conversations with my nearest neighbors, most of whom I hadn't spoken to before (we've lived in our current place for just over a year).  It was really nice.

If you think about it, it's kind of astonishing the extent to which we typically don't know our neighbors.  I can't speak for everyone, everywhere, but it seems like a reasonably safe bet that most of us don't know the vast majority of people who live within a one-block radius of us.

Why is that?

To some extent, it's probably a deeply rooted sense of fear and privacy.

But I suspect it's also a practical matter -- there just aren't convenient, socially fluid (i.e., non-awkward) ways to connect with your neighbors.  That's part of why Halloween is so great.  It's a fun, easy, light-touch excuse to walk around and say hi to everyone.  No big commitment, no awkward over-staying the moment.  In the best case, just enough connection to reasonably say hi to someone next time you see them on the street.  For sure this is not a whole lot, but it's a whole lot more than normal.

Another factor here -- and another reason why this is hard -- is that you actually need to be really careful making these connections.  By and large, these are people you are stuck with for some period of time, so you want to tread carefully and make sure you don't create a situation that's weird, or too intense, etc.

So it's not surprising that no one has cracked the "social network for neighborhoods" problem.  It's hard on a number of levels - the sensitivities mentioned above, the widely varying levels of comfortability with technology, etc.  But if you look at the success of platforms like Facebook (networking for colleges) and Yammer (networking for businesses), there is a proven path of starting with an existing community and building a platform from there.  So I still think there's an opportunity here (that folks like CommonPlace, LifeAt, Front Porch Forum and to some extent SeeClickFix and Neighborland are looking at).

Maybe the way to think about this is bringing Halloween to every day? That's clearly wrong, but maybe there's something right in it.

Striking the Right Balance

It's hard to find the right balance when bringing technology into our lives.  I do think lots of us suffer from some form of internet / social media addiction, and it's getting easier and easier every day to bring all of that with us everywhere we go. This will only continue to accelerate (and I don't even have Google Glass yet).

A few weeks ago, I went to a discussion at the New York Public Library for Steven Johnson's new book -- for the event, Steven's "debate" opponent was Sherry Turkle, author of "Alone Together: Why We Expect More From Technology and Less From Each Other". The thesis of Sherry's book is essentially that we are all addicted to our phones, and that we're trading away our real-world connections for distant digital connections.  She has spent countless hours interviewing teenagers, observing moms and dads in the playground (with their faces stuffed into their iphones, of course), etc.  And basically came away with some troubling, if unsurprising, results.

I am not terrified by all this, but I do think we're at a moment now where we are still forming our cultural norms around all of this, and it will take a while.

For instance, Frannie and I have a rule of no screens in bed (that includes TV) -- it just seems like the bedroom should be a place to unplug, slow down, and relax.  But over the past few days while she's been away, I've been breaking the rule.  On Sunday night, I blew through my email backlog on my laptop (woo!), and on Monday night I followed #Sandy via Twitter on my phone.

Of course, this sparked an argument discussion last night when I continued to break our rule by bringing my laptop to bed to write "one last email".  To make matters worse (better?) I posted a snap poll to twitter to see what people thought about this particular nuance of digital culture. The results were mixed:

Some great gems in there.

I do think that thinking about this in terms of addiction seems about right -- we have this thing with really powerful social pulls drawing us in, and we need to make sure we understand how to live in moderation. I might even argue that the addictive strength of the internet and social media is stronger than that of alcohol or other drugs; at least the social aspect of that addiction. i.e., I may feel some social pressure to drink more than I should, but it's not coming at me 24x7 from hundreds of friends, thousands of acquaintances, and millions of others.

So, this is something we'll have to keep figuring out.

The Slow Hunch by Nick Grossman

Written by

Investing @ USV. Student of cities and the internet.

Subscribe