Improving on TrafficTweet

The first response to DIYcity Challenge #1 was TrafficTweet, a Twitter bot that allows people in NYC to tweet updates to each other about traffic conditions. See DIYcity post about it here: http://diycity.org/challenge-response/first-response-diycity-challenge-1...

Good idea - what are some ways this could be made more useful to people?

What would keep you from using it?

01 Dec00:40

Cool idea but...

By Anonymous

... the last thing we need is more drivers texting on their cell phones. The traffic had better be at a dead stop first!

03 Dec02:16

ideas

By mariae mancipium

It seems like this thing just broadcasts whatever people send it, right? (I'm scared to try because I don't live in NYC so I couldn't give any real info).

Is there a way that you could make it so that if I send you a certain message, it sends back all the traffic tweets from about the last hour or so? That way I'm not getting tweets about traffic all day long, but when I'm ready to go somewhere, I can see what has been happening recently.

Also, could it be divided into more specific regions or even filtered so that only the highway data or only the street data gets transmitted?

I'm not a programmer, so these are just conceptual suggestions. I have no idea how hard any of this would be to execute.

peace.

03 Dec14:38

Hey, Mariae - It seems like

By whitneymcn

Hey, Mariae -

It seems like this thing just broadcasts whatever people send it, right? (I'm scared to try because I don't live in NYC so I couldn't give any real info).

Exactly right -- the way that this currently works it's just a simple repost, so it just takes whatever people input via Twitter and outputs it to its own timeline.

Is there a way that you could make it so that if I send you a certain message, it sends back all the traffic tweets from about the last hour or so? That way I'm not getting tweets about traffic all day long, but when I'm ready to go somewhere, I can see what has been happening recently.

I think that you're looking in the right direction. Even just within NYC, you're only interested in traffic information for certain areas at certain times, so each user really wants a personal filter in the way that you describe.

It could definitely be done. For one simple approach off the top of my head, you could take advantage of Twitter's direct message functionality: when you want traffic updates you send a message to the bot like...
@traffictweet recent
...and then the bot sends you all the updates as direct messages, so that only you are seeing them.

It gets more interesting if you add additional functionality, but I think this could be a great start (though it'd need more data coming in to be really useful).

I wrote the original code for this, so I'll see if I can make some time to rough out a version like this. If anybody else is interested in working on it feel free to let me know--I'm happy to share whatever background knowledge I can.

03 Dec18:30

Re: Hey, Mariae - It seems like

By mariae mancipium

I would love to get something like this working in my hometown of Columbus.  Would you mind sharing the source code of your bot with us so that we can adapt this to other places?Like I said I have almost no abilities in programming, but I love a good challenge, and i think this might be a good hands on way to learn something.  Or, if it's totally over my head, maybe there's still someone out there who can help.
peace.

03 Dec18:59

Source Code for Twitter Repost Bot

By whitneymcn

Absolutely happy to share!

You can grab the source code and read through the setup information here: http://bit.ly/DwAu

It's a pretty simple script--you need to have some basic technical skills to get it running, but by no means do you need to be a wizard. :)

04 Dec18:12

GPS tracking & Lasers

By Anonymous

Couple questions about this and an idea.

1. doesn't google already give you traffic conditions on you gMaps? we do in SF.

2. instead of tweeting traffic conditions, why not just have an app that transmits your Lat/Long every 30 seconds or so and thereby shows speed over time on any given street.

3. another idea: have people who live on busy streets put a laser out the window pointed out the street that would measure the speed of cars passing on a certain section of the street (the distance from transmit point to street being a known distance). This way being the best way, b/c lasers are always fun to say.

-ben

04 Dec22:00

Re: GPS tracking & Lasers

By John Geraci

1. doesn't google already give you traffic conditions on you gMaps? we do in SF.

good point - is there an API for that data, and is the data fresh?  if so, that would be easier to get and more reliable than data that was input by users.  though if not, it doesn't do much good in the moment when you're trying to make decisions.

Looking into the API question, I see this post: http://googlemapsapi.blogspot.com/2007/06/add-traffic-to-your-mashup-button.html  that talks about a map overlay call for traffic info, but I don't get the sense that could be abstracted to tell you what routes were less busy than others.

instead of tweeting traffic conditions, why not just have an app that transmits your Lat/Long every 30 seconds or so and thereby shows speed over time on any given street.

See Seth Godin's Challenge.

I think the general takeaway from your comment is that if up-to-the-minute traffic data can be obtained in any sort of automatic, programmatic way, that would be easier and more reliable than asking users to input the data themselves.  I think that's right, I just don't know if it can at this point.  Data input from users might still be the easiest place to get started right now.

04 Dec22:00

Some further ideas, if we

By Anonymous

Some further ideas, if we are intent on using twitter:
* signup would be on a web page, where users would enter their twitter ID and check off from a list of neigborhoods/roads/bridges and tunnels that they want to know about, and a time range in 30 min increments for when they want to receive these.
* this would generate a series of tables in the backend of the site that list, for example, every user who wants to receive info about the bronx queens expressway between 5pm-5:30pm.
* when the bot receives a direct message with a #BQE hash tag at 5:08pm, it checks the BQE5_530 table and then forwards that message to everyone on the list by individual direct message.
- OR -
* the time ranges can be eliminated and it can be kept as a request-only service as described above, but with the direct messages filtered by the user's road/neighborhood list - although I imagine this would be more difficult to implement than the automatic push because of the need to filter by each user's profile.

* another thing that would have to be considered is how to enable user's to update their road/location selections.

What do y'all think?

05 Dec05:59

watch out it's long

By mariae mancipium

While the whole signing up on a webpage idea is not bad, it limits some flexibility on the user's end (what if i want traffic info outside my usual commuting times?) and it also seems overly complicated. Maybe one day the resources will exist at DIYcity to build a traffic bot this comprehensive, but i think we need to start simple.

As for using the Google traffic API (if that's even a possibility), i don't think that it's a bad idea, but i do think it takes away from the DIY nature of the project. Part of what really attracts me to the DIYcity project is not the end functionality (because if i want a traffic report that bad, i can turn on my radio and find one in 3-4 languages) but rather the sense of community interaction that is enabled by technology.

By building a twitter bot which gathers its data from anyone and everyone, we are using technology an open source ideals to reconnect people who have been sitting alone in their Lexus monads listening to Sunny 95 for the traffic report. Suburban sprawl and TV and a million other things have slowly eaten away at the sense of community in our cities, and even though a Google API might be more expedient, it wasn't hand-made by the people of my community and so it just doesn't have the heart i'm looking for in a traffic report, dammit.

< /ideological rant > (for now)

05 Dec13:24

Re: watch out it's long

By John Geraci

Mariae, those are good points, and well said.

At the same time, I can't argue with the efficiency of automated data, if it is up-to-the-minute and freely available.

I think this is where it makes sense to think about different groups of developers building different versions of an idea.

At this stage there is not necessarily any one version of an idea that is absolutely better than all the rest. Maybe the thing to do is to lay out the possibilities here in the Discussion threads, and then let individuals build apps with those possibilities as they see fit. Get a couple different apps going that people can use and learn from.

I'd personally love to see a user input app, like the kind whitneymcn describes here, as well as some TrafficTweet apps that built on preexisting data.

05 Dec15:00

Re: watch out it's long

By peterbilton

Great thoughts on the homegrown, community aspect of the potential project.  I was trying to sketch out a future case with functionality that could be built in a few weeks or months depending on who's interested in working on it. Alas, I'm no developer/programmer. 
I think using twitter for community traffic updates is convenient but ultimately limits it to a demonstration project because so few people are twitter users (relatively speaking).  I'm not saying we shouldn't go ahead, just something to think about.
So continuing with the twitter bot idea, we should at least consider expanding it to a few bots for different geographic areas/corridors. I'll bet any reports done for the congestion pricing plan would have good analysis on commutersheds.

06 Dec18:57

Building on all of these TrafficTweet ideas

By John Geraci

Okay, I wanted to pull together some ideas from various threads and propose a sort of fusion of them.

First of all, there are some people saying that a system that requires people to send tweets while in traffic is unsafe. I think there's some merit to that.

Then, someone else pointed out that traffic.com has excellent, up-to-date RSS feeds of traffic conditions for many U.S. cities. And indeed it does.

And it would be very easy to build a system like Whitneymcn suggests, where users could ping a Twitter bot to get the lastest updates on traffic, with that data coming from the Traffic.com RSS feed.

So that would be very cool.

But you have to wonder how up to date those feeds really are. Traffic can swing on a dime, and the stuff you really want to know about is the unpredictable stuff that just happened 3 minutes ago - the crash on the FDR that suddenly backed up traffic for 30 blocks, etc.

Would an RSS feed from traffic.com be able to provide you with that? I doubt it.

So that's where user input comes in. In those situations, the sudden change in traffic conditions is reported on by users themselves and sent out to listeners.

So what you have is a system where traffic.com or some such RSS feed is laying the base of data for the system, providing the 98% that people are relying on, but the users themselves are providing the 2% that is the most volatile information, the stuff that an RSS feed wouldn't be good at covering.

A hybrid RSS feed / user input system, delivered to you when you ping the bot. That seems like it could actually be a pretty reliable system.

What do people think about that?

08 Dec21:12

traffictweet

By Anonymous

What would keep me from using it? The fact that, being a New Yorker, I don't drive. What we need is a twitter feed or bot or whatever for the MTA - now that I would use. Crowd-source those sick passengers, signal problems, police investigations, etc. With a little pattern matching, you could have custom feeds for the various lines.

Also, your captcha needs a list of stop-words. It invited me to enter an epithet.

08 Dec21:21

MTA Twitter account already exists

By whitneymcn

The unofficial Twitter bot is already exists, and it captures everything that the MTA puts out via their official channels: http://twitter.com/nyc_mta

The MTA also recently released its own email/SMS notification service; I don't have a link handy, but you shouldn't have too hard a time finding the info.

- Whit

24 Jan22:16

Predicting traffic

By salimv

Seems there are three areas here:
1. Gathering traffic information
2. Analysing it and extrapolating
3. Distributing it in a relevant way to users

I'd suggest focusing on distributing the data rather than gathering or analyzing it. The former holds a lot of untapped potential, and the latter have already been done well enough to avoid competing with (for now.)

Dan Greenblatt's, Mariae Mancipium's and whitneymcn's suggestions are good because they focus on where we can immediately benefit the most.

There is an accurate traffic flow model by Dirk Helbing and others, and I imagine Google and other traffic tools already use this to make predictions and also to estimate problems in other places. For example, if traffic is slowing down and becoming more dense at point A on a highway, it is likely there is a more substantial slowdown, or even a jam, forming 1 or 2km ahead. With exact data, these can be predicted with enough accuracy for users to plan the right route. (AFAIK these models can work in real-time.)

This may present an opportunity, as combined with crowdsourcing, it would create an open platform for other open services, per Adam Greenfield's vision. Applying the Helbing model to data from users who are constantly updating from GPS could yield some very accurate extrapolations. Though, there is one thing missing: predictive models for traffic require vehicle speed AND traffic density. It's a bigger project, but if we could pick up traffic density data and apply it to a predictive model, we'd have a free, open traffic system.

If we can't do that, distribution is shining strength of this project, so I'd stick to distributing existing traffic data in better ways.

25 Jan00:06

Re: predicting traffic

By John Geraci

>>I'd suggest focusing on distributing the data rather than
>>gathering or analyzing it.

Yep, I think that's a good idea. And that's exactly what the first DIYcity project is aiming to do.

There's plenty of good data out there already on current traffic conditions, it's just very difficult for people to get it in situ, in a way that can make a difference both to personal commute decisions and then by extension to larger and more general traffic patterns.

The issue of gathering traffic information has been raised before on the site. It's an interesting issue to think about and one we should come back to, but I think partitioning the two ideas is best for now to keep any projects from becoming unweildy.