Swine flu intelligence: Twitter v. Google
Monday, April 27, 2009 at 10:07PM The media coverage of the Swine flu and its elevation to Phase 4 status by the WHO has caused a lot of discussion across print, TV and web chatrooms. It also renews interest in predictive tools such as Google's Flu trends project. The fascinating thing about Google's flu prediction system is its apparent accuracy and ability to predict flu activity one to two weeks ahead of CDC reports. This ability is clearly critical with potential pandemics.
It seemed inevitable that services mining keywords associated with Twitter status messages would eventually emerge around the health space. Two services, FluTweet and Sickcity.org, have developed real-time tracking services to show flu activity based on Twitter messages. FluTweet updates its data every hour and tracks messages globally. Sickcity.org is attempting to track data on the local, city level. The goals of both are admirable but a quick review of Twitter messages on Swine flu and flu in general reveals how daunting the task can be. The conversational nature of the messages on Twitter means there is a lot more static to muddle through. Here are a couple of results when I search on flu:
trish_thedish: Sanjay Gupta says don't worry about swine flu, but when an obnoxious, dirty little 5 y/o projectile coughs in line at Target, I worry.
ROCKINTHAT: Swine flu, Remember what your Mother taught you. Cover your cough, Wash your hands, and if you have a fever stay at home!!!!!
How do you build that filter into an algorithm (ie, if you are tracking mentions of coughs and flu)? With 19 million users, Twitter now has thousands (perhaps millions) of conversations going on at the same time about Swine flu. The key to the success of these services is lots of historical data and the ability to continuously refine the data model.
The issue is what happens next -- Does awareness itself have a public health value? A study published in Proceedings of the National Academy of Sciences in the United States of America (PNAS) found that awareness does have a positive effect on containing a pandemic. The study was based on data on the spread of the SARS epidemic in China culled from millions of text messages sent to and from residents of Guangzhou where the epidemic originated. According to PNAS, "The authors linked a mathematical model for the spread of disease awareness to one for the spread of disease, and found that increased disease awareness resulted in a smaller outbreak within a population." A similar study is probably impossible to conduct here in the US due to privacy concerns, so the best analog we have is publicly-available Twitter and Facebook messages.
The CDC has set up several Twitter accounts, including @CDCemergency which provides accurate information. Twitter has been criticized during the last few days as a source of misinformation but it is also bringing good information to those looking for it. If the results of the PNAS study can be extended to the U.S., increased awareness (stay home, wash your hands, etc.) and most importantly, understanding when to go to an emergency room or a doctor, is a net positive.


Reader Comments (5)
Dear Camille
You're absolutely right, the huge number of discussions about swine flu really messed up the algorithm (or "algorithm"; being just a simple experiment, it only shows the relative share of flu-related messages at the moment, not a prediction or something more sophisticated.)
But what is interesting, was the amazingly sudden peak in FluTweet -- it occurred within one hour when the first news on swine flu started to spread out. The peak seemed rather alarming, even though it was not a sign of that many people had caught a "real" influenza.
About a week ago, behind the scenes, we did some modelling on Excel based on the gathered data, trying to fit a model between FluTweet and CDC. The curve started to point upwards for no apparent reason and we thought that damn, what a disappointment, there is something really wrong with the data... But actually it seems that it was the swine flu raising its ugly head. :)
All in all, FluTweet is still very experimental and should not be taken as an accurate prediction -- it's more like a demonstration of the power of Twitter and the information hidden in the discussions.
Camille,
Great post and I agree you have to take Twitter with a healthy dose of skepticism. Not knowing FluTweet.com already existed, I built FluTweets.com both as an information resource and to showcase the "tweet frenzy" associated with this outbreak.
I experimented with my own Twitter stream for Swine Flu, only in my case, I directed a set of Google Alerts to a Twitter account: @swineflualerts. I also watched the full Twitter stream for the term "swine flu" in Tweetdeck. What I found in the full Twitter stream was a lot of honest concern mixed with offensive and racist "jokes" about bacon, pigs, BBQ, Jews and Muslims. The Google Alerts stream was much lower in volume, but higher in quality. I wrote up a complete analysis of these two methods of following a breaking news event on my blog:
Difference between Google Alerts and Twitter Search: No lame jokes about bacon
Google is also involved in a global disease alert map - HealthMap. It's been mentioned here and there during that past month's events.
visit the HealthMap
tiffany and co
Tiffany Jewelry
Tiffany jewellery
tiffany&Co
Tiffany
Buy Tiffany
tiffany necklaces
tiffany bracelets
tiffany earrings
Tiffany rings
tiffany cufflinks sale
Tiffany Atlas ring
Tiffany Elsa Peretti
Tiffany Frank Gehry
Return To Tiffany
Tiffany & Co bangle
Tiffany Notes
tiffany bangles
Silver bangles
bangles