What is the firehose feed? It’s what businesses like Seesmic, Tweetdeck, Peoplebrowsr, and FriendFeed get from Twitter: it is the full stream of Tweets (more than 10gigs a day). The problem is that to deal with it you need to be expert at dealing with large, changing databases, and if your business gets popular you must be able to build scalable databases that can serve out millions of queries per day. That’s beyond most developer’s skill sets, but that shows there’s opportunity for new kinds of businesses to build on top of Twitter. Which is why I wrote this note. (Scoble)
10 gigs of tweets per day? That is data-mining gold; who’s going to be the first to sell the pick axe?
