Wall Street Traders Mine Tweets to Gain a Trading Edge

From this USA Today article comes the story of a Johan Bollen, a professor at Indiana University who has authored a book on extracting sentiment information from Twitter.

Bollen analyzed the text of daily Twitter feeds (9.6 million in total) over a nine-month period in 2008 with two mood-tracking tools. One simply measures whether the daily tweets were positive or negative. The other tool sought to measure human mood states by categorizing tweets under six terms equated with different mood types: calm, alert, sure, vital, kind and happy.

He claims that using this technique allowed him to anticipate Dow stock prices 3-4 days later with 87% accurracy. I havent looked at the study in detail, so I don’t know if he’s measuring the overall movement of the DOW, or specific issues.

Mining Twitter sentiment seems to be all the rage. Streambase recently announced a feed based on Twitter sentiment, and Thompson Reuters’ Open Calais has offered similar features for a while now.

What’s news here is not that these techniques are being applied.. I wrote about a similar mashup last June. No; the thing I think is interesting is that you are now seeing this approach become mainstream.

I’m certainly not the first person to advodate this approach, but I gave clear examples in Mashup Patterns (back in 2009) of using this technique to get “Advance Knowledge of an Industry’s Performance” and to “Spot the Underlying Causes of Trends in the Housing Market”. Besides market performance, I wrote about how firms could use these techniques to uncover issues that might threaten the reputation of their brand (or of a competitor’s).

Between Innovation and Commoditization lies a Competitive Gap

Like most innovations, there is an “S” curve that takes you from humble beginnings to ubiquity. The gap in-between these points is where you can create a competitive advantage. I think this latest news demonstrates that Leading Indicator mashups are nearing the right side of this chart.

Firms are perpetually caught in a struggle between experimenting with new products and tools that can give them an edge in their market, and playing catch-up with companies that have proven-out new ideas and deployed them more quickly.

What’s interesting about Mashups is that while some applications of the technology are clearly moving to the commodity stage, many others are not. And “Enterprise Mashups” as a discipline unto itself is definitely still down to the right of the chart.

“Managing Innovation” may seem like an oxymoron, but firms should recognize this maturation curve and try to move items along it more quickly. This helps maximize the time they can enjoy the competitive advantages the new technology yields.

For the “Leading Indicator” pattern, I think that window is closing quickly (if it’s not already closed). But there are still large problem spaces where mashups can offer new and valuable solutions that will help you leap ahead.

One Response to “Wall Street Traders Mine Tweets to Gain a Trading Edge”

  • NEW YORK &151; Tweet this: To gain a trading edge, Wall Street traders are now using clever computer programs to monitor and decode the words, opinions, rants and even keyboard-generated smiley ces posted on social-media sites like Twitter.com.

Leave a Reply

  • SpreadSheetSpace
    SpreadSheetSpace uses REST API to allow the user to link Excel sheets online. This app allows transformation of Microsoft Excel into a live data analysis tool through linking it to corporate data in a secure and controlled way. Due to the PKI encryption, which allows full privacy and selective sharing of Excel cells, the API is served over HTTPS , therefore […]
  • Diffbot Analyze
    Diffbot provides developers tools that can identify, analyze, and extract the main content and sections from any web page. The Diffbot Analyze API can analyze a web page visually, and take a URL and identify what type of page it is. Diffbot’s Analyze API can then decide which Diffbot extraction API (article, discussion, image, or product) may be appropriate, […]
  • Diffbot Discussion
    Diffbot provides developers tools that can identify, analyze, and extract the main content and sections from any web page. The Diffbot Discussion API extracts discussions and posting information from web pages. It can return information about all identified objects on a submitted page and the Discussion API returns all post data in a single object. The Diffb […]
  • Diffbot Image
    Diffbot provides developers tools that can identify, analyze, and extract the main content and sections from any web page. The purpose of Diffbot’s Image API is to extract the main images from web pages. The Image API can analyze a web page and return full details on the extracted images. Date Updated: 2014-10-20 Tags: [field_primary_category], [field_second […]
  • Crowdfunder
    Crowdfunder is a UK based platform where people can crowdsource funding for unique projects. Crowdfunder projects typically involve social endeavors related to community, charity, environment, art, music, publishing, film, and theatre. Currently in an open beta, HTTP GET calls to the Crowdfunder API can be made to request JSON lists of all current campaigns […]
  • GlobalNLP
    Via RESTful connectivity, GlobalNLP handles a wide variety of natural language processing. Currently, the API supports many NLP processes including: stemming, morphological synthesis, word sense disambiguation, entity extraction, and automatic translation. A full list of supported processes is listed in the documentation along with code samples in JavaScript […]
  • VIDAL Group
    VIDAL Group is a French healthcare informatics group specializing in databasing and distributing healthcare data, pharmaceutical information, treatment specifications, and scientific publications for patients and healthcare practitioners in the European continent and worldwide. VIDAL Group also supports a medical software application under the same name. VID […]
  • Company Check
    The Company Check API provides direct access to a wealth of information on companies and directors. The API platform is useful to developers to incorporate company, director, financial, credit data, and many more data fields into software and business apps. By applying for the API Key, developers can choose between different levels of account plans. Date Upd […]
  • bx.in.th
    bx.in.th is a Thailand-based Bitcoin and cryptocurrency exchange platform operated by Bitcoin Exchange Thailand (Bitcoin Co. Ltd.). Their API accessibility is divided into Public and Private. The bx.in.th Public API allows anyone to view market data from the exchange, including rates, orderbook, currency pairing for comparison, high and low trades, average B […]
  • Coinzone
    Based in Amsterdam, Coinzone enables European online retailers and eCommerce providers to accept digital currencies such as Bitcoin instead of traditional payment methods. Using the Coinzone REST API, secure calls can be made to authenticate, initiate transactions, retrieve transaction details, and process refunds. Authentication requires a client-code, time […]