Why Big Data Matters in Finance

Why Big Data Matters in Finance

A New York Times article covering the latest Triple Crown horse race winner, American Pharaoh, noted that the horse was identified as having an amazing potential when the animal was only 1 year old. The prediction of success was made by a team of data scientists who estimated the horse’s performance by noting the size of the winner’s heart and other characteristics and comparing them with those of past race winners. On the future potential of the horse, the data scientists advised him, “to sell the house, but keep the horse.” Their prediction paid off – American Pharaoh won. The real victory, however, can be assigned to data science – the researchers’ ability to identify the winner ahead of time based on quantitative metrics.

At its core, the data science behind the horse’s win is similar to the methods deployed by modern analysts of financial markets. By observing and measuring recurring characteristics and phenomena in the financial markets, data scientists are able to pinpoint winning stocks, predict market crashes, detect market manipulation and the like.

With time, financial data analysis is becoming increasingly precise and data-intensive. This is in part driven by ever-plummeting costs of technology required to crunch data, by ever expanding data availability, and by the success of data science in financial operations. Big data analyses often drift to the shortest time frames, involving data captured in milliseconds and microseconds. Firms like Getco, Virtue and Quantlab have short-term data analyses over the past couple of decades. Not only institutions benefit from the advantages of short-term financial data analyses; smaller investors can benefit, as well.

Why would ordinary investors care about big data in Finance, and big data at high frequencies, in particular? To answer this question, consider an average investor, Joe, who desires to do something mundane: buy or sell a stock or another financial instrument at the market open prices. To do so, Joe has two methods at his disposal:
1) Joe can place a market order that tells his broker or an exchange to fill his order as soon as possible at the best price available.
2) Joe can place a limit order specifying a particular price, but no time limit for his trade.

If Joe chooses the market order route, he is guaranteed to have bought his desired security, but possibly at a much worse price than the opening bid or even ask price. During the few minutes immediately following the market opening prices strive to incorporate all of the information pent up from overnight, when the markets are closed. The information is transmitted into the markets via traders’ orders, and the disparity of views causes the prices to bounce violently up and down briefly, until the traders reach a consensus on prices. Due to the volatility, a market-order Joe may be filled at the worst possible price, possibly erasing Joe’s projected gain from the trade.

As an alternative, Joe may choose to place a limit order and specify the price at which he is willing to buy the financial instrument of interest. Here, Joe is facing another decision, the price itself. If Joe chooses a price that is too low, his order may never execute. If the price is too high, he does nothing to outperform his market-order scenario. How can Joe determine a price that is just right, that is, both favorable and results in a timely execution?

A simple, yet effective strategy could be to place a limit order at a “mid-price”: a price that is the average of the bid and ask at the market open. To do so, however, one needs a timely source of market data, from which to calculate the mid-price. (Most brokers provide their clients with free access to data that is 15 minutes delayed – too slow for Joe to successfully identify and execute upon his strategy.) This basic example illustrates just one big high-frequency data application that, over time, can make a million-dollar difference in accounts of investors who embrace the data and those who do not. The mantra of today’s investors in financial and horse markets alike may be “keep data science, and choose to trade the assets according to the science’s predictions.”

What other inferences can one make from market data using data science? The possibilities are limitless. Like in any field of research, identifying working models involves lots of trial and error, data observation, and, eventually, intuition about what works and what does not. The data is the first necessary stepping stone.

Steve Krawciw is CEO of AbleMarkets; he can be reached at steve@ablemarkets.com. Irene Aldridge is Managing Director of Able Alpha Trading, LTD., and AbleMarkets and author of High-Frequency Trading: A Practical Guide to Algorithmic Strategies and Trading Systems (2nd edition, Wiley, 2013).


  1. 網絡最龐大欺凌事件,Barbie 原來是邪惡公主的化身 – STYLE-TIPS.COM 你相信人人都是雙面人,甚至是多面人嗎?面對「外人」可以溫文儒雅,對「內人」如家人…

  2. 強效維持角質層豐盈水分,使肌膚滋潤和柔滑飽滿。<中性至乾性肌膚使用

  3. [彩妝] Leah Dizon。外框眼線打造洋娃娃無辜大眼~❤ @ ❤ Bonjour.Amanda 愛曼達購物。旅遊日誌♫ :: 痞客邦 :: [彩妝] Leah Dizon。外框眼線打造洋娃娃無辜大眼~❤ @ ❤ Bonjour.Amanda 愛曼達購物。旅遊日誌♫ :: 痞客邦 ::

  4. Keep this going please, great job!

  5. Hmm it appears like your website ate my first comment (it was extremely long) so I guess I’ll just
    sum it up what I submitted and say, I’m thoroughly enjoying your blog.
    I as well am an aspiring blog writer but I’m
    still new to the whole thing. Do you have any helpful hints for newbie blog writers?
    I’d really appreciate it.

  6. Just desire to say your article is as surprising.
    The clarity in your submit is just spectacular and that i can assume you’re an expert in this subject.
    Fine along with your permission allow me to
    grasp your RSS feed to keep updated with approaching post.
    Thanks a million and please carry on the rewarding work.

  7. Everyone loves it when folks get together and share views.
    Great website, keep it up!

  8. Thank you a bunch for sharing this with all folks you really recognise what you are talking about!
    Bookmarked. Kindly also discuss with my site =). We can have a hyperlink alternate agreement
    between us

  9. It’s a pity you don’t have a donate button! I’d
    without a doubt donate to this excellent blog! I guess for now i’ll settle
    for bookmarking and adding your RSS feed to my Google account.
    I look forward to brand new updates and will talk about this blog with
    my Facebook group. Chat soon!

  10. C8lDaz Thank you for your blog article.Really thank you! Awesome.

  11. Hi there just wanted to give you a quick heads up and let you know a few of the images aren’t loading
    correctly. I’m not sure why but I think its a linking issue.
    I’ve tried it in two different web browsers and both show the same outcome.

  12. I’m not that much of a internet reader to be honest but your sites really nice, keep it
    up! I’ll go ahead and bookmark your website to come back in the
    future. Many thanks

  13. Do you have a spam issue on this website; I also
    am a blogger, and I was wondering your situation; many of us have created some nice procedures and we are looking to exchange methods with other folks,
    please shoot me an email if interested.

  14. Ahaa, its pleasant dialogue about this paragraph at this place at this website, I
    have read all that, so now me also commenting here.

  15. I always used to read article in news papers but
    now as I am a user of web so from now I am using net for articles or reviews, thanks to web.

  16. It is appropriate time to make some plans for the future and
    it’s time to be happy. I’ve learn this post and if I could I desire to counsel you few attention-grabbing issues
    or tips. Perhaps you can write subsequent articles referring to this article.
    I wish to learn even more things approximately it!

  17. Wonderful article! This is the type of information that are meant to be shared across the web.
    Shame on Google for no longer positioning this post higher!
    Come on over and discuss with my web site . Thank you

  18. Hey! I know this is kinda off topic but I was wondering if you knew where I could find a captcha plugin for my comment form?
    I’m using the same blog platform as yours and I’m having problems finding one?
    Thanks a lot!

  19. Currently it sounds like Expression Engine is the
    top blogging platform available right now. (from what I’ve read) Is that what you’re using on your blog?

  20. I am no longer positive the place you are getting your information,
    however great topic. I needs to spend some time learning more or understanding more.
    Thanks for excellent information I used to be searching
    for this information for my mission.

  21. Magnificent goods from you, man. I have understand your stuff previous to and you
    are just extremely fantastic. I really like
    what you’ve acquired here, certainly like what you’re stating and
    the way in which you say it. You make it enjoyable and you still
    care for to keep it smart. I can’t wait to read much more from you.
    This is actually a tremendous website.

  22. It’s remarkable to go to see this site and reading the views of all mates
    on the topic of this piece of writing, while I am also
    keen of getting familiarity.

  23. I was suggested this website via my cousin. I’m not
    sure whether or not this put up is written by way of
    him as no one else recognize such exact approximately my trouble.
    You are amazing! Thanks!

  24. Greetings! Very helpful advice within this article!
    It is the little changes that will make the most important changes.
    Many thanks for sharing!

  25. Wonderful blog! I found it while searching on Yahoo News.
    Do you have any suggestions on how to get listed in Yahoo News?
    I’ve been trying for a while but I never seem to get there!

  26. I don’t even know how I ended up here, but I thought this post was great.
    I do not know who you are but certainly you’re going
    to a famous blogger if you are not already 😉 Cheers!

  27. Great goods from you, man. I have understand
    your stuff previous to and you’re just too great. I actually like what you have acquired
    here, certainly like what you are saying and the way in which you say it.

    You make it entertaining and you still take care of to keep it sensible.

    I can’t wait to read far more from you. This is really
    a great site.

  28. Heya this is somewhat of off topic but I was wanting to know if blogs use WYSIWYG editors or
    if you have to manually code with HTML. I’m
    starting a blog soon but have no coding skills so I wanted to get advice
    from someone with experience. Any help would be greatly appreciated!

  29. crazy 실제딜러카지노 카지노주소 온라인텍사스홀덤

  30. Oh my goodness! Incredible article dude! Thank you so
    much, However I am having troubles with your RSS.
    I don’t understand the reason why I cannot subscribe to it.

    Is there anybody else getting similar RSS problems? Anyone that knows the solution can you kindly respond?

  31. Hey there! I could have sworn I’ve been to this website before but after reading through some of the post I realized it’s new to me. Anyways, I’m definitely delighted I found it and I’ll be bookmarking and checking back often!|

  32. Estrace 1mg Tablets Buy Cialis Propecia Generico Espana Non Percription Mobic Buy Eltroxin Online No Prescription Uk

  33. You really make it seem so easy along with your presentation however I to find this matter to be really one thing that I think I might never understand.
    It sort of feels too complicated and extremely extensive for me.

    I am taking a look ahead to your next put up, I’ll attempt to get the
    hold of it!

  34. Hi, after reading this amazing article i am as well cheerful
    to share my experience here with mates.

  35. Hey I am so excited I found your blog, I really found you by error, while I was
    researching on Google for something else, Nonetheless I am here
    now and would just like to say cheers for a incredible
    post and a all round entertaining blog (I also
    love the theme/design), I don’t have time to read it all at the moment but I have
    bookmarked it and also added in your RSS feeds, so when I have time I will be back to read a lot
    more, Please do keep up the superb work.

  36. What’s Happening i am new to this, I stumbled upon this I have found It positively helpful and it has aided me out loads.
    I am hoping to give a contribution & aid different
    users like its helped me. Good job.

  37. You really make it appear really easy along with your presentation but I in finding this
    topic to be really something which I believe I’d by no means understand.
    It seems too complex and very extensive for me. I am
    taking a look ahead in your next post, I’ll attempt to get
    the hold of it!

  38. Hey There. I discovered your weblog the usage of msn. That is an extremely smartly written article.

    I will be sure to bookmark it and come back to learn extra of your useful information. Thank you for the
    post. I will definitely comeback.

  39. I’ve been exploring for a little bit for any high quality articles or weblog posts in this sort of area
    . Exploring in Yahoo I finally stumbled upon this website.

    Studying this info So i am glad to express that I have an incredibly good uncanny
    feeling I discovered exactly what I needed. I most definitely
    will make sure to do not fail to remember this site and give it a
    look on a continuing basis.

  40. Hi my loved one! I wish to say that this article is amazing,
    nice written and come with approximately all important infos.
    I’d like to see extra posts like this .

  41. Having read this I thought it was really enlightening. I appreciate you finding the time and energy
    to put this article together. I once again find myself personally spending way too much time both reading and commenting.
    But so what, it was still worthwhile!

  42. Spot on with this write-up, I truly believe this
    website needs much more attention. I’ll probably be
    returning to read more, thanks for the info!

  43. We’re a group of volunteers and starting a new scheme in our community.

    Your web site offered us with valuable info to work on. You have done an impressive job and our entire community will be thankful
    to you.

Leave a Reply

Your email address will not be published.