Trading Technology

11:59 AM
John Fawcett, Quantopian
John Fawcett, Quantopian
Commentary
50%
50%

The New Finance Era: From HFT to Big Data

The profitability of HFT is declining — and that is a good thing. It’s time for the financial industry to pay attention to the quantitative finance beyond HFT.

High-frequency trading (HFT), the practice of using automated financial tools to rapidly trade large volumes of securities, is one of the buzzwords that has dominated financial media and has led to a stigma against quantitative finance as a whole. It’s time for investors, quants and the media to start focusing instead on the incredible possibilities for creativity, innovation and breakthrough strategies made possible by financial data science and algorithmic trading.

Based on market arbitrage and capitalizing on latency, HFT has given rise to a rapidly escalating speed war between companies seeking any marginal advantage – no matter how small and seemingly no matter what the cost. These advantages are gained by companies spending tens of millions on cutting-edge fiber optical technology that can make sub-second improvements to their transmission speed. To the untrained eye, a millisecond decrease in a trade delay may seem like nothing; however, it can actually boost a high-speed firm’s earnings by as much as much as $100 million per year.

There are multiple sides to the story: Some experts claim that it can work to improve market liquidity, while others argue that it brings an unnecessary risk to financial markets. Regardless of which side you stand on, it should be apparent that the speed war is likely nearing its final days – and with it, hopefully, the all-consuming focus on HFT. Despite the massive investments in infrastructure, speed traders are trading fewer and fewer shares, down to 1.6 billion in 2012 from a high of 3.25 billion in 2009. And it’s not only the total shares traded that is down; it’s profits too. The entire HFT industry made about $4 billion less in 2012 than in 2013.

The profitability of HFT is declining – and that is a good thing. The time has come for the financial industry – organizations, individual traders and the media alike – to pay attention to the quantitative finance beyond the realm of HFT. New tools are opening an entirely new era in algorithmic trading in which data and algorithms can be put to use for incredibly powerful insight-based trading. Beyond the overly-flogged speed capability, there are four significant benefits that trading with algorithms can bring:

1. Reproducibility: Algorithms let traders backtest against real historical data, giving the opportunity to weed out many losing strategies before committing capital. They also let traders put historically published strategies to the test themselves to verify performance before risking their money on the market. It really is about insight – not just executing blindly on an untested strategy.

2. Removing bias: Algorithms remove human emotion and bias from trading decisions. Financial history is filled with the mistakes that humans make when they get attached to a position, company or trade; an algorithm never falls prey to sentimental pitfalls. Embracing algorithms empowers traders to rely on their financial models executing properly without interference from their emotions.

[Moneybrawl: Michael Lewis Takes on Goldman Sachs, HFT]

3. Finding the signals through the noise: Just as algorithms never get nervous or overly confident and change their performance, they also don’t fall prey to influence from media coverage or social speculation. Whatever the hype in the human sphere, algorithmic trading will continue to operate on the hard data of the market.

4. Gigantic increase in scope: Algorithms can evaluate thousands of securities with complex mathematical tools, far beyond human capacity. They also can combine and analyze data to reveal insights not readily apparent to the human eye. This is where true innovation can happen – there is a seemingly endless amount of data available to us today, and with the right tools financial modeling becomes limited only by the brain power and imagination of the quant at work. The future of finance is algorithms looking beyond the order book to the rapidly expanding universe of time-series data, opening the market to the power of quant creativity.

Of course, although HFT may be declining rapidly, the scale of the initial infrastructure investment means it won’t go away entirely. But it’s not the only game in town when it comes to quantitative finance. With the increasing accessibility of big data, quantitative finance is moving beyond Wall Street to the homes and offices of entrepreneurial spirits looking to seize upon its advantages.

John “Fawce” Fawcett is founder and CEO of Quantopian.

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
anon2468921878
50%
50%
anon2468921878,
User Rank: Apprentice
7/7/2014 | 2:30:48 AM
Michael Lewis’ book "Kroger feedback survey"
This book Kroger feedback survey presents an easy explanation of why high frequency trading is advantageous to small-scale investors, and how and why it works.

We'll start by visualizing a marketplace with tons of little individual dealers. Subsequently we'll examine how the marketplace alter. Eventually, we'll describe how small-scale investors are affected.

Begin by picturing a stock without any special news. The cost is not unstable, but there are bunch of little trades. Other investors are determined to jump on the bandwagon and have found increases. Some investors have cash to invest, and happen to be observing it. Others are satisfied and have possessed it but need some cash. The cost tendency for the stock appears absolutely steady. Kroger feedback survey is a nice read and give a good view on these matters.
Greg MacSweeney
50%
50%
Greg MacSweeney,
User Rank: Apprentice
8/13/2013 | 11:58:52 AM
re: The New Finance Era: From HFT to Big Data
It does seem, as you point out, that the race to zero in the HFT game has really turned into a commodity race (an expensive commodity). As Ivy says, firms are using microwave technology to shave off a few more microseconds. It is expensive. Saving a few microseconds here or there can only go so far now. Analytics seems to be the next way that HFT is evolving.
John
50%
50%
John"Fawce"Fawcett,
User Rank: Apprentice
8/12/2013 | 9:12:37 PM
re: The New Finance Era: From HFT to Big Data
Thanks for your perspectives, Ivy. What I see happening is a
commoditization. As algos and analytics become more widely used, they default to competing on speed. HFT isnGÇÖt going away; it is just where good strategies that have become commoditized end up.
quantopian@inkhouse.com
50%
50%
quantopian@inkhouse.com,
User Rank: Apprentice
8/12/2013 | 9:12:37 PM
re: The New Finance Era: From HFT to Big Data
Thanks for your perspectives, Ivy. What I see happening is a
commoditization. As algos and analytics become more widely used, they default to competing on speed. HFT isnGÇÖt going away; it is just where good strategies that have become commoditized end up.
John
50%
50%
John"Fawce"Fawcett,
User Rank: Apprentice
8/12/2013 | 9:11:14 PM
re: The New Finance Era: From HFT to Big Data
Thanks for your perspectives, Ivy. What I see happening is a
commoditization. As algos and analytics become more widely used, they default
to competing on speed. HFT isnGÇÖt going away; it is just where good strategies
that have become commoditized end up.
quantopian@inkhouse.com
50%
50%
quantopian@inkhouse.com,
User Rank: Apprentice
8/12/2013 | 9:11:14 PM
re: The New Finance Era: From HFT to Big Data
Thanks for your perspectives, Ivy. What I see happening is a
commoditization. As algos and analytics become more widely used, they default
to competing on speed. HFT isnGÇÖt going away; it is just where good strategies
that have become commoditized end up.
IvySchmerken
50%
50%
IvySchmerken,
User Rank: Author
8/8/2013 | 3:06:49 PM
re: The New Finance Era: From HFT to Big Data
With HFT profits on the decline, you say there will be less emphasis on speed and that the future of quantitative finance is shifting to algos and analyzing Big Data. But what about all these efforts to build microwave networks and colocate servers w/in data centers? I see a lot of vendors packaging up algos w/ analytics hosted in data centers for execution speed close to trading venues. This is quite common now.
More Commentary
M&A Activity Will Continue to Grow in 2015
Data shows that the M&A market continues to improve, and forecasts indicate deal making will be healthy in 2015.
Chief Data Officers: Organization Strategy & Cultural Change
Chief data officers are new to the financial services C-suite, but they are facing a number of challenges, including the need for new data governance and execution strategies, staffing, and new organizational structures to enable cultural change.
New York FinTech Innovation Lab Calls for New Entrepreneurial Applicants
Wells Fargo joins 14 other major financial institutions providing mentoring and guidance to the six chosen startups.
Micro Data Challenges in an Era of Macroprudential Regulation
Research and statistical analysis experts at central banks are tasked with developing sophisticated forecasts and models to identify systemic risk. Yet they are spending most of their time acting as data entry clerks, rather than developing these models.
The Perks of 'SmartSourcing' Shared Services in Financial Industry
A breadth of vital but undifferentiated business processes are still being replicated across the industry. They are all candidates for centralization.
Register for Wall Street & Technology Newsletters
White Papers
Current Issue
Wall Street & Technology - Elite 8, October 2014
The in-depth profiles of this year's Elite 8 honorees focus on leadership, talent recruitment, big data, analytics, mobile, and more.
Video
Exclusive: Inside the GETCO Execution Services Trading Floor
Exclusive: Inside the GETCO Execution Services Trading Floor
Advanced Trading takes you on an exclusive tour of the New York trading floor of GETCO Execution Services, the solutions arm of GETCO.