The Elusive Definition of High Frequency Trading Pt. II

Why all the Fuss?

High frequency trading has gotten a lot of media attention over the past few days, much of which most of which has been negative.  This is due to a couple of factors:

  1. The down market has created disgruntled (and vocal) concerned citizens wary of the finance industry.  That resentment and distrust has surfaced in the mainstream media in which bailout money, AIG, Lehman Brothers and the finance industry are lumped together and demonized as an amorphous, sinister entity out to trample the rights of the common person.  High frequency, in the eyes of the layman, is representative of this.
  2. People don’t really understand high frequency trading.  In many instances, it’s wrongfully lumped together with practices like flash orders or short selling.  The real danger with this lack of understanding is that it leads to uninformed regulation. This perpetuates the lopsidedness of the market and results in regulations created to control a few being extended to many. One size cannot fit all in a regulatory landscape.

What is the Next Hurdle?

The market crash has created a political environment where heavily lobbied decisions that may not in the best interest of market participants are being forced on the industry.  Under political pressure and widespread scrutiny from the media, the SEC doesn’t have the luxury of time to do extensive due diligence before legislating.

During the the crash the SEC tried to prevent stocks from falling with regulations like banning short selling, but the spreads only got larger and because of the hysteria, there is now political pressure to bring back some version of the rule which was studied for years before finally being repealed.  The data and statistics show that it will probably have a negative effect but there is a hue and cry to do something, so something must be done. For those who argue that current market structure does not work need a lesson in history, to start of with even with all the turmoil that was happening in 08 stocks still have tight spreads and liquidity was available across the broad spectrum from small cap to large cap. What more of a test can you ask for than what happened in 08 ?  Whereas back on Black Monday in 87 and in the early 90s, for Nasdaq listed stocks the market would completely dry up the bid/ask spreads become too wide to be usable in really bad market conditions.

The current climate, lack of knowledge about what caused the market crash and the need to do something combined with a lack of understanding of HFT has caused it to become a the target of blame for anything wrong.

What Does the Future Hold?

Matching engines, a major part of the trade execution process, are currently limited by the communications between servers they run on. Technology-forward liquidity venues like NYSE are working on things like broad in-memory trading.  In as little as 3-4 years, everything will sit in one big memory box, removing the physical drag of communication between computers.  Latency’s only limitation will become that pesky speed of light and it will make today’s trading pace look like a horse and cart race.

The cost of entry and ability for smaller players to be able to participate will continue to increase as more competing vendors force prices down, for example the executing broker Lime Brokerage is known for providing very low latency execution.

Technologies like open source are also enjoying extensive adoption at investment firms of all sizes. Access to source code means infinite flexibility without being beholden to proprietary vendor release schedules and cost. Financial firms that have no internal software development can take advantage of the existing functionality in an open source platform, and innovate where they need to. Some of the world’s largest banks are using open source at every point in the investment cycle including Linux platforms, CEP engines like Esper, front-end trading platforms like Marketcetera and feed handlers like the Collaborative Software Initiative.

What Does it all Mean?

Several years ago, the barrier to entry into the world of high frequency trading was patently higher than it is today.  There were numerous startup costs, including expensive hardware, implementation, service and maintenance.  Only the bulge bracket sell side and buy side firms could play in this game. Today, if you are a small buy-side shop with two traders and a developer you could be up and trading automated strategies productively in three to four months.

There is a also a cultural change starting whereby technical people are collaborating virtually and sharing information about the standardized infrastructure… a great example is QuickFIX.  Trading firms are able to spend more on intellectual capital – the strategies and the algorithms that will gain them competitive advantage – instead of saddling themselves with large capital investments in expensive and restrictive infrastructure. The level playing field created by this perfect storm of technology and market pressure will bring with it thousands of new entrants into the high frequency trading game.

The Elusive Definition of High Frequency Trading Pt. I

What is High Frequency Trading?

Ask a dozen traders and you’ll get a dozen different answers.  Some say it involves program trading, stat arb and quantitative modeling coupled with extremely low latency and high frequency trade execution. Others say it is where alpha generation is purely based on speed.

Quants define it as “exceptional speed + algorithms or automatic strategies.” But, who gets to determine whether your speed is “exceptional” or if you are using enough algorithms to make the cut?

There are even nuances to the technical definition. Does trade execution have to occur for it be considered high frequency trading? What about bad liquidity – if you put an order out to try and influence other participants, but you pull it back and don’t execute it, does that still count? What about sponsored access? Are you a high frequency trader if you are simply the conduit, not the execution venue?

The truth is that as an industry, we may never standardize on a definition.

However, a few things do seem to be constant. You need a fully automated system to be considered a high frequency trader and most people agree that it has more to do with the percentage of total volume traded using high frequency strategies than the total volume traded overall. This is interesting because it puts companies like Lime Brokerage in the same category as Goldman Sachs despite the fact that they are on opposite sides of the size spectrum.

How Did We Get Here?

To really understand high frequency trading, we must understand where the industry has come from…  Advances in computing power have boosted the number of firms who are able to take advantage of pricing inefficiencies in different markets. Changes in liquidity providers – particularly new entrants like Knight Capital, Liquidnet and BATS – have opened the floodgates for many high frequency firms.

Before decimalization, you had to be registered with an Exchange to be able to make a market as an on the floor market-maker (NYSE specialist) or an “upstairs” market maker (eg. Nasdaq market-maker).  As a market-maker you were subject to regulation and capital requirements in return for a right to capture the bid-ask spread. Before decimalization only registered market makers were allowed on both sides of the trade (eg. Bid and ask) at the same time. Now anyone can operate from both sides of the market and act like a market maker. This freedom, combined with the democratization of access to new technologies, has created a host of opportunities.  In 2001, one to two seconds was fast, but the continual increase in computer power combined with decreased cost has led to an arms race to see who can have the fastest and lowest latency infrastructure. In a market structure that determines the priority of orders by price and time, being first in line means getting the trade done.  This ever-increasing speed means that turn around times are now measured in single milliseconds or sub-millisecond for the largest players with co-located servers at the exchanges.

People have also been leaving larger firms to start small shops. And, by capitalizing on advancements in technology, they have been able to achieve the same results. This is currently resulting in a very large increase of newer, smaller firms competing with similar strategies and ideas. As is usual with the markets, even the small inefficiencies found today will soon be gone and spreads will continue to narrow until they are all at 0.01c.  This is an indication of a competitive market and good for retail investors as they will have lower transaction costs due to the decreased bid/ask spread.

The Next Chapter for Hedge Funds

Two data points surfaced in recent days that underline why we’re so passionate about democratizing trading with open source software.

First, hedge fund returns are up. And not just up from the carnage of last year, but with 2.5% returns in September, it’s looking like hedge funds could have their best year since 2003.  According to the Eurekahedge Fund Index — and bolstered by a number of other hedge fund research firms — the industry grew by $26.3 billion last month, bringing total assets managed to $1.42 trillion.

Such news, coming just months after record losses, illustrates that hedge funds are coming back aggressively and when you dig into the numbers, you find that funds with medium or high-frequency strategies had even higher returns.

Now to that other data point. Hedge Fund Research is reporting that hedge fund creation is up but the size of those hedge funds is down. And while it’s true that the new funds will have to compete with the larger established players for investment funds, we see this as a positive trend for the industry.

The reason why is simple. Bigger isn’t always better. Just look at the economic data that show that small and medium businesses provide the bulk of our jobs and most of the muscle behind a recovery.

In the case of the hedge fund industry, we’re seeing a resurgent wave of creative capitalism rising at the hands of small groups of traders who are making smart use of technology to leverage their trading strategies and secure returns. Many of them came from the big funds that posted last year’s dismal returns. They learned from the experience and are taking a new approach this time around with funds that may be smaller but are also more nimble.

We’d like to think that it’s this generation of hedge funds that Marketcetera’s trading platform is made for…

High-Frequency Trading Doesn’t Need Speed Limits, It Needs A Better Image

High-frequency trading (HFT) could use a good image consultant.  Everyone from Floyd Norris to Chuck Shumer have questioned the validity and even legality of high-frequency strategies, as they have taken over from exchange floor specialists as the mainstream media’s favorite whipping boy.

Unfortunately HFT is a term like “salad” where there are many definitions, and no one covers the entire set.  We define HFT as high-speed, high-volume, low-latency trading enabled by technology. It’s what the Marketcetera platform enables and it’s all about responding quickly to inefficiencies in the market..

It’s also unfortunate that the media have helped conflate HFT with a couple of other trends that have given it a bad name. The practice of flash orders — for example, giving order floor access to a limited number of market participants, which I would argue isn’t good for the market structure — for example, is being twisted up with HFT in some news stories, coloring it an unfair advantage.  It’s true the same technology can enable HFT and trading flash orders, but the two are not equivalent.  There are many high-frequency strategies that operate outside the limited number of venues providing flash orders.

A second issue conflated with HFT in recent discussions is the apparently large profits generated by banks that a) have taken TARP funds, and b) have produced significant returns based on HFT.  HFT has been identified as a government-funded unfair advantage that the big banks have over the individual investor.

I don’t buy it.

Whenever inefficiencies can be removed, it’s constructive to the market. That to me is a fundamental principle of capital markets. And while it’s true that the larger banks are more likely to have the technology budgets to develop the infrastructure to support HFT, the playing field is leveling quickly.

Bear with me for a marketing message: because Marketcetera’s trading platform is open source, it is cheap, fast and flexible. Our new offering in partnership with NYSE will provide a managed service version of the Marketcetera platform right there in the exchange’s data center, allowing for the same kind of low-latency trading that the big banks, who have paid to park their servers their too, are building strategies.

The point is, technology is evolving and Wall Street is changing. HFT is no longer going to be a tool for the elite few. The analogy we like to use is the racetrack where all drivers have the same car. Once the advantage of the machine is removed, the best driver wins.

Marketcetera Partners with NYSE Technologies to Deliver Next Generation SaaS Offering

Just as high frequency is the future of trading and open source is the future of trading technology, we believe that the cloud will be the future of the trading ecosystem. In today’s world of exploding market data and intense pressure on the financial services industry, buy-side firms and traders will be less able to afford costly on-premise proprietary trading systems that require long implementation periods and lag behind the rapidly changing needs of users. An open source architecture provides the benefits of customization, flexibility, and agility that we’ve been discussing since the inception of Marketcetera. But let’s take it one step further…

At the SIFMA Technology Management Show this week, Marketcetera announced a partnership with NYSE Technologies to offer a SaaS trading platform over NYSE’s Secure Financial Transaction Infrastructure (SFTI) network. High frequency traders using the network to connect seamlessly with the world’s leading markets will be able to employ Marketcetera’s trading platform hosted in the cloud. This means high-performance, end-to-end trading infrastructure available at a fraction of the cost of proprietary IT systems that must be run on premise. Combining open source with on-demand services in the cloud will revolutionize the way that customers mold the Marketcetera platform to fit with their business models.

To help us express our vision for the future of open source trading and innovation in hosted cloud services, we’ve added a new video to the YouTube channel featuring interviews with Graham Miller, our co-founder and CEO, and I. Appreciate your thoughts!

Marketcetera Announces Partnership With NYSE Technologies

Marketcetera Announces Partnership With NYSE Technologies

Screencast Series on YouTube

As we continue to come out with new screencasts available on our YouTube channel, you may be wondering what inspired me to start this project and what you can expect in the future. In the past few years, I’ve found various videos and demos on Ruby on Rails quite useful and informative. Ruby is the main strategy scripting language supported by the Marketcetera platform. Being able to watch coding and development in action allows you to understand concepts and applications of the language more easily and I knew we had to do the same for our community at Marketcetera.

In the past few weeks, we’ve started with three basic videos: the first screencast describes developing simple strategies in Ruby on Photon, the integrated Strategy Studio. The second screencast shows how to deploy a number of real sample strategies. The third screencast is a demonstration of the Strategy Agent, which allows users to scale strategies to work on multiple machines and handle complex data flows between strategy modules. Future screencasts will include more complex topics and trading strategies. For example, you may see a video on pairs trading and a demo on backtesting.

The goal for the video series as a whole is to provide Marketcetera users with audio-visual explanations for all the features and functions of the Marketcetera platform. We’ve been listening to your feedback so far. Keep it coming! You’ll help us determine the future direction of the videos.

Marketcetera is on YouTube!

Toli Kuznets, our CTO and co-founder led our first experiment with a screencast demonstration of the Strategy Studio. In this first video, Toli takes us through the process of developing and deploying new trading strategies in Ruby. The video is available below and on our YouTube channel.

One of our goals at Marketcetera is to make the platform intuitive and easy to use. To that end, this screencast is meant to enable current and new users to learn the ins and outs of the Strategy Studio more quickly. As always, we appreciate your feedback on the product as well as our first screencast.

The Rise (and Rise) of Automated Trading

Aite Group, a Boston research firm, reports that the high frequency trading community is now responsible for more than 60% of average daily volume in U.S. equities. High frequency trades are often executed with automated systems. Data volumes are exploding on Wall Street and the number of trades executed each year is increasing significantly. Traders and buy-side firms need technology to handle this fast-paced market. But what is automated trading and how does the human trader fit into the picture? At first glance, the word “automated” seems to eliminate the need for smart human traders and compel conformity in trading strategies. After all, if high-powered computers are doing everything and finding the perfect formulas, then what’s the use of even the best quant?

Read more »

Announcing….. Marketcetera V1.5

Since the release of the Marketcetera Automated Trading Platform 1.0 in January, we’ve brought on several great new board members and got the ball rolling with exciting new customers. And recently, we’ve heard continuing calls for open source from financial services firms trying to navigate a new market with smaller budgets. When Graham and Toli started Marketcetera a couple years ago, they found a hole in the automated trading market and decided to fill it. But while open source was one part of the answer, they believed that high-performance and functionality needs to compliment the unprecedented customizability and accessibility that open source offers traders.

To that end, we’re announcing today the general availability of the Marketcetera Automated Trading Platform 1.5 (www.marketcetera.com). The purpose of this update is to provide even more scalability so that multiple users can collaborate using remote servers to turn trading strategies into immediate executions. The update also allows for monitoring of profit and loss in real time so that traders can adjust to new data as it becomes available throughout the day. Key features of 1.5 include:

  • Real-time intraday position and profit and loss monitoring.
  • Simplicity and security for multi-user installations
  • Level 2 and depth-of-book market data
  • Strategy Studio, allowing multiple agents to build and execute strategies across multiple servers

Read more »

Seven Months After The Crash

Dow Jones Index Drop

Dow Jones Index Drop

The September 2008 market crash has certainly shaken up the trading industry.

For buy-side firms and hedge funds in particular, the volatile period over the last seven months has required difficult adjustments. The realities of a new market have challenged the assumptions inherent in hedging practices and federal regulations (such as the short selling ban) have forced firms to radically change how they do business – from trading strategy to cost structures to IT systems. What have we learned?

Read more »