Most signals I deal with are noisy, reflecting noise of underlying prices, volume, vol of vol, etc. Many traditional strategies built on such indicators might either:
Pictured below is an example...
In the prior two posts, investigated:
In this post will evaluate feature importance as implemented by Random Forest and compare to Information Geometric approaches. Here is an outline of what would like to discuss:
As we will see, Random Forest’s approach to...
As mentioned in the prior discussion feature selection (1/3), of primary interest is understanding the contribution of each feature in \(\vec{x}\) to the outcome or class labeling function \(f(\vec{x})\). One way to examine this is to understand how the distributions:
differ from each other. For a feature with no relationship to the outcome \(p(x_f)\)...
I am often confronted with the problem of trying to reduce a high dimensional feature set to a, smaller, more effective one. Reducing dimension is important for machine learning models as:
It is fairly easy to recognize price momentum with price-based indicators ex-post or with lag. Price based momentum signals tend to have lag issues in recognizing the start and end of a price move as there is a tradeoff between noise and lag [1] that can’t be defeated without future information (due to principles from signal processing).
[1] For those interested see impulse-response and the relationship between response delay and degree of smoothing by a filter. Zero lag...
Following on from the prior post, want to discuss the problem of sample independence. Many machine learning models in finance deal with timeseries data, where samples used in training may be close together in time and not be independent of one another. There are very few features in finance that do not make use of lookback periods. Most features do evaluate prior windows:
Following on from the prior post, want to discuss the repercussions of the low signal / noise ratio and how it effects:
How does this manifest and what might we do to ameliorate the issues it poses.
Financial timeseries appear to have a very low signal to noise ratio, where the variance (the power of the noise frequency) can be higher than the power of the overall signal....
I have used machine learning in trading strategies over the past 10 years or so. However my use of ML has often played a relatively small role in the overall design and success of the strategies due to issues particular to financial data sets. I tend to use ML in specific signals or strategy sub-problems where the data / problem setup have attributes that lead to a robust statistical solution. This is as opposed to the “Nirvana” scenario where fundamental...
There are times when need to label a time series, identifying periods of momentum, trend, mean-reversion, etc. Directionaly labeling timeseries has a wide variety of applications:
The naive approach to labeling might just note the sign of individual returns in a series....
Bitcoin has entered the mainstream, though not in a way that is particularly useful. Many, including myself, are calling a bubble in Bitcoin. As with many bubbles when the “mom and pops” and non-professional investors get into a buying frenzy, historically this has been associated with the last stages of a bubble. Momentum from individual buying may persist for some time, potentially in cycles of buying dips, so would not want to get short, without a strong view on sentiment...
In the prior post Information In Volatility Structure [1] applied the SABR model to fit noisy raw option price data of approximatelty 700 million prices across a 10 year history of 2700 stocks. The point was to examine a hypothesis:
I started by observing both put/call skew and skew...
I have two pools of capital, one for active trading and another for long-term investment / lower-risk capital preservation. I go through phases of actively managing investment capital and then phases where become too busy to do so properly. It would be convenient to hand off the management to one or more funds, invest and forget, but given the market uncertainties and what I know about wall street, trust is hard to come by. Indeed since the financial crisis, Hedge...
I’ve developed signals based on the “spot” market, but had not really explored the options market as a source of information. In particular want to look at discrepancies in option demand / pricing that may relate to future returns or risk. In scenarios where there is an expected dislocation in price, there may be more demand for calls vs puts or vice-versa. Buying pressure on puts or calls will tend to impact the option price (and therefore implied vol), much...
With market making we can try to be neutral by skewing prices in such a way as to maintain a neutral position. To the extent that the market can become 1-sided (in momentum) or may have large sized requests (if offering at different sizes), one’s portfolio may require explicit hedging.
In a live market-making scenario we can determine how we want to hedge on a case-by-case basis and with a view on where it is cheapest to achieve the...
Investors are often looking for uncorrelated returns so as to better diversify. If one looks at world indices & equities, there is much less diversity between assets than there was a decade ago, indeed the cross-market correlations are remarkably high.
On the other hand, from a trading perspective, generally want to be able to reduce the risk by hedging or spreading against related assets. For example in FX, when market making the G10 currencies, one typically offsets inventory risk with...
I have 4 Bitcoin L3 exchange feeds running smoothly out of a data center in California (which is slightly closer to Asian exchanges and Coinbase than the east coast). It took a bit of error handling and exponential back-off, to handle the unreliability of connectivity with these exchanges, where connections can intermittently be overwhelmed (returning 502 / 503 errors due to the poor choice of a REST-based API).
I am thinking to add Bitstamp and Kraken to the mix, even though they are...
Ok, what I am going to say here is probably Bitcoin heresy, in that I am going to advocate more centralized clearing and management of assets wrt exchange trading.
I want to be able to scale trading in bitcoin and execute across multiple exchanges. However have the following problems
I have implemented 4 bitcoin exchange interfaces now that produce a live L3 stream of orderbook updates + trades of the form:
Given the above, can reconstitute the orderbook as it moves through time, and can likewise be used to create BBO quotes and bars of different granularities. The status of the exchange implementations is:
I am looking to run this on a remote machine (preferably linux) and write to an efficient...
In the previous post outlined intention to put together high quality L2/L3 feeds for the top 4-5 bitcoin exchanges, collect L3 data, and provide a consolidated live orderbook for trading. So far have implemented OKCoin and been experimenting with the others to determine their API capabilities.
With the exception of OKCoin, what I’ve found so far is not good. Here is a summary of the top-4 exchanges w/ respect to market data APIs (I also included Coinbase with the notion will...
It seems like every other month there is a new bitcoin exchange. For the purposes of trading research & backtesting it is important to have historical data across the most liquid exchanges. My minimal list is:
(percentage volume sourced from http://bitcoincharts.com/charts/volumepie/). Each of these exchanges not only has a unique protocol but also unique...
I recently attended a talk by David Simchi-Levi of MIT, where he discussed an approach to online price discovery for inventory, to maximize some objective, such as profit. The scenario was where one could observe whether inventory was sold or not-sold to for each potential buyer in the marketplace, giving an empirical view of demand-behavior as a function of price. The optimal setting in selling the inventory is one that maximizes price x liquidation probability.
When we have no knowledge about the...
It has been almost a year since my last post. I have been far too busy getting a new trading desk up and running. I thought to discuss money management, since am revisiting right now.
It is easy to think that trading signal is the most important aspect of a trading strategy, but money management (and execution) can be even more important. Loosely defined, money management is a mechanism for position-level risk management. The mechanism attempts...