Trading Systems: Troubleshooting And Optimization
  1. Trading Systems: Introduction
  2. Trading Systems: What Is A Trading System?
  3. Trading Systems: Designing Your System - Part 1
  4. Trading Systems: Designing Your System - Part 2
  5. Trading Systems: Constructing A System
  6. Trading Systems: Troubleshooting And Optimization
  7. Trading Systems: Conclusion

Trading Systems: Troubleshooting And Optimization

Even after successfully designing and constructing a working trading system, a trader may find that his or her system is imperfect. There may be some problems, such as an event that keeps generating losses; or maybe the rules are too broad and need to be optimized. What's the easiest way to fix the problem? How effective is optimization? This section will show you how to troubleshoot and optimize your trading system to maximize profits and minimize losses.

Troubleshooting is a very important aspect of system development. A decent trading system will be profitable in most market conditions, but if it occasionally renders large losses, you can work to identify and solve the problem. Here are four easy steps:

1. Identify the problem - Find all instances in which the problem occurred during your backtesting, and/or start recording when the problem occurs during live trading. During each instance, take note of any tendencies of the following four factors:

  1. Chart pattern or price series - Spike in the prices.
  2. Volume - Large volume initially and low volume thereafter.
  3. Bid/Ask spread - Spike in price on low volume often indicates a large spread.
  4. Margin (if used).
These are some of the areas in which problems can occur, which we can see by analyzing the chart below. Note the price spikes on low volume by the green arrow. Also note the large volume (near the blue arrow) followed by low volume thereafter. If none of these turns out to be the culprit, there are other factors that can be analyzed, such as block-sizes and advanced chart patterns.

2. Evaluate the problem - Use the information you gathered to determine what exactly caused the system to malfunction or to generate a loss. This is often done by using common sense, or by analyzing transaction logs (provided by your broker). Here are examples of how some conditions of the four factors listed above may be the reason for an identified problem:
  1. Chart pattern or price series - The system is unable to sell during sharp declines or buy during steep climbs. Perhaps the system did not have ample time to buy or sell.

  2. Volume - The system is unable to sell during declines or buy during increases. Perhaps the equity has such a low trading volume that the system is unable to buy or sell at one price. During these instances, the price can be misleading without a consideration of volume and bid/ask.

  3. Bid/Ask spread - The system makes a purchase but doesn't profit as much as it should when selling. This could be due to the fact that the trader forgot to consider bid/ask spreads. If a system is programmed to buy and sell at the "current price" it actually pays the ask, and when sold, it doesn't sell at current price but at the bid price. Sometimes the differences between the bid and ask can be large, leading to undesired losses.

  4. Margin - The system suddenly sells for no apparent reason. If this occurs, you may have forgotten to consider margin calls.

3. Consider the alternatives - Simply try some solutions to the problems you have identified. Consider the following alternatives corresponding to the above problems.
  1. Chart pattern or price series - One alternative is simply to tell the system to wait until the price stabilizes before buying. This can be done by using the differences between the previous prices and the current price to create a rule.

  2. Volume - To solve this problem, you could create a rule that requires the equity to have a certain amount of volume before executing a trade.

  3. Bid/Ask spread - Here you might want to buy and sell based on the bid and ask prices instead of the current price.

  4. Margin - Using margin can be profitable if risk is managed effectively. Limiting downside should keep you from receiving margin calls. This can be done with trailing stop loss points or other similar tactics to limit downside.

4. Implement a solution - Finally, we need to apply the solution and see how it works. Paper trading or back testing again before live trading is often a good idea after applying a solution because sometimes solutions have unintended consequences. For example, additional rules may limit these down days, but also decrease overall profits (due to missed opportunities).

Optimization simply means finding the best sets of parameters for a given market. This process can marginally improve results. However, it also carries many risks because its underlying assumption is that past performance is indicative of future price movements. Optimization can be accomplished by changing the values of the parameter you would like to optimize and then back testing these changes. Keep in mind the other parameters must remain constant for the effects of the changes to be determined. Once you find the value that yields the highest performance in the back testing, implement it into the trading system.

Let's consider an example. Say a trader analyzed the S&P 500 and found that he or she could optimize the system by using a daily chart. This same process can also be taken to a higher degree. For example, if a simple moving average of 6 works better than 8 for an MA-crossover strategy in a given market, then 6 would be used. The problem here is not only in the assumption, but also in the fact that the system may perform worse in many other markets, thereby making it less universal.

Many system developers forgo the optimization stage for these two reasons:

  • Optimization often overstates results. This is because the parameters are so specific and non-universal that any change in the market (that is, the future) can cause instability.

  • In many cases, optimization will not improve performance by a meaningful degree. Slight improvements may be apparent; however, the forfeiture of universality is a high price to pay.

As a general rule, optimization should only define broad settings for parameters rather than set up specific rules - even if it was successful in backtesting and paper trading.

Troubleshooting is crucial to making your system work the way you want it to. It is important to identify any problems by observing the instances in which they occurred and then evaluating how certain conditions of several factors - such as price pattern, volume, bid/ask spread, and margin - may have caused the problem.

Optimization can improve your results, but it is important to remember that it has its limitations. Not only is it based on the assumption that past performance indicates the future, but it is not the stage at which the trader creates specific rules - optimization is only about defining broad settings. In the next and final installment, we will provide an overview of everything we've covered along with some advice and resources to help you gain a working knowledge of trading system design and development.
Trading Systems: Conclusion

  1. Trading Systems: Introduction
  2. Trading Systems: What Is A Trading System?
  3. Trading Systems: Designing Your System - Part 1
  4. Trading Systems: Designing Your System - Part 2
  5. Trading Systems: Constructing A System
  6. Trading Systems: Troubleshooting And Optimization
  7. Trading Systems: Conclusion
  1. Contagion

    The spread of market changes or disturbances from one region ...
  2. Rule Of 72

    A shortcut to estimate the number of years required to double ...
  3. Markdown

    The difference between the highest current bid price among dealers ...
  4. Catalyst

    A catalyst in equity markets is a revelation or event that propels ...
  5. Investing

    The act of committing money or capital to an endeavor with the ...
  6. Metrics

    A wide variety of tools that managers and executives can use ...
  1. Is Colombia an emerging market economy?

    Colombia meets the criteria of an emerging market economy. The South American country has a much lower gross domestic product, ... Read Full Answer >>
  2. What is a stock split? Why do stocks split?

    All publicly-traded companies have a set number of shares that are outstanding on the stock market. A stock split is a decision ... Read Full Answer >>
  3. What assumptions are made when conducting a t-test?

    The common assumptions made when doing a t-test include those regarding the scale of measurement, random sampling, normality ... Read Full Answer >>
  4. How do I place an order to buy or sell shares?

    It is easy to get started buying and selling stocks, especially with the advancements in online trading since the turn of ... Read Full Answer >>
  5. Is there a difference between financial spread betting and arbitrage?

    Financial spread betting is a type of speculation that involves a highly leveraged derivative product, whereas arbitrage ... Read Full Answer >>
  6. What does a high turnover ratio signify for an investment fund?

    If an investment fund has a high turnover ratio, it indicates it replaces most or all of its holdings over a one-year period. ... Read Full Answer >>

You May Also Like

Hot Definitions
  1. Black Friday

    1. A day of stock market catastrophe. Originally, September 24, 1869, was deemed Black Friday. The crash was sparked by gold ...
  2. Turkey

    Slang for an investment that yields disappointing results or turns out worse than expected. Failed business deals, securities ...
  3. Barefoot Pilgrim

    A slang term for an unsophisticated investor who loses all of his or her wealth by trading equities in the stock market. ...
  4. Quick Ratio

    The quick ratio is an indicator of a company’s short-term liquidity. The quick ratio measures a company’s ability to meet ...
  5. Black Tuesday

    October 29, 1929, when the DJIA fell 12% - one of the largest one-day drops in stock market history. More than 16 million ...
  6. Black Monday

    October 19, 1987, when the Dow Jones Industrial Average (DJIA) lost almost 22% in a single day. That event marked the beginning ...
Trading Center