What is so dangerous about over-optimization?
When done incorrectly, optimization leads to curve-fitted systems which are âfitâ to test profitably in the past but fail to profit in the same way in the future. Because the future may look nothing like the past in a particular market â the âfittingâ of parameters onto the past âcurveâ of data may cause big problems on the future data curve, causing the system to be out of phase and potentially causing investors losses.
Imagine a system that buys or sells newly created tokens on a breakout (after an ICO event) abd was back tested on above or below the market high or low for the past X number of days. When testing the system on the past data, the testing may show $3,000 in profits when using a 10 day high/low, $60,000 in profits when using a 20 day high/low, and $100,000 when using a 30 day high/low.
How long should a testing period be if you are serious about building a profitable trading strategy?
5 years+
Smaller periods of time are not statistically relevant according to long term changes in market volatility.
Tip: For Bitcoin I would go since the beginning, 2009. The problem with altcoins is that some of them do not have a long trading history, and therefore cannot be traded with a bot. An alternative solution would be to run Pearson Correlation tests, against other coins with similar properties e.g ETH has 93% correlation with BTC. Generally speaking short lived token cannot be traded.
For more information see link
Why should you avoid asymmetric trading signals?
Because it does not take into consideration macro economic variables of the asset. The highs and lows of BTC in 2020 compared to 2017 are dedicated by different events e.g. Covid-19 was responsible for the March drop, which did not exist on 2017.
For more information see link