I am not so sure that testing systems for certain periods only (seasonality of contracts), and/or stress testing it for specific historical
periods/events is that unusual (I happen to know and have worked with many traders that do just that).
As I was alluding to above, I believe that this approach is preferred if you are developing systems on seasonal products, especially those where the
contract specs de facto differ between different months of delivery, I think anyone will miss out by treating all contracts the same way, essentially
as one continuous data series. Since they are different in their specs, have different fundamentals etc, they also have different price
behaviour/distributions/volatility etc. I guess one analogy I would make is with gold/silver. You may find a system that works for both - great if you
do as it is likely robust then - but realistically you are probably better off with two different systems. Another analogy would be to treat all hours
of trading the same for something like ES, which you concluded is a bad idea in your session time video (lthanks for putting together that video btw -
loots of good takeaways in it).
Also, for stress testing any system I find this to be a very practical approach (eg if a long only system survives the last 20 big drops OOS, it may
be a winner).
I realize that not all system developers think in these terms, but please do keep it under consideration during the develpment of the optimization
options.. Again, I find it superior to the current % settings for IS/OOS/Verification, and it is an addition I feel others would find useful as well.
(Also, I do understand that you can hack a CSV file, but there are obviously lots of issues with this. Not only is this inconvenent, but you would
have to transform the data as you end up with price gaps etc etc.)
Many thanks. |