GSB Forums

Wish List

 Pages:  1    3    5

adcardoso01 - 28-12-2018 at 04:46 PM

Thx a lot for you effort to understand as I'm not totally familiar with GSB functionalities.

Yes, I'm talking about OOS%.

I understand that you are still grappling with validating several approaches. No worries.

Anyways... I was just brainstorming here.

All the best!

admin - 28-12-2018 at 05:20 PM

Quote: Originally posted by adcardoso01  
Thx a lot for you effort to understand as I'm not totally familiar with GSB functionalities.

Yes, I'm talking about OOS%.

I understand that you are still grappling with validating several approaches. No worries.

Anyways... I was just brainstorming here.

All the best!

GSB is greatly enriched by the ideas of the GSB community, and different perspectives are healthy because if we get improved approach - this flows through to our trading p/l

cyrus68 - 29-12-2018 at 12:11 AM

Quote: Originally posted by rws  
Be carefull with future peaks if you have bars endtime and using
them with the open in a system.

Quote: Originally posted by admin  
Quote: Originally posted by cyrus68  
Would it be possible to enable GSB to enter trades at the open of the bar instead of the close? i.e. the user will be able to select whether trades are executed at the open or the close of the bar. This will enable swing trading daily bars for stocks, without facing problematic execution issues at the brokerage.
Thanks

is this in the context of daily bars, or say 30 min bars you want to enter say at 830 instead of 900 on ES?
I think the concept is ok, but will come after the additional secondary filters. (work starting fairly soon)


I'm specifically referring to daily bars for stocks. If you are swing trading, using daily bars, a reversal trade at session close is very problematic.

admin - 29-12-2018 at 12:14 AM

Hi Cyrus, I think that can be done, but it will be after the secondary filters etc. I can see why you want the feature.

Central Price Data Repository

JasonT - 3-1-2019 at 05:20 PM

Hi Peter,

it is possible for GSB to supply, as an option, a central online directory of price data (maintained daily, weekly or monthly) and for GSB 'Data > Public Data Directory' to point to it?

Thanks,

Jason.

admin - 3-1-2019 at 05:58 PM

Quote: Originally posted by JasonT  
Hi Peter,

it is possible for GSB to supply, as an option, a central online directory of price data (maintained daily, weekly or monthly) and for GSB 'Data > Public Data Directory' to point to it?

Thanks,

Jason.

Where is the data going to come from? Likely there are legal issues if I supply the data. Best thing would be open a workspace with a indicator that writes the price files.
I dont mind data being stale, as it also gives a further un seen data period

JasonT - 3-1-2019 at 06:14 PM

Quote: Originally posted by admin  
Quote: Originally posted by JasonT  
Hi Peter,

it is possible for GSB to supply, as an option, a central online directory of price data (maintained daily, weekly or monthly) and for GSB 'Data > Public Data Directory' to point to it?

Thanks,

Jason.

Where is the data going to come from? Likely there are legal issues if I supply the data. Best thing would be open a workspace with a indicator that writes the price files.
I dont mind data being stale, as it also gives a further un seen data period


I'm not across licensing requirements with regard to the pricing data. I wonder if there is a difference if the data is kept contained within the application versus being available for anyone to download. I also wonder whether or not how the data is used is effected by the license ie if it is used for trading execution then it can't be used but if it is used for analysis then it can be? Just thoughts.

Also I agree with the unseen data, hence the multiple update periods suggested.

GSB based session template

JasonT - 3-1-2019 at 06:26 PM

Hi Peter,

As posted in another thread the concept you've introduced with the Price Data Multiplier, that enables you to turn an 'ES.1.Minute.@ES.D.CentralUsaTime.txt' file into a 30 min data stream by adding the multiplier (eg 30 min), is very helpful and saves a lot of time.

Is it possible to extend this concept further and include a GSB based price data session template?

This would different to the 'Trading-Periods > Times' filter which prevents entries outside that time window. It would emulate the Trade Station (for example) session template in that indicators and secondary filters that GSB uses only considers bars inside the GSB session that is applied to the Price Data used in its analysis. I suspect it would need to be applied consistently across every data stream being used for Opt Price Data, TPD, Verif Price Data, WF Price Data and WF TPD.

Thanks,

Jason.

admin - 3-1-2019 at 06:36 PM

Quote: Originally posted by JasonT  
Hi Peter,

As posted in another thread the concept you've introduced with the Price Data Multiplier, that enables you to turn an 'ES.1.Minute.@ES.D.CentralUsaTime.txt' file into a 30 min data stream by adding the multiplier (eg 30 min), is very helpful and saves a lot of time.

Is it possible to extend this concept further and include a GSB based price data session template?

This would different to the 'Trading-Periods > Times' filter which prevents entries outside that time window. It would emulate the Trade Station (for example) session template in that indicators and secondary filters that GSB uses only considers bars inside the GSB session that is applied to the Price Data used in its analysis. I suspect it would need to be applied consistently across every data stream being used for Opt Price Data, TPD, Verif Price Data, WF Price Data and WF TPD.

Thanks,

Jason.


You mean your data might be es 830 to 1515, but there is a global filter you can apply to make it 830 to 1500?
if data2 was @ym 24 hour, the filter 830 to 1500 would also apply.
If so I think this is an reasonable idea, but it wont happen until secondary filters are done

JasonT - 3-1-2019 at 09:51 PM

Quote: Originally posted by admin  


You mean your data might be es 830 to 1515, but there is a global filter you can apply to make it 830 to 1500?
if data2 was @ym 24 hour, the filter 830 to 1500 would also apply.
If so I think this is an reasonable idea, but it wont happen until secondary filters are done


Yes that's almost what I mean. I was thinking that you download all the data (say 24x7) for the instrument you want to build systems on then apply a filter to that, say 0830-1500. That means that you can download all the data you need in one data file and test your assumptions on that, rather than download data for 24x7, and one for 0830-1500, and one for 0900-1400 for example.

admin - 4-1-2019 at 12:06 AM

Quote: Originally posted by JasonT  
Quote: Originally posted by admin  


You mean your data might be es 830 to 1515, but there is a global filter you can apply to make it 830 to 1500?
if data2 was @ym 24 hour, the filter 830 to 1500 would also apply.
If so I think this is an reasonable idea, but it wont happen until secondary filters are done


Yes that's almost what I mean. I was thinking that you download all the data (say 24x7) for the instrument you want to build systems on then apply a filter to that, say 0830-1500. That means that you can download all the data you need in one data file and test your assumptions on that, rather than download data for 24x7, and one for 0830-1500, and one for 0900-1400 for example.

I see merit in this but @es.d is not the same as @es in that @es gives data on some holidays that @es.d doesnt.
Likely we can implement after secondary filters etc

JasonT - 4-1-2019 at 01:21 AM

Quote: Originally posted by admin  

I see merit in this but @es.d is not the same as @es in that @es gives data on some holidays that @es.d doesnt.
Likely we can implement after secondary filters etc


Noted. I agree that would make it trickier. I just did an @ES.D v @ES comparison earlier for my notes prior to posting the suggestion (see attached). The @ES.D session hours are limited by the Regular Session in a way that @ES is not - even if you use a 24x7 session template for @ES.D you get 08:30 to 15:15 Mon-Fri only (ie the Regular Session). This limitation can be emulated by using a session template on @ES equivalent to the @ES.D Regular Session but it doesn't account for any holidays that are automatically added by the @ES.D Regular Session.

Thanks for your consideration of the idea.

TradeStation9.5 - @ES.D v @ES and Different Session Times.JPG - 332kB

coccigelus - 1-2-2019 at 06:46 AM

Hello, I would like to have a couple of others folders in the Favorites. Let's say C & D.

admin - 1-2-2019 at 04:18 PM

Quote: Originally posted by coccigelus  
Hello, I would like to have a couple of others folders in the Favorites. Let's say C & D.

I have thought on this and would like it. Its going to make the GUI even bigger.
However there might be less need for all of this when we have a excel / acess or standalone app the digs into the metrics.

What Ive found is decent correlation of various in sample data to out of sample data. You can also use the systems on the left, my leaving them selected by the mouse. Its more crude but works.
Override original data can also be used.

c & d can be done but the answer is maybe. What would be nicer if we can soft code how many favorites we have. I dont know if that can be done but its the best option.

Evolving PT exit

Gregorian - 20-2-2019 at 12:50 PM

I'd like to request that PT exit be evolvable, as you did with the SLs.

Am seeing some good results by setting PT, but choosing what PT to set is just an educated guess right now. Having it genetically evolve would be great.

Bruce - 20-2-2019 at 01:21 PM

Quote: Originally posted by Gregorian  
I'd like to request that PT exit be evolvable, as you did with the SLs.

Am seeing some good results by setting PT, but choosing what PT to set is just an educated guess right now. Having it genetically evolve would be great.


Ditto.

MFE and MAE metrics would also be useful here.

admin - 20-2-2019 at 04:04 PM

We should be able to do GA PT
MFE & MAE as one of the custom fields
Not sure when it will happen as the next stage of GSB is a major one.

admin - 21-2-2019 at 04:02 PM

Are users interested in greater stats. IE a list of the amount each indicator is used.

Combined with favorites, this could be used to see what indicators performed best IN sample,
and then you compare to what performed best out of sample.

The idea would be to not use indicators that go well in sample, but not out of sample.

avatartrader - 24-2-2019 at 09:09 PM

Quote: Originally posted by TradingRails  
Quote: Originally posted by Gregorian  
I'd like to request that PT exit be evolvable, as you did with the SLs.

Am seeing some good results by setting PT, but choosing what PT to set is just an educated guess right now. Having it genetically evolve would be great.


Ditto.

MFE and MAE metrics would also be useful here.


I think it would be good for the Bars, Minutes exits to use GA as well for the same reasons. If I had to choose one, I would choose to have Bars use GA, since I generally like to use that more than exiting after n minutes.

admin - 24-2-2019 at 09:13 PM

Hi Avatar,
whats the context that you timed exits? I assume some sort of long term trading?
I suspect its a really poor exit and one of the other 7, or atr stop, close down day etc is better.

IQFeed data export formatting

engtraderfx - 17-3-2019 at 06:11 AM

IQFeed data format - Peter, i am using the iqfeed data tool to export data files (as for some reason Multicharts seems to truncate some data at start). However after a number of failed attempts keeps giving a text error when trying to import to GSB, I think the issue is the data is exported in reverse time (latest time at top). I did add new formatting for date & time but still gives error. Does GSB recognise this or could this be included?

Thanks, Dave

Example format below from ..

Date,Time,Open,High,Low,Close,Volume,Inc Vol
2019-03-15,17:00:00,58.72,58.73,58.65,58.69,490637
2019-03-15,16:30:00,58.72,58.73,58.70,58.72,488660
2019-03-15,16:00:00,58.74,58.75,58.70,58.71,487080
2019-03-15,15:30:00,58.71,58.74,58.69,58.74,484248
2019-03-15,15:00:00,58.80,58.81,58.66,58.71,478347
2019-03-15,14:30:00,58.86,58.89,58.76,58.81,465099
2019-03-15,14:00:00,58.77,58.87,58.72,58.87,437134

IQfeed time & sales.JPG - 139kB

admin - 17-3-2019 at 06:32 PM

Quote: Originally posted by engtraderfx  
IQFeed data format - Peter, i am using the iqfeed data tool to export data files (as for some reason Multicharts seems to truncate some data at start). However after a number of failed attempts keeps giving a text error when trying to import to GSB, I think the issue is the data is exported in reverse time (latest time at top). I did add new formatting for date & time but still gives error. Does GSB recognise this or could this be included?

Thanks, Dave

Example format below from ..

Date,Time,Open,High,Low,Close,Volume,Inc Vol
2019-03-15,17:00:00,58.72,58.73,58.65,58.69,490637
2019-03-15,16:30:00,58.72,58.73,58.70,58.72,488660
2019-03-15,16:00:00,58.74,58.75,58.70,58.71,487080
2019-03-15,15:30:00,58.71,58.74,58.69,58.74,484248
2019-03-15,15:00:00,58.80,58.81,58.66,58.71,478347
2019-03-15,14:30:00,58.86,58.89,58.76,58.81,465099
2019-03-15,14:00:00,58.77,58.87,58.72,58.87,437134


mc truncate data at start likely due to bars back settings. Try making it 1 (or 0??)
That could be the simplest fix.

engtraderfx - 26-3-2019 at 04:43 PM

Peter, didn’t help unfortunately, does change basic data chart, have contacted MC for help.

admin - 26-3-2019 at 05:19 PM

Quote: Originally posted by engtraderfx  
Peter, didn’t help unfortunately, does change basic data chart, have contacted MC for help.


Let me know how you get on. How much is missing from mc.
often its not an issue, esp as first part of data often is not liquid and not suitable for trading.
can iqfeed order be made old to new?

engtraderfx - 27-3-2019 at 05:53 AM

I managed to get it down now to a few months by reloading data, eg CL data from IQFeed starts on 19/9/2006 with MC showing back to 18/12/2006 so pretty close now. Have sent query to IQ on data order. I notice in my systems some have a large drawdown in that first 6 mths vs rest ( eg 3 to 4K vs around 2K for rest of data), was wondering if its reasonable to ignore that early data.

admin - 27-3-2019 at 03:31 PM

Quote: Originally posted by engtraderfx  
I managed to get it down now to a few months by reloading data, eg CL data from IQFeed starts on 19/9/2006 with MC showing back to 18/12/2006 so pretty close now. Have sent query to IQ on data order. I notice in my systems some have a large drawdown in that first 6 mths vs rest ( eg 3 to 4K vs around 2K for rest of data), was wondering if its reasonable to ignore that early data.

From memory most cl systems were bad in 2006. You can check on the demo CL system. The data was also a bit thin. So 18/12/2006 should be fine.

engtraderfx - 28-3-2019 at 06:58 AM

Peter, I got a response from MC today with a hotfix that helped my reload data back to first data date. If anyone on MC wants the patch let me know.

For example,
ES 1m data back to 6/9/2005
CL 1m data back to 19/9/2006

Chrs, Dave


admin - 28-3-2019 at 03:53 PM

Quote: Originally posted by engtraderfx  
Peter, I got a response from MC today with a hotfix that helped my reload data back to first data date. If anyone on MC wants the patch let me know.

For example,
ES 1m data back to 6/9/2005
CL 1m data back to 19/9/2006

Chrs, Dave


Hi Dave, thanks for the update

traderusa - 28-3-2019 at 08:48 PM

GSB has some awesome features that no one else has. Things like being able to test 1000's of systems, to see objectively what works best.

The method to do this is fairly simple, but could it either have keyboard shortcuts, that programs like autoit could use to automate or could pre configured commands be done in gsb.

for example
build 10,000 systems
when done, put into statsA
then change nth from do no trade to trade
Then put into stats B etc

admin - 29-3-2019 at 01:25 AM

Quote: Originally posted by traderusa  
GSB has some awesome features that no one else has. Things like being able to test 1000's of systems, to see objectively what works best.

The method to do this is fairly simple, but could it either have keyboard shortcuts, that programs like autoit could use to automate or could pre configured commands be done in gsb.

for example
build 10,000 systems
when done, put into statsA
then change nth from do no trade to trade
Then put into stats B etc


Excellent idea, and we can and will do it. Keep looking in the beta builds section details when its closer.

traderusa - 5-4-2019 at 01:13 AM

Very impressive with the speed you got such a significant feature added - macro's. You have exceeded my expectations. :)

coccigelus - 8-4-2019 at 03:52 AM

Peter,

I am still exploring the custom indicator tool which I believe is a real important feature:

- Right now custom indicators is not currently supported for multi data optimization
- Validation for the reasons above is not possible.

The best solution would be have the feature to be able to import directly the function. But I understand that this is (probably) a lot of work.

However one thing that I think would be a very acceptable advanced features with little programming work required, would be import the value of the custum indicator for each data stream with which we are interested to work. So let’s do an example:

We want to optimize ES30 SPX30 and we want to validate on Nq30 – NDX30.

Using the code generated by the software with little modifications we could run the custum indicators 4 times on each data stream set as data1 in order to retrieve the value needed for each of the four data streams.

Once finished the process import the custum indicator that GSB should do automatically for each data stream.(checking each folder created into Indicator data folder and checking the name of the custom function) So in this case, once GSB initialize, should raise a warning only when one specific data stream does not have the value for the required custum indicator and/or data stream required, letting GSB users to have available all the multidata stream and validation featureas available.


2222.JPG - 23kB

admin - 8-4-2019 at 03:57 AM

Quote: Originally posted by coccigelus  
Peter,

I am still exploring the custom indicator tool which I believe is a real important feature:

- Right now custom indicators is not currently supported for multi data optimization
- Validation for the reasons above is not possible.

The best solution would be have the feature to be able to import directly the function. But I understand that this is (probably) a lot of work.

However one thing that I think would be a very acceptable advanced features with little programming work required, would be import the value of the custum indicator for each data stream with which we are interested to work. So let’s do an example:

We want to optimize ES30 SPX30 and we want to validate on Nq30 – NDX30.

Using the code generated by the software with little modifications we could run the custum indicators 4 times on each data stream set as data1 in order to retrieve the value needed for each of the four data streams.

Once finished the process import the custum indicator that GSB should do automatically for each data stream.(checking each folder created into Indicator data folder and checking the name of the custom function) So in this case, once GSB initialize, should raise a warning only when one specific data stream does not have the value for the required custum indicator and/or data stream required, letting GSB users to have available all the multidata stream and validation featureas available.


I will ask programmer about this.

admin - 8-4-2019 at 06:29 AM

Hi coccigelus
this can and will be done, but im not sure when. Trying to get the new secondary filters in GSB 2.0. So likely soon after this.

coccigelus - 8-4-2019 at 09:11 AM

Excellent, Thank You!

Marc7200 - 10-4-2019 at 09:47 AM

Hi Peter,
It would be nice if you would not have to create price data for every time frame.
Since you already have a contract list it should be possible to eliminate the price data list if the naming is the same as in the contract list.
If we only use 1 Minute price data files it would then be possible to simple change time frames 5min , 10min,.... GSB could do the work in the background instead saving this information in a price data file?

Nice to have would be the option to test systems for example by saying 10-90min in increment of 5min and run all the possible time frames without having to create so many price data files.

Also it would be helpful if there is one central location for price files not one for worker one for standalone and one for manager.

Just some ideas for improvement.

Thanks
Marc

admin - 10-4-2019 at 04:15 PM

Quote: Originally posted by Marc7200  
Hi Peter,
It would be nice if you would not have to create price data for every time frame.
Since you already have a contract list it should be possible to eliminate the price data list if the naming is the same as in the contract list.
If we only use 1 Minute price data files it would then be possible to simple change time frames 5min , 10min,.... GSB could do the work in the background instead saving this information in a price data file?

Nice to have would be the option to test systems for example by saying 10-90min in increment of 5min and run all the possible time frames without having to create so many price data files.

Also it would be helpful if there is one central location for price files not one for worker one for standalone and one for manager.

Just some ideas for improvement.

Thanks
Marc


Hi Marc
Good to hear from you.
this can be done already
https://trademaid.info/gsbhelp/Data1.html
I probably should make this more obvious in the docs.

location of files.
With workers, you dont need to do anything.

Managers and standalone should be configured to use the same location. This should be the default config.

Marc7200 - 14-4-2019 at 12:26 PM

Hello Peter,
Is there by chance a video showing how this is done?
Thanks for the feedback and great work your doing!
Marc

admin - 14-4-2019 at 04:12 PM

Quote: Originally posted by Marc7200  
Hello Peter,
Is there by chance a video showing how this is done?
Thanks for the feedback and great work your doing!
Marc

Thanks for your comments.
I will update the docs in a few days. Problem with videos is GSB 2.0 is in the pipeline, and this means many videos should be re done.
The main visual change I expect is new secondary filters(SF), optional but default of the existing SF to be 'locked' to each contract.
The logic in this is the number1 error GSB uses make is wrong SF.
Either the wrong closed, or all SF set to true.
All SF to be in the same list, including the non normalized
Maybe all SF to only be the closed variants, and then make the rest as tertiary filters

Marc7200 - 16-4-2019 at 07:33 PM

Wonderful looking forward to it! :)

waldocktrades - 18-4-2019 at 06:36 AM

Peter, maybe this should be posted on the wish list.
It would be great to run a macro that culls the weak performers between Nth IS/OS, then double-blind date period, cull weak performers, run remainder on more recent double-blind. Then, we could manually go through the survivors using data to current date.
I typically look at average trade. It would be REALLY nice to be able to compare individual system degradation, rather than a cutoff value. I typically delete everything below $125 as too small of an average trade. I'll also delete systems below a given profit threshold based on the general population. It would be really nice to know on a system by system basis and say only keep OS systems with an average trade within 10% of their IS avg trd.
After all, the point of this pursuit is to find the most consistent algos over time.
52.06 is working fine. Good call.
Best, Andy

admin - 18-4-2019 at 05:35 PM

Quote: Originally posted by waldocktrades  
Peter, maybe this should be posted on the wish list.
It would be great to run a macro that culls the weak performers between Nth IS/OS, then double-blind date period, cull weak performers, run remainder on more recent double-blind. Then, we could manually go through the survivors using data to current date.
I typically look at average trade. It would be REALLY nice to be able to compare individual system degradation, rather than a cutoff value. I typically delete everything below $125 as too small of an average trade. I'll also delete systems below a given profit threshold based on the general population. It would be really nice to know on a system by system basis and say only keep OS systems with an average trade within 10% of their IS avg trd.
After all, the point of this pursuit is to find the most consistent algos over time.
52.06 is working fine. Good call.
Best, Andy


Hi Andy
I like what you propose. A number of users are saying some similar things, but from very different angles. This is similar to WF efficiency thats in EWFO.
GSB macros does support metrics/favorites, but Ive never even looked or documented it. This feature in the macros was not intuitive and I want it revamped.
We cant yet filter on fitness ration IS/OOS, but I want to do this.
Programmer says 52.06 has some significant bug in contract section, and all uses should be on 52.08. However I never noticed any bug.
Enjoy Easter.

admin - 19-4-2019 at 12:21 AM

Hi Andy
this is favorite in macro. I have not used it yet.
You can also remove from favorites too.

How I think it works is your criteria is added into favorite.
Then say you change dates and or nth,
then you run it again, and it will remove the systems that dont pass the metrics.

So if your first metric was pf >2,
you then change nth, and run pf >2
what remains is only systems that have pf2 with nth being true and not true.

I have never used this, but was told this by the programmer verbally.




macro-fav.png - 22kB

waldocktrades - 22-4-2019 at 07:10 AM

I do a lot of manual sorting based on the same ideas. Unfortunately, it forces us into thresholds, rather than being able to compare individual algo IS/OS.
The current process works. My current algos represent the general populations, as they're designed to.
My belief is that being able to track the individual algo IS/OS will allow us to be able to move further up the performance ladder.

admin - 22-4-2019 at 03:57 PM

Quote: Originally posted by waldocktrades  
I do a lot of manual sorting based on the same ideas. Unfortunately, it forces us into thresholds, rather than being able to compare individual algo IS/OS.
The current process works. My current algos represent the general populations, as they're designed to.
My belief is that being able to track the individual algo IS/OS will allow us to be able to move further up the performance ladder.

I like what you propose.
Short term, here is a possibility that you can modify to suit you.
I use 2000 to 2050630 nth 1, nth day 80.
Then turn all dates and nth to all. Then get the most linear systems using pearsons or pearsons date. You can then put a system into favoures, Run a macro with stats to get the ratio. First change nth to no trade again, dates to trade, run stats a,c then nth to trade, statsB, dates to no trade, nth all, stats d

Weakness is stats c,d are comparing years that are not equal.

Bottom line is we will code the feature in GSB, but need to get the first GSB 2.0 (at least) first

avatartrader - 8-5-2019 at 12:18 AM

Just a small feature request:

It would helpful if there was an on-screen label or other indication of how many systems were selected in the Unique-Systems grid - for example, a status bar docked to the bottom of the panel containing the tab control hosting the grid, or whatever is appropriate. Probably how I would do it is to use a status bar control with a status label that only displays the selected total when the selected items are > 1 (e.g. 1000 of ).

When there is a very large number of systems, it is often hard to tell how many are being selected for walk forward, etc. and this would help when the process prescribes "select approximately x systems", etc., particularly when you need to relax some of the criteria like NP/DD and so on to select an ample amount for WF testing.

admin - 8-5-2019 at 12:33 AM

Quote: Originally posted by avatartrader  
Just a small feature request:

It would helpful if there was an on-screen label or other indication of how many systems were selected in the Unique-Systems grid - for example, a status bar docked to the bottom of the panel containing the tab control hosting the grid, or whatever is appropriate. Probably how I would do it is to use a status bar control with a status label that only displays the selected total when the selected items are > 1 (e.g. 1000 of ).

When there is a very large number of systems, it is often hard to tell how many are being selected for walk forward, etc. and this would help when the process prescribes "select approximately x systems", etc., particularly when you need to relax some of the criteria like NP/DD and so on to select an ample amount for WF testing.

I agree. Excel has this. For now put them into favorites and it will give you the count. I will see if this can be done.
Macros I hope will do this in an up coming build.

Data Visualisation

JasonT - 25-5-2019 at 04:10 PM

One of the challenges I have is understanding what the impact is of changes I make to settings in the Contracts List and Sessions List have on the data that GSB uses to test systems against. For example changes to MOC, Last bar or Exch Time on the Contracts List and the open and close time on the session list. I can imagine what they are supposed to do but I am not sure that what I am expecting is what is happening. As a result it reduces the confidence I have in applying GSB generated systems to tradestation.

Is it possible to embed a chart visualisation tab to GSB to enable you to compare what data GSB is testing a system on to what you've got set up on your trading software?

Perhaps it could be available using a Chart tab, next to the settings tab. Maybe when you click on the Trading Data or Opt Data that is the chart data that is shown. Perhaps also (later) if you were to select a particular system that had been tested any indicators would be plotted and the entries and exits could be plotted to enable even more effective debugging of the translation of systems between GSB and trading software.

Thanks for your consideration.

Jason.

Data Visualisation.png - 98kB

admin - 26-5-2019 at 06:07 PM

Quote: Originally posted by JasonT  
One of the challenges I have is understanding what the impact is of changes I make to settings in the Contracts List and Sessions List have on the data that GSB uses to test systems against. For example changes to MOC, Last bar or Exch Time on the Contracts List and the open and close time on the session list. I can imagine what they are supposed to do but I am not sure that what I am expecting is what is happening. As a result it reduces the confidence I have in applying GSB generated systems to tradestation.

Is it possible to embed a chart visualisation tab to GSB to enable you to compare what data GSB is testing a system on to what you've got set up on your trading software?

Perhaps it could be available using a Chart tab, next to the settings tab. Maybe when you click on the Trading Data or Opt Data that is the chart data that is shown. Perhaps also (later) if you were to select a particular system that had been tested any indicators would be plotted and the entries and exits could be plotted to enable even more effective debugging of the translation of systems between GSB and trading software.

Thanks for your consideration.

Jason.

You mean visualization of the charts, and indicators?
I need to think on this but I see some merit to it.

There is however extensive diagnostics built into gsb.
The main use is to compare ts to gsb. asci files written and can be compared in windiff
see this
files written in Data\Debugs



debugmode.png - 14kB

JasonT - 1-6-2019 at 08:56 PM

Quote: Originally posted by admin  

You mean visualization of the charts, and indicators?


Yes. Thanks for the consideration.

coccigelus - 28-6-2019 at 05:16 AM

Hello Peter,

I have a wish list request for PA:

I would like to get incorporated a metric that account the weight of each system in the generation of NP/maxDD AT the portfolio level, TAKING in consideration the time since the first system in the portfolio traded.

Example: (here considering 2018 end of year keeping simple example)

System A: started to trade in the 2000 with a NP of 100k and MaxDD of 10k.

System B: started to trade in the 2009 with a NP of 100k and MaxDD of 10k.


In this case the weight of system A related to NP & DD would be 1 for each metric. (weightDD and weightNP). However the weight for system B would be 2 for weightDD and weightNP.
So the system that trade at earlier date would be always 1 for both metrics.

Calculation SYS A : 100 NP/18 Years= 5.555 ///// norm: 5.555/5.555 = 1 // Same process for DD calculation

Calculation SYS B : 100 NP/9 Years= 11.111 ///// norm: 11.111/5.555 (sys A divisor) = 2 // Same process for DD calculation


I think would be an add on extremely useful in the construction of balanced portfolio where We want balanced weight systems within it that take in consideration the starting time of the portfolio.

coccigelus - 28-6-2019 at 05:27 AM

The request is meant for PA PRO.

admin - 1-7-2019 at 05:41 AM

Quote: Originally posted by coccigelus  
The request is meant for PA PRO.


I will look into this later in the week.

coccigelus - 1-7-2019 at 05:44 AM

Thank You!

admin - 3-7-2019 at 08:27 PM

Quote: Originally posted by coccigelus  
Hello Peter,

I have a wish list request for PA:

I would like to get incorporated a metric that account the weight of each system in the generation of NP/maxDD AT the portfolio level, TAKING in consideration the time since the first system in the portfolio traded.

Example: (here considering 2018 end of year keeping simple example)

System A: started to trade in the 2000 with a NP of 100k and MaxDD of 10k.

System B: started to trade in the 2009 with a NP of 100k and MaxDD of 10k.


In this case the weight of system A related to NP & DD would be 1 for each metric. (weightDD and weightNP). However the weight for system B would be 2 for weightDD and weightNP.
So the system that trade at earlier date would be always 1 for both metrics.

Calculation SYS A : 100 NP/18 Years= 5.555 ///// norm: 5.555/5.555 = 1 // Same process for DD calculation

Calculation SYS B : 100 NP/9 Years= 11.111 ///// norm: 11.111/5.555 (sys A divisor) = 2 // Same process for DD calculation


I think would be an add on extremely useful in the construction of balanced portfolio where We want balanced weight systems within it that take in consideration the starting time of the portfolio.



Im not 100% clear what you want.
Pretend we made the pa files only from the dates systems went live, and we maximise the portfolio to find best np/dd - is that what you want?
But have reporting that includes all dates

coccigelus - 4-7-2019 at 01:09 PM

See the excel attached.

This doesn't want to be an efficient way to bet for each component as is already explained nicely in many books related to size - betting. This is an idea that want to be efficient in a scenario where we have x systems with different performance AND we want to reach a calibrated optimum where a component of the portfolio may fail.

Again this is just an idea. Perhaps It would be more useful to use the AVG 5 MAXDD for each system instead of just the MAXDD which however can't be obtained through the strategy performance report.

At the beginning just put the metrics from your backtest: NP - %MAXDD - Years of backtesting.
The column to calibrate the whole pack is the net profit which would also mean regulate the size of each component. This probably regarding futures could be achieved through micro contracts. I also suspect using MAXDD would cause massive spike changing the netprofit that could be smoothed using an avg of MaxDD.

Attachment: Login to view the details


admin - 5-7-2019 at 02:13 AM

Quote: Originally posted by coccigelus  
Hello Peter,

I have a wish list request for PA:

I would like to get incorporated a metric that account the weight of each system in the generation of NP/maxDD AT the portfolio level, TAKING in consideration the time since the first system in the portfolio traded.

Example: (here considering 2018 end of year keeping simple example)

System A: started to trade in the 2000 with a NP of 100k and MaxDD of 10k.

System B: started to trade in the 2009 with a NP of 100k and MaxDD of 10k.


In this case the weight of system A related to NP & DD would be 1 for each metric. (weightDD and weightNP). However the weight for system B would be 2 for weightDD and weightNP.
So the system that trade at earlier date would be always 1 for both metrics.

Calculation SYS A : 100 NP/18 Years= 5.555 ///// norm: 5.555/5.555 = 1 // Same process for DD calculation

Calculation SYS B : 100 NP/9 Years= 11.111 ///// norm: 11.111/5.555 (sys A divisor) = 2 // Same process for DD calculation


I think would be an add on extremely useful in the construction of balanced portfolio where We want balanced weight systems within it that take in consideration the starting time of the portfolio.


What going to happen when systems are new, or going for just a few months?
I suspect there will be issues when we do this.

coccigelus - 5-7-2019 at 08:59 AM

Did You see the excel file? It seems no according to the answer received..

Carl - 6-7-2019 at 02:12 AM

Hi coccigelus,

How are you going to maintain the numbers in your Excel sheet?
Monitor the performance of the systems A,B,C and update the statistics in Excel to get the new weights?
And repeat this step every month for all systems?

coccigelus - 9-7-2019 at 09:48 AM

Hello Carl,

Please accept my apologize for late answer I had a long week end. Yes what You have mentioned is my thought. Probably You can update even less frequently if You are not going to add any new system or You do not get any new major change of the metrics used in the excel file (NP-Years-Maxdd).

However I would like to use a different metric than MaxDD which at the end of the day is just a spike. For instance, to declare the exhaustion of a system (fail) I am using a MaxDD retrieved from a montecarlo simulation using the Avg win/loss and their SD over N simulations and then I am using this metric to eventually shut it down a system that suffered a notable deterioration of the performance. This make a lot of sense If You are sure Your system is not overoptimized otherwise You are going to add aggravation at your account. Another parameter that I would like to add in the equation is the correlation of each system.

Let me know If You would be interested to discuss it in a greater detail.


Carl - 10-7-2019 at 03:16 AM

Hi coccigelus,

Your method doesn't include the correlation between the different strategies.
I think correlation is the most important in portfolio building.

Instead of monitoring every strategy separately you can also periodic rebalance your portfolio by using PA.
For example rebalance every month or every 10% change in capital so see which strategies are selected by PA for the new portfolio.
This way a deteriorating strategy will be replaced by anothebetter one.

coccigelus - 10-7-2019 at 08:33 AM

Hi Carl,

I would love to agree with You regarding correlation but here the reason why I do not think should be given more relevance (if any) than other variables mentioned:

Excerpt from Vince book - The handbook of portfolio Mathematics:

...
Here, we are measuring the correlation of binomially distributed outcomes(heads or tails), and the outcomes are random, not generated byhuman emotions. In other types of environments, such as market prices, correlation coefficients begin to exhibit a very dangerous characteristic. When a large move occurs in one component of the pairwise combination, there is a tendency for correlation to increase, often very dramatically. Additionally, since I am speaking here of, say, market A making the large move, and its correlation to B, then too can I expect A and C to see an increase in their correlation coefficient in those time periods of the large move, and hence between B and C during those periods where I see a large move in A. In short, when the big moves come, things tend to line up and move together (to a far greater degree than the correlation coefficient implies).
In incidental time periods, which are most time periods, the correlation coefficients tend back toward zero.
....
////////

The correlation of components along a time horizon does not provide any meaningful insight on the bet size. What provide the insight is when there are moves from a component/s of the portfolio beyond 3 sigma. When that event happens than the correlation We thought was the case dramatically and tragically (if You rely on that for the bet size) increase toward 1.
The correlation data provided by PA is very useful in relation to the detection of system that basically do the same thing.




Carl - 12-7-2019 at 03:49 AM

You can also use more diversified types of strategies.

Trendfollowing and mean reverting strategies.
Day trading and swing trading.
This way you can try to keep the correlation at lower levels.

Daniel UK1 - 8-10-2019 at 06:42 AM

I think it would be interesting to be able to produce random clones of price for verification on a price series as we can today, BUT with a possibility to adjust the clone 1-10 toward more mean reversion or trending characteristics.. i think it could make it possible to test robustness depending on market changes for the symbol in question... perhaps i am out of depth there.. but i think it could open up to further testing possibilities

Thoughts?

admin - 8-10-2019 at 07:12 PM

Quote: Originally posted by Daniel UK1  
I think it would be interesting to be able to produce random clones of price for verification on a price series as we can today, BUT with a possibility to adjust the clone 1-10 toward more mean reversion or trending characteristics.. i think it could make it possible to test robustness depending on market changes for the symbol in question... perhaps i am out of depth there.. but i think it could open up to further testing possibilities

Thoughts?

In excel, can you make such a file, and do some testing to see if its superior to the current method?
Your request for the directory tree of contracts got added to the job que today, but the job que for programmer #2 is bigger than normal as he took leave and just got back. My contracts section is a mess thats hard to navigate, so I like the idea.

Sten - 15-11-2019 at 03:27 AM

Hi Peter,

I want to be able to do this in GSB:

Run a macro that for every system in Fav.A does this:
* saves system into .gsbsystem file somewhere on disk;
* saves system statistics (Full Period Net Profit, e.t.c.) somewhere on disk;
* runs "Genetic Algorithm to EWFO" to prepare EWFO intermediate files;
* calls an external command to process this data (for example, runs a python script with some parameters).

The idea is that I want to be abel to run a Python script for every pre-selected system in Fav.A, so that this script can automatically do EWFO cluster-analysis and, maybe, do some other tests to assess systems robustness. And then this script produces only .gsbsystem files that pass some formal robustness tests.

This should allow users to generate fully automatic workflows using GSB + EWFO.

Currently I can only run "Genetic Algorithm to EWFO" for all systems in Fav.A as a one single operation from a macro (but this exhausts disk space quickly). And there is no option to run an external command for every cell, and no macro command or command parameter to save .gsbsystem file on disk.

Probably, for the start, it would be nice to add a new parameter to WalkForward macro command, something like "run an external command after WF finishes: python.exe somescript.py %EWFO_output_dir%". This should allow user to write a script that runs EWFO, checks the results and then deletes EWFO intermediate files so that preserve the disk space.

Then we can add to this an ability to save .gsbsystem file on disk and export system params. from a macro command.

admin - 15-11-2019 at 04:30 AM

Quote: Originally posted by Sten  
Hi Peter,

I want to be able to do this in GSB:

Run a macro that for every system in Fav.A does this:
* saves system into .gsbsystem file somewhere on disk;
* saves system statistics (Full Period Net Profit, e.t.c.) somewhere on disk;
* runs "Genetic Algorithm to EWFO" to prepare EWFO intermediate files;
* calls an external command to process this data (for example, runs a python script with some parameters).

The idea is that I want to be abel to run a Python script for every pre-selected system in Fav.A, so that this script can automatically do EWFO cluster-analysis and, maybe, do some other tests to assess systems robustness. And then this script produces only .gsbsystem files that pass some formal robustness tests.

This should allow users to generate fully automatic workflows using GSB + EWFO.

Currently I can only run "Genetic Algorithm to EWFO" for all systems in Fav.A as a one single operation from a macro (but this exhausts disk space quickly). And there is no option to run an external command for every cell, and no macro command or command parameter to save .gsbsystem file on disk.

Probably, for the start, it would be nice to add a new parameter to WalkForward macro command, something like "run an external command after WF finishes: python.exe somescript.py %EWFO_output_dir%". This should allow user to write a script that runs EWFO, checks the results and then deletes EWFO intermediate files so that preserve the disk space.

Then we can add to this an ability to save .gsbsystem file on disk and export system params. from a macro command.


re - saves system statistics (Full Period Net Profit, e.t.c.) somewhere on disk;
Would the save trade list do for this? or all the details in the performance tab?

Sten - 15-11-2019 at 11:10 AM

Quote: Originally posted by admin  
re - saves system statistics (Full Period Net Profit, e.t.c.) somewhere on disk;
Would the save trade list do for this? or all the details in the performance tab?


Yes, list of trades is enough - if needed the script can calculate stats from the list of trades (however it would be convenient to have all the parameters that are listed in Unique-Systems window: F-F, NP-F, DD-F, AT-F e.t.c. so that not to calculate them again. But that is not required.).

The only catch is that an external script needs the way to tell which trades came from In-Sample period and which are from OOS period. As, obviously, these are two different statistics which need to be analyzed separately.

admin - 15-11-2019 at 03:22 PM

Quote: Originally posted by Sten  
Quote: Originally posted by admin  
re - saves system statistics (Full Period Net Profit, e.t.c.) somewhere on disk;
Would the save trade list do for this? or all the details in the performance tab?


Yes, list of trades is enough - if needed the script can calculate stats from the list of trades (however it would be convenient to have all the parameters that are listed in Unique-Systems window: F-F, NP-F, DD-F, AT-F e.t.c. so that not to calculate them again. But that is not required.).

The only catch is that an external script needs the way to tell which trades came from In-Sample period and which are from OOS period. As, obviously, these are two different statistics which need to be analyzed separately.

worst case could the external script could be programed to have the oos date of say 2015.6.30 in it?

admin - 15-11-2019 at 04:29 PM

Hi Sten,
Assuming we do what you request, are you sure you are happy with your workflow? IE test manually. I would not want to commit to this to find it not used.
Users like you with unique requirements make my job harder, but are the very things that collectively enrich GSB to make it even better.
Hence you are valued.

Sten - 16-11-2019 at 04:24 AM

Quote: Originally posted by admin  
worst case could the external script could be programed to have the oos date of say 2015.6.30 in it?


Yes, in the worst case the script could be programmed with hard-coded IN and OOS dates. Actually, list of trades and system stats are the lowest priority items in my feature request. I can leave even without them.

The priorities are as following:

- An ability to run an external script with parameters from a macro when each WFO tests finishes. That already allows me to do some automation [Highest Priority].
- An ability to export the system being processed into .gsbsystem file (I can use AutoSave feature to automatically save all most-interesting systems and then use system ID to find the system on disk from a script). So in the worst case I can leave without this feature. [Middle Priority]
- Export list of trades and/or system statistics into external file from a macro for every WFO. Since I'm able to filter and select best systems from a macro, and place them into Fav.A, I can live without access to system stats in an external script. Also, I looked into uncompressed .gsbsystem file and found it already includes all system statistics for Full and Training periods, and the file is in a JSON format. I didn't find stats for test segment inside .gsbsystem file, probably as I'm using "Training: 100% with Nday: 80 settings". Anyway, this item is [Lowest Priority].

So, what I need the most is an ability to run an external script to process every WFO test results from a macro.


Quote: Originally posted by admin  
Hi Sten,
Assuming we do what you request, are you sure you are happy with your workflow? IE test manually. I would not want to commit to this to find it not used.
Users like you with unique requirements make my job harder, but are the very things that collectively enrich GSB to make it even better.
Hence you are valued.


That's a valid point. Surely, you can wait while I finish GSB Trial version evaluation before implementing all this (but just to add a parameter to run an external command should be extremely easy).

Currently I am rerunning the process from the scratch. And I'm waiting for the results. I'll probably report soon a few more severe bugs I noticed.

admin - 16-11-2019 at 05:39 AM

Hi Sten
are you saying after every wf ->ewfo we run a exe?
its simplier to run all the wf via the macro, and the macro runs your exe after that.
Your exe could sweep all the folders and do its stuff.
very messy to do it after each wf as its outside the scope of what macros do - if done the other way.
Plus the macro programmer is not the same programmer as did gsb wf - so out side his area of expertise.


Sten - 16-11-2019 at 06:42 AM

Quote: Originally posted by admin  
Hi Sten
are you saying after every wf ->ewfo we run a exe?
its simplier to run all the wf via the macro, and the macro runs your exe after that.
Your exe could sweep all the folders and do its stuff.
very messy to do it after each wf as its outside the scope of what macros do - if done the other way.
Plus the macro programmer is not the same programmer as did gsb wf - so out side his area of expertise.


Hi, Peter,

Yes, ideally I want to run an exe after each WF is finished. The problem with running all WF and then running a macro is that we can run out of disk space before the process is finished.

Let's do a quick calculation. Right now I have one system exported from GSB to EWFO, and ewfoFiles\20191114-122400-417309-l7X2q folder with intermediate EWFO binary files consumes 362 Mb disk space.

Now, let's assume I want to do a cluster analysis for top 250 systems from Fav.A, and I run a macro that does "Genetic Algorithm WF to EWFO" for all 250 systems in Fav.A and then runs an external exe file.

I need at least:

362 Mb * 250 == 90500 Mb == 88.38 Gb

88.38 Gb of free disk space for this process. And what if I want to run EWFO on top 1000 or top 2000 systems? Free disk space requirements go up quickly.

Surely, in practice I can find around 100 Gb disk space to process top 250 systems. So if you just add a separate macro command to run an exe file, that would already be some sort of solution.

But, ideally, I prefer to be able to run an exe after every WF finishes so that to have an option to delete intermediate EWFO files and to free up a disk space.

admin - 18-11-2019 at 03:04 AM

Hi Sten.

you could massively cut down the amount of WF you do. When you break down to families
see https://trademaid.info/gsbhelp/Createupdatefamily.html

Disk space is now very cheap too, do I dont see the issue of 88gb.
If you want speed, last I checked - nothing beats a samsung m2 ssd as far as bang for buck goes.
minor problem with deleteing files, is if you want to refer to them again - they are gone. You could also move to backup storage.

Sten - 18-11-2019 at 03:17 AM

Hi Peter,

Ok, that's fine. Thanks for tip on using Families.

Sten - 18-11-2019 at 03:32 AM

So, to draw conclusion from our discussion, I need the following:

- A macro command to run an external .exe file;
- A macro command to save Fav.A / Fav.B strategies into some folder on disk;
- Possibly an option to disable showing a shell window when "Genetic Algorithm to EWFO" finishes (I did not test it on multiple strategies and from a macro, but when I run "Genetic Algorithm to EWFO" on one strategy from a GUI, it shows a shell window in the end).

admin - 18-11-2019 at 03:39 AM

Hi Sten, the disable shell has been done. I think its in the current ewfo, but if not I just need to upload the new version. Please confirm
Im open to all your requests, but if you use the families, wf them most of your task is done.
Will discuss the finer points of this with the programmer tomorrow.

Sten - 18-11-2019 at 03:44 AM

Peter, yes EWFO now has a --silent option that disables a shell window. That's ok.

I was referring to the "Genetic Algorithm to EWFO" command in GSB which also shows a shell window in the end. But I did not test how this works from a macro command, so do not mind for now. We can return to this item later if needed.

admin - 18-11-2019 at 06:43 PM

Hi Sten
my reply in CAPS
- An ability to run an external script with parameters from a macro when each WFO tests finishes. That already allows me to do some automation [Highest Priority].
YOU DONT NEED THIS. JUST WAIT TILL ALL WF ARE DONE. THEN MAKE A SCRIPT THAT SCANS C:\Program Files (x86)\TradeStation 9.5\WFO\data

- An ability to export the system being processed into .gsbsystem file (I can use AutoSave feature to automatically save all most-interesting systems and then use system ID to find the system on disk from a script). So in the worst case I can leave without this feature. [Middle Priority]

I COULD ADD THIS INTO MACROS, THOUGH SHORT TERM MANUAL OPERATION SHOULD BE OK.


- Export list of trades and/or system statistics into external file from a macro for every WFO. Since I'm able to filter and select best systems from a macro, and place them into Fav.A, I can live without access to system stats in an external script. Also, I looked into uncompressed .gsbsystem file and found it already includes all system statistics for Full and Training periods, and the file is in a JSON format. I didn't find stats for test segment inside .gsbsystem file, probably as I'm using "Training: 100% with Nday: 80 settings". Anyway, this item is [Lowest Priority].
THIS CAN BE DONE

So, what I need the most is an ability to run an external script to process every WFO test results from a macro.
PLEASE CONFIRM YOUVE TESTED YOUR WORKFLOW, AND REALLY WANT THIS DONE.

Sten - 19-11-2019 at 11:16 AM

> YOU DONT NEED THIS. JUST WAIT TILL ALL WF ARE DONE. THEN MAKE A SCRIPT THAT SCANS

Well, there is a difference between fully automated workflow and the need to run all WF, then wait several hours, then manually run a script.

> PLEASE CONFIRM YOUVE TESTED YOUR WORKFLOW, AND REALLY WANT THIS DONE.

No, I can not confirm.

GSB generates an exception during wf_stats macro and sometimes in other circumstances, and then goes into a "broken" state when it does not work reliably (reported in another thread). Strategy code that I imported into MultiCharts does not generate any trades (probably, that can be related to the MultiChart's bug with nested calls).

For now I decided to give it a pause, as nothing works as expected.

Daniel UK1 - 19-11-2019 at 02:17 PM

Hi Sten, as a Multicharts user, i can confirm that my GSB MC generated code delivers almost identical to GSB tradelist in MC. Not sure why its not in your case.
I can also confirm that i get sometimes these exception error signs, however they have no had any impact on performance of GSB in my case .

Not saying that everything is perfect all the time, however i find that GSB is very stable and has never crashed or become "broken".

Hope you manage to sort things out..




Sten - 19-11-2019 at 02:57 PM

Daniel UK1, thanks for your feedback!

Ability to use GSB to manage saved results

RandyT - 16-1-2020 at 04:00 PM

Trying to get my head around a way to manage results with the ability to go back and find systems for a specific market that might have some minimum performance value like PF, Trade Count, etc.

It would be interesting to have the ability to open GSB and point it to a folder where system results have been saved and then further filter those results based on market and these other parameters.

As it is, opening saved systems is a bit hit or miss as the name given to them when saved does not provide much to go on. Perhaps there are better ways of doing this. I am just becoming familiar with this challenge.

admin - 16-1-2020 at 04:04 PM

Quote: Originally posted by RandyT  
Trying to get my head around a way to manage results with the ability to go back and find systems for a specific market that might have some minimum performance value like PF, Trade Count, etc.

It would be interesting to have the ability to open GSB and point it to a folder where system results have been saved and then further filter those results based on market and these other parameters.

As it is, opening saved systems is a bit hit or miss as the name given to them when saved does not provide much to go on. Perhaps there are better ways of doing this. I am just becoming familiar with this challenge.

Not sure if Im clear what you say. You can save and load systems in whatever folders you want, as well as filename prefex etc

RandyT - 16-1-2020 at 05:41 PM

Peter,

I first don't see a way to specify the destination of the file. Saving files seems to default to "Data/Saved Systems".

I do see that I can add a prefix which could help. Would be nice if it was possible to set some default pattern to use as a prefix in order to avoid inconsistencies when saving files. Much like a photo management program does. @MARKET-@TF-@DIR could be expanded to automatically save as ES-30-ShortOnly-filename. This would allow writing scripts and other tools to easily crawl a directory full of these files to display systems with certain characteristics.

Or better yet, let GSB crawl that folder of saved systems.
My suggestion though is to enable GSB to be used for that same directory crawling of systems and point it to open a folder. It could then parse the contents of that folder and present options to filter the saved systems based on market, timeframe, direction, etc.

Happy to speak about this if that would make it more clear.

admin - 17-1-2020 at 04:53 AM

Quote: Originally posted by RandyT  
Peter,

I first don't see a way to specify the destination of the file. Saving files seems to default to "Data/Saved Systems".

I do see that I can add a prefix which could help. Would be nice if it was possible to set some default pattern to use as a prefix in order to avoid inconsistencies when saving files. Much like a photo management program does. @MARKET-@TF-@DIR could be expanded to automatically save as ES-30-ShortOnly-filename. This would allow writing scripts and other tools to easily crawl a directory full of these files to display systems with certain characteristics.

Or better yet, let GSB crawl that folder of saved systems.
My suggestion though is to enable GSB to be used for that same directory crawling of systems and point it to open a folder. It could then parse the contents of that folder and present options to filter the saved systems based on market, timeframe, direction, etc.

Happy to speak about this if that would make it more clear.


Will reply on monday. Prefix etc can be done in current gsb, and you can save into other folders with current GSB

verification improvements

asd9025253 - 25-1-2020 at 08:08 AM

Hi, peter,

When I am building a future strategy, there are too many data files. Normally, when you use (WFP), and try to verify again, nothing happend to other month. So, I need to check them all one by one when a WF process is done, and I need to verify in Multicharts window.

before replaced




after replaced




Here is some suggestion to do verification:

1. Add the verification to WF parameter replaced strategy.

Could you add 'WFP verify' and display such a result in GSB TOP GUI TABS?

2. Ability to check the verification month's trades data in normal and WFP.

It is saving times in future trading.

Thank you, peter.

admin - 26-1-2020 at 04:04 PM

Quote: Originally posted by asd9025253  
Hi, peter,

When I am building a future strategy, there are too many data files. Normally, when you use (WFP), and try to verify again, nothing happend to other month. So, I need to check them all one by one when a WF process is done, and I need to verify in Multicharts window.

before replaced




after replaced




Here is some suggestion to do verification:

1. Add the verification to WF parameter replaced strategy.

Could you add 'WFP verify' and display such a result in GSB TOP GUI TABS?

2. Ability to check the verification month's trades data in normal and WFP.

It is saving times in future trading.

Thank you, peter.

Your images dont work, so I dont understand.
You posted url pictures, and even the url gives an error.

Daniel UK1 - 14-2-2020 at 07:55 AM

Would be really great to have a simplified Cluster analys of WF in GSB, where you set your test criteria and get a score depending on how many it passed.. i think it could be helpful.
I do understand there us EWO, but this would be a first simplified check in GSB..

Would also be great to be able to test exit and entry compared to random of systems..

I am sure there is more important things higher up the roadmap, but these would be helpful

@Peter, do you use Cluster analysis of your systems?

Thanks

RandyT - 14-2-2020 at 08:25 AM

Quote: Originally posted by Daniel UK1  
Would be really great to have a simplified Cluster analys of WF in GSB, where you set your test criteria and get a score depending on how many it passed.. i think it could be helpful.
I do understand there us EWO, but this would be a first simplified check in GSB..

Would also be great to be able to test exit and entry compared to random of systems..

I am sure there is more important things higher up the roadmap, but these would be helpful

@Peter, do you use Cluster analysis of your systems?

Thanks


I would second this request. I've also mentioned this to Peter in conversations.

admin - 14-2-2020 at 03:40 PM

Quote: Originally posted by Daniel UK1  
Would be really great to have a simplified Cluster analys of WF in GSB, where you set your test criteria and get a score depending on how many it passed.. i think it could be helpful.
I do understand there us EWO, but this would be a first simplified check in GSB..

Would also be great to be able to test exit and entry compared to random of systems..

I am sure there is more important things higher up the roadmap, but these would be helpful

@Peter, do you use Cluster analysis of your systems?

Thanks

i very rarely use cluster analysis, though for other traders its a backbone of validation. We however have other tools that are much simpler and faster. I will think on this. EWFO is the specialized product for this at the moment, and yes there are much more critical things to be done. It might happen though in time.

Im playing around with cluster analyses on the cl market right now.
It was nice to see my CL system did well in it, but it was hours of work to optimize in ts etc.

emsjoflo - 17-2-2020 at 11:36 AM

Peter,

It would mean a lot if you could add the attached indicators(functions) to GSB. Simple as they may appear, I have been working on them for about 5 years and I can't use your methodology to test them as custom indicators because of limitations in the custom indicators module. They should be fairly easy to code into GSB because they are time based and are the same for every symbol they are attached to.

Attachment: Login to view the details


admin - 17-2-2020 at 03:06 PM

Quote: Originally posted by emsjoflo  
Peter,

It would mean a lot if you could add the attached indicators(functions) to GSB. Simple as they may appear, I have been working on them for about 5 years and I can't use your methodology to test them as custom indicators because of limitations in the custom indicators module. They should be fairly easy to code into GSB because they are time based and are the same for every symbol they are attached to.

Can you show me the source of these so I can check they are public domain?
Is there evidence that moon / tides are usable in trading?
What specific limitation in there in CI for you?
In GSB 2, its planned to have DLL files to be used for this.
If you strongly want these added, and they are public domain, I can add. In life there are ideas that I thought crazy, but they were very correct. Read a great book on dogs who know there owners are coming home well before they arrive. Numerous dog owners I spoke to experience this - though the average dog likely doesnt have this sensitivity. There are a lot of implication about this 'doggy' fact.

emsjoflo - 17-2-2020 at 04:09 PM

Peter,
I created the indicators myself and I understand they will be public domain once incorporated into GSB. I'm willing to share and I doubt if they will be widely used because they only work in conjunction with other indicators in a narrow band.
I believe there is some merit to time-bases cycles and I have read others who agree. I can send you documentation if desired.
I can explain my frustrations with Custom Indicators in another post if you want. I can't use CIs with verification, multiple data sources and the CIs don't show up in the statistics, force use doesn't do anything, and the graphs and statistics change when I click on the generated systems. I also get multiple errors on the platform when trying to run, and CIs work better with standalone than manager/workers.

admin - 17-2-2020 at 05:38 PM

Quote: Originally posted by emsjoflo  
Peter,
I created the indicators myself and I understand they will be public domain once incorporated into GSB. I'm willing to share and I doubt if they will be widely used because they only work in conjunction with other indicators in a narrow band.
I believe there is some merit to time-bases cycles and I have read others who agree. I can send you documentation if desired.
I can explain my frustrations with Custom Indicators in another post if you want. I can't use CIs with verification, multiple data sources and the CIs don't show up in the statistics, force use doesn't do anything, and the graphs and statistics change when I click on the generated systems. I also get multiple errors on the platform when trying to run, and CIs work better with standalone than manager/workers.

I wasnt so aware of the limitations. In time they will all get fixed. I will add them to the indicator library in the beta tester mode.
We now have a third programmer, so good job for him
If they turn out to work, they will get added for all users.

admin - 24-2-2020 at 10:00 PM

Quote: Originally posted by emsjoflo  
Peter,
I created the indicators myself and I understand they will be public domain once incorporated into GSB. I'm willing to share and I doubt if they will be widely used because they only work in conjunction with other indicators in a narrow band.
I believe there is some merit to time-bases cycles and I have read others who agree. I can send you documentation if desired.
I can explain my frustrations with Custom Indicators in another post if you want. I can't use CIs with verification, multiple data sources and the CIs don't show up in the statistics, force use doesn't do anything, and the graphs and statistics change when I click on the generated systems. I also get multiple errors on the platform when trying to run, and CIs work better with standalone than manager/workers.

moon etc are in 57.11 build (Alphas tester mode only )(not released yet)
Did a quick test on CL with RSI as secondary filter, and they didnt appear in the list
We now have 81 indicators in alpha build GSB

RandyT - 25-2-2020 at 08:19 AM

Quote: Originally posted by admin  
Quote: Originally posted by emsjoflo  
Peter,
I created the indicators myself and I understand they will be public domain once incorporated into GSB. I'm willing to share and I doubt if they will be widely used because they only work in conjunction with other indicators in a narrow band.
I believe there is some merit to time-bases cycles and I have read others who agree. I can send you documentation if desired.
I can explain my frustrations with Custom Indicators in another post if you want. I can't use CIs with verification, multiple data sources and the CIs don't show up in the statistics, force use doesn't do anything, and the graphs and statistics change when I click on the generated systems. I also get multiple errors on the platform when trying to run, and CIs work better with standalone than manager/workers.

moon etc are in 57.11 build (Alphas tester mode only )(not released yet)
Did a quick test on CL with RSI as secondary filter, and they didnt appear in the list
We now have 81 indicators in alpha build GSB


I've done a fair bit of testing with these in both CL and ES and am not seeing them get picked up in the development runs either.

FWIW, I have seen TRIX, MACD, DetrendedPriceOsc, AvgDeviation, AverageUp/DnMove appearing in some results but I don't think any of those systems have made it through all phases of testing.

alpha build

emsjoflo - 27-2-2020 at 01:18 AM

Peter,

How soon do you think the new version will be released? Or could I try the alpha build?

admin - 27-2-2020 at 01:19 AM

Quote: Originally posted by emsjoflo  
Peter,

How soon do you think the new version will be released? Or could I try the alpha build?

will send you 57.15 in a few minutes. Not well tested by me.

Daniel UK1 - 16-4-2020 at 03:04 AM

HI Peter, i know your list is full... however, i think it would be worthwhile since we now are reaching a quite high amount of indicators, to start to divide them in groups...
For example momentum indicators, volume etc.. *not sure where to put the moon stuff .. but i think even a small and simple grouping would help... and not to mention the possibility to change data path for whole gsb so one can easily move from ssd to dropbox for example...

Anyway, thanks for great support and development of GSB..

 Pages:  1    3    5