GSB Forums

Not logged in [Login - Register]

Futures and forex trading contains substantial risk and is not for every investor. An investor could
potentially lose all or more than the initial investment. Risk capital is money that can be lost without
jeopardizing ones’ financial security or life style. Only risk capital should be used for trading and only
those with sufficient risk capital should consider trading. Past performance is not necessarily indicative of
future results
Go To Bottom

Printable Version  
 Pages:  1    3    5  ..  9
Author: Subject: Enhanced Walk Foward Optimizer updates. EWFO EXE
saycem
Junior Member
**




Posts: 48
Registered: 13-7-2018
Member Is Offline

Mood: No Mood

[*] posted on 13-8-2019 at 12:15 AM


Thanks Peter. I wanted to understand your comment better. Are you saying that EWFO could be optimising an input that GSB is not optimising and that should not be optimised. This is critical for me to understand as I am using the inputs from EWFO for live trading given I rely on Cluster Analysis in my process.

View user's profile View All Posts By User
admin
Super Administrator
*********




Posts: 5060
Registered: 7-4-2017
Member Is Offline

Mood: No Mood

[*] posted on 13-8-2019 at 12:29 AM


Quote: Originally posted by saycem  
Thanks Peter. I wanted to understand your comment better. Are you saying that EWFO could be optimising an input that GSB is not optimising and that should not be optimised. This is critical for me to understand as I am using the inputs from EWFO for live trading given I rely on Cluster Analysis in my process.


GSB WF I think should be indentical in GSB and EWFO IF EVERYTHING IS THE SAME.
ie fitness, dates used. So remember if we WF in GSB from 2000 to 2015-06-30
but in ewfo wf form 2000 to 20190812, this is not the same thing.

Also a wf in TS/MC to ewfo will be significantly more different as the parameters used will not be the same.

I hope this helps.

If your market validation steps are solid and healthy numbers, then the specs on typical systems will be good weather wf has been done or not.



View user's profile View All Posts By User
Bruce
Member
***




Posts: 115
Registered: 22-7-2018
Location: Auckland - New Zealand
Member Is Offline

Mood: No Mood

[*] posted on 13-8-2019 at 02:32 AM


Quote: Originally posted by admin  
Quote: Originally posted by saycem  
Thanks Peter. I wanted to understand your comment better. Are you saying that EWFO could be optimising an input that GSB is not optimising and that should not be optimised. This is critical for me to understand as I am using the inputs from EWFO for live trading given I rely on Cluster Analysis in my process.


GSB WF I think should be indentical in GSB and EWFO IF EVERYTHING IS THE SAME.
ie fitness, dates used. So remember if we WF in GSB from 2000 to 2015-06-30
but in ewfo wf form 2000 to 20190812, this is not the same thing.

Also a wf in TS/MC to ewfo will be significantly more different as the parameters used will not be the same.

I hope this helps.

If your market validation steps are solid and healthy numbers, then the specs on typical systems will be good weather wf has been done or not.



Is there any merit with unpacking the GSB_EWFO files with the GSB_WF settings loaded into EWFO so "everything is the same" and then perform the analysis (cluster test, etc) from that datum?


View user's profile View All Posts By User
saycem
Junior Member
**




Posts: 48
Registered: 13-7-2018
Member Is Offline

Mood: No Mood

[*] posted on 13-8-2019 at 03:56 AM


I am not able to get GSBWF = EWFO, see attached. Same dates, same fitness, 20%oos 10 runs.
GSB WF different every run. AStab can range from 20-70
EWFO gives same result every time.
Not sure why?

OUEtw GSB WF.JPG - 344kB OUEtw GSB WF params.JPG - 392kB OUEtw EWFO.JPG - 319kB


View user's profile View All Posts By User
admin
Super Administrator
*********




Posts: 5060
Registered: 7-4-2017
Member Is Offline

Mood: No Mood

[*] posted on 13-8-2019 at 04:13 AM


Quote: Originally posted by saycem  
I am not able to get GSBWF = EWFO, see attached. Same dates, same fitness, 20%oos 10 runs.
GSB WF different every run. AStab can range from 20-70
EWFO gives same result every time.
Not sure why?


Looks like you have a good system there.
Can you send me teamviewer tomorrow?
The performance is close, but not exact.


View user's profile View All Posts By User
zug7
Thomas
**




Posts: 5
Registered: 8-5-2017
Member Is Offline

Mood: No Mood

[*] posted on 28-8-2019 at 12:19 AM


In case someone is interested: I have used a system with 324 iterations and have run this through the Walk-Forward Analyzer of Tradestation. First I have run a Walk-Forward Analysis and afterwards a Cluster Analysis. After that I have done the same with EWFA with the following results:

WF Tradestation: 4 seconds, EWFO: virtually immediatly, but let’s call it 1 second

CA Tradestation: 54 seconds, EWFO: 10 seconds


View user's profile View All Posts By User
admin
Super Administrator
*********




Posts: 5060
Registered: 7-4-2017
Member Is Offline

Mood: No Mood

[*] posted on 8-9-2019 at 10:51 PM


at top of thread, todays version that has auto updates for all future versions. Zip file only. No installer.

View user's profile View All Posts By User
BigDog
Junior Member
**




Posts: 20
Registered: 25-4-2018
Member Is Offline

Mood: No Mood

[*] posted on 29-9-2019 at 04:40 AM


Hi Peter,

I tried downloading and running EWFO in a machine running windows server 2012. It hangs on loading 46.67% of any TS WFO data file. Doesn't seem to make any difference if I set compatibility = Win 2007.

Any suggestions?


View user's profile View All Posts By User
admin
Super Administrator
*********




Posts: 5060
Registered: 7-4-2017
Member Is Offline

Mood: No Mood

[*] posted on 29-9-2019 at 08:40 PM


Quote: Originally posted by BigDog  
Hi Peter,

I tried downloading and running EWFO in a machine running windows server 2012. It hangs on loading 46.67% of any TS WFO data file. Doesn't seem to make any difference if I set compatibility = Win 2007.

Any suggestions?

Hi BigDog

As a test use ts wfo.exe and or do a quick optimization in ts. Likely the files are corupt is my guess. Make sure your on a recent build of ewfo too. New build likely out this week sometime


View user's profile View All Posts By User
admin
Super Administrator
*********




Posts: 5060
Registered: 7-4-2017
Member Is Offline

Mood: No Mood

[*] posted on 30-9-2019 at 06:46 PM


There is a new build, Has options to save profiles etc. Not documented yet but fairly straight forward.



save.png - 8kB


View user's profile View All Posts By User
Sten
Junior Member
**




Posts: 35
Registered: 25-10-2019
Member Is Offline


[*] posted on 31-10-2019 at 11:00 AM


I took a look at EWFO 20190724.1. And found two major issues:

1. "Run \ Save Parameters" does not save Cluster Analysis settings (only saves "ClusterAnalysisEnabled" flag). So when I run EWFO from command line it uses default settings for Cluster Analysis and not the ones I wanted to save into json file.

2. When I run EWFO from a command line like this:

WalkForwardOptimizer.exe -p tst_parameters.json -d C:\GSBInstaller\Data\ewfoFiles\20191026-222718-200359-T7a65 -o c:\tst

It does the job, calculates and saves output .txt files. However after that the app GUI window remains open, the application does not quit automatically when it finishes processing. This makes much harder to use EWFO in some automated workflows.

Can you, please, fix these issues?


View user's profile View All Posts By User
admin
Super Administrator
*********




Posts: 5060
Registered: 7-4-2017
Member Is Offline

Mood: No Mood

[*] posted on 31-10-2019 at 04:13 PM


Quote: Originally posted by Sten  
I took a look at EWFO 20190724.1. And found two major issues:

1. "Run \ Save Parameters" does not save Cluster Analysis settings (only saves "ClusterAnalysisEnabled" flag). So when I run EWFO from command line it uses default settings for Cluster Analysis and not the ones I wanted to save into json file.

2. When I run EWFO from a command line like this:

WalkForwardOptimizer.exe -p tst_parameters.json -d C:\GSBInstaller\Data\ewfoFiles\20191026-222718-200359-T7a65 -o c:\tst

It does the job, calculates and saves output .txt files. However after that the app GUI window remains open, the application does not quit automatically when it finishes processing. This makes much harder to use EWFO in some automated workflows.

Can you, please, fix these issues?


I have passed this into the programer. Thank you for pointing out the issues.
The fix will be applied via auto update when you run ewfo again.
Sometime next week.
Peter




Thanks received (1):

+1 Sten at 2019-11-01 09:25:37
View user's profile View All Posts By User
admin
Super Administrator
*********




Posts: 5060
Registered: 7-4-2017
Member Is Offline

Mood: No Mood

[*] posted on 4-11-2019 at 03:48 AM


Quote: Originally posted by Sten  
I took a look at EWFO 20190724.1. And found two major issues:

1. "Run \ Save Parameters" does not save Cluster Analysis settings (only saves "ClusterAnalysisEnabled" flag). So when I run EWFO from command line it uses default settings for Cluster Analysis and not the ones I wanted to save into json file.

2. When I run EWFO from a command line like this:

WalkForwardOptimizer.exe -p tst_parameters.json -d C:\GSBInstaller\Data\ewfoFiles\20191026-222718-200359-T7a65 -o c:\tst

a lot of this work has been done. Im on working holiday so no time to test it.
there will be new command line -e = -- auto exit when done + other changes
Should be out late this week.

It does the job, calculates and saves output .txt files. However after that the app GUI window remains open, the application does not quit automatically when it finishes processing. This makes much harder to use EWFO in some automated workflows.

Can you, please, fix these issues?


View user's profile View All Posts By User
admin
Super Administrator
*********




Posts: 5060
Registered: 7-4-2017
Member Is Offline

Mood: No Mood

[*] posted on 6-11-2019 at 04:26 PM


Quote: Originally posted by Sten  
I took a look at EWFO 20190724.1. And found two major issues:

1. "Run \ Save Parameters" does not save Cluster Analysis settings (only saves "ClusterAnalysisEnabled" flag). So when I run EWFO from command line it uses default settings for Cluster Analysis and not the ones I wanted to save into json file.

2. When I run EWFO from a command line like this:

WalkForwardOptimizer.exe -p tst_parameters.json -d C:\GSBInstaller\Data\ewfoFiles\20191026-222718-200359-T7a65 -o c:\tst

It does the job, calculates and saves output .txt files. However after that the app GUI window remains open, the application does not quit automatically when it finishes processing. This makes much harder to use EWFO in some automated workflows.

Can you, please, fix these issues?

new build for you to test is here


Attachment: Login to view the details



View user's profile View All Posts By User
Sten
Junior Member
**




Posts: 35
Registered: 25-10-2019
Member Is Offline


[*] posted on 7-11-2019 at 07:07 AM


I did a quick test, Cluster Analysis & Test Criteria settings are now saved correctly into .json file. This issue is solved.

- DEL -

UPD: I found -e command line switch which solves issue No 2. I am testing it right now.


View user's profile View All Posts By User
Sten
Junior Member
**




Posts: 35
Registered: 25-10-2019
Member Is Offline


[*] posted on 7-11-2019 at 07:33 AM


The -e or --autoexit switch solves issue No. 2 for the most part.

The only minor problem is that EWFO with -e switch leaves shell window with a directory with output files open (see screenshot).
Consider an automated workflow which runs EWFO 1000 times. EWFO would open 1000 shell windows, which may not be what end user wants. :)





EWFO_autoexit_leaves_shell_open.png - 10kB


View user's profile View All Posts By User
admin
Super Administrator
*********




Posts: 5060
Registered: 7-4-2017
Member Is Offline

Mood: No Mood

[*] posted on 7-11-2019 at 02:50 PM


Quote: Originally posted by Sten  
The -e or --autoexit switch solves issue No. 2 for the most part.

The only minor problem is that EWFO with -e switch leaves shell window with a directory with output files open (see screenshot).
Consider an automated workflow which runs EWFO 1000 times. EWFO would open 1000 shell windows, which may not be what end user wants. :)




I think whats done is deliberate (and fine) but we need a non shell option.
It will be in next build - likely by auto update.


View user's profile View All Posts By User
admin
Super Administrator
*********




Posts: 5060
Registered: 7-4-2017
Member Is Offline

Mood: No Mood

[*] posted on 8-11-2019 at 10:05 PM


new ewfo out via automatic update. Has bug fixes and features described above few posts


View user's profile View All Posts By User
admin
Super Administrator
*********




Posts: 5060
Registered: 7-4-2017
Member Is Offline

Mood: No Mood

[*] posted on 11-12-2019 at 06:51 PM


WalkForwardOptimizer20191209.2.exe is out. For users with more recent builds, it will auto update when you run it.
If you have an older build, download the zip files and put in your EWFO folder C:\Program Files (x86)\EWFO,
OR use the installer file.
Whats new is bug fixes, and improvements in batch processing. Likely this product will more into EWFO & EWFO PRO (BATCH)
The upgrade will be free for all current users of EWFO, but new users will have a choice the two products which some premium in the price.


View user's profile View All Posts By User
admin
Super Administrator
*********




Posts: 5060
Registered: 7-4-2017
Member Is Offline

Mood: No Mood

[*] posted on 14-1-2020 at 03:44 PM


EWO PRO is out soon.
It will look very similar to last EWO, just slightly refined and faster.
It is 3 times faster than the previous build.
What takes Ts wfo.exe 21:12 minutes takes EWFO pro 4 min 25 sec
You can also run multiple EWFO with little speed penalty

There now is time stamp logging.
There will be a mild price increase for future purchasers, likely next month. A lot of programing time has gone into this.
The biggest feature in the last year has been batch processing of the EWFO input files.
For existing users, there are no upgrade charges.

It will be released by automatic upgrade when you open EWFO.


View user's profile View All Posts By User
admin
Super Administrator
*********




Posts: 5060
Registered: 7-4-2017
Member Is Offline

Mood: No Mood

[*] posted on 15-1-2020 at 12:15 AM


The documentation has been updated, but could do with a few tweaks.
There are a few minor bugs to be fixed but its working well.
If any one is after the new build in a hurry, then email me.


View user's profile View All Posts By User
edgetrader
Junior Member
**




Posts: 24
Registered: 16-5-2018
Member Is Offline

Mood: No Mood

[*] posted on 22-1-2020 at 07:22 PM


How can I roll back from 20200116.2 to previous version? What I had before worked fine on same computer and same data folder, but 20200116.2 doesn't work, see image.

20200116.2.png - 35kB


View user's profile View All Posts By User
admin
Super Administrator
*********




Posts: 5060
Registered: 7-4-2017
Member Is Offline

Mood: No Mood

[*] posted on 22-1-2020 at 07:26 PM


Quote: Originally posted by edgetrader  
How can I roll back from 20200116.2 to previous version? What I had before worked fine on same computer and same data folder, but 20200116.2 doesn't work, see image.


how much ram on the pc in total, how much is free?
How big are the data files from ts?

I can get you the old build, but the new build is miles better.
I also dont expect any change in memory usage between old and new build


View user's profile View All Posts By User
edgetrader
Junior Member
**




Posts: 24
Registered: 16-5-2018
Member Is Offline

Mood: No Mood

[*] posted on 22-1-2020 at 07:30 PM


Data file is 30.6 GB and computer has 32 GB RAM + 16 GB SSD page file. The very same setup worked flawlessly in previous version.

View user's profile View All Posts By User
admin
Super Administrator
*********




Posts: 5060
Registered: 7-4-2017
Member Is Offline

Mood: No Mood

[*] posted on 22-1-2020 at 07:38 PM


Quote: Originally posted by edgetrader  
Data file is 30.6 GB and computer has 32 GB RAM + 16 GB SSD page file. The very same setup worked flawlessly in previous version.


Thats at the limit of what you can do due to your ram.
I dont think its the new build at all.

Ive done 60 gb files in the past, but have much more ram.

You can try two things
1) increase swap file size, then reboot the computer
2) download the old build, and click no when it asks to update
https://trademaid.info/sw/ewfo_20191106.2b.exe

Just a reboot itself may make enough difference to free up some ram

you could also run
C:\GSB\ResourceMonitor\ReduceMemory.exe


or buy more ram. Its cheap now.


View user's profile View All Posts By User
 Pages:  1    3    5  ..  9

  Go To Top

Trademaid forum. Software tools for TradeStation, MultiCharts & NinjaTrader
[Queries: 67] [PHP: 30.2% - SQL: 69.8%]