| Pages:
1
2
3
..
10 |
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
GSB AUTOMATION
The exe file for release build GSB automation is now here. Oct 28 2020
https://trademaid.info/forum/viewthread.php?tid=267#pid5542
once installed run C:\GSB\GSB_AUTOMATION\install-into-GSB.bat will install all files, inc data files for GC into GSB.
This will overwrite all your data in sessions.txt. Dont run the last part of the batch file if this is an issue.
It will not be a issue for anyone who has made no changes to GSB SESSIONS.
the gold data file is from a computer on local time = central usa time.
This thread shows how we went from the idea of automation using 3rd party tools, to making GSB automation.
Most of the GSB workflow can be automated.
The entire 2 pass + build is now automated.
Please see this rough video kindly done by a GSB user.
https://drive.google.com/file/d/1hNVwUD43DVnxJPPeYgsVi3SLWOX...
I thought wow, this is going to save a lot of human time and human error.
Basically the 2 pass and build should be able to be done entirely by command line all going well.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
indicator testing is built, but has one critical bug still
this saves the green_orange onto the app settings file name.
|
|
|
RandyT
Member
Posts: 123
Registered: 5-12-2019
Location: Colorado, USA
Member Is Offline
|
|
Peter,
I think adding this type of functionality to GSB will be a game changer and a real differentiator for GSB versus other system builder apps.
Some other features that would be nice to consider:
1. ability to give GSB a number range of indicators to use, and a number for which to split that list into groups of 10 for example.
2. ability to write results to files for later automated analysis by other external scripts
3. using a file format to drive the automation runs that could be easily written by an external script that prescribes automation run based on results
found in above scripts.
Using UI scripting tools as demonstrated in the video are doable, but not without considerable effort to create the scripts to drive the automation.
Any changes to the UI can make those scripts obsolete and fragile. Much better to put this in GSB.
Can't wait.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
Hi Randy
your comments are very useful seeing as you have lots of experience in this field.
The feature to choose the green / orange indicators, apply to settings and save is now working.
This can be all done via command line now, but Im going to modify GSB benchmark app to be a front end for GSB
|
|
|
Daniel UK1
Member
Posts: 470
Registered: 4-6-2019
Member Is Offline
|
|
Hi, very interesting stuff, i also believe this will help a lot.
Will you also include in GSB the possibility to by auto/macro, test each choice within a specific setting and then save this to excel, for example
test all or some option in Entry mode seting?
And will it compile it to one result in excel, or you need to save the result per single choice/test?
Would be great with option to compile results to one excel table, for the people with not so much python skills.
Cheers
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
Quote: Originally posted by Daniel UK1  | Hi, very interesting stuff, i also believe this will help a lot.
Will you also include in GSB the possibility to by auto/macro, test each choice within a specific setting and then save this to excel, for example
test all or some option in Entry mode seting?
And will it compile it to one result in excel, or you need to save the result per single choice/test?
Would be great with option to compile results to one excel table, for the people with not so much python skills.
Cheers
|
Im working on this but dont yet know how it will be done.
Its easier to shuffle through a set of indicaots (ie sf) or entry types in sequence.
But to choose the sequence is harder to do. It all can be done though
We are 1 tweak away from 2 pass and build being 100% automated, though export of final stats to csv not done yet
see new command line autoexit feature
|
|
|
Carl
Member
Posts: 342
Registered: 10-5-2017
Member Is Offline
Mood: No Mood
|
|
A lot of this kind of analysis can be done in Excel.
Grouping per indicator can also be done by using a pivot table in Excel.
Averages, median, standard deviation and so on.
Anyone interested in this? I can post a video to show how to do this.
Thanks received (4):
+1 moresi522 at 2020-10-31 10:59:51 +1 Daniel UK1 at 2020-07-10 01:35:36 +1 admin at 2020-07-09 17:44:36 +1 Bruce at 2020-07-09 15:26:48
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
| Quote: Originally posted by Carl | A lot of this kind of analysis can be done in Excel.
Grouping per indicator can also be done by using a pivot table in Excel.
Averages, median, standard deviation and so on.
Anyone interested in this? I can post a video to show how to do this. |
Hi Randy, I think a video on this would be good.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
two pass method now works 100% via dos prompt, but export of stats to CSV file not done yet
/autoexit could be used on the pass1 and pass2 lines
this would close GSB
all this can be run from batch file using windows start feature.
(someone is welcome to show how this is done)
Macros will be in file repository in next day
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
This is not the direction i'm going it, but seeing what UI path could do made me appreciate how much better GSB will be when much more is automated.
Im going to have GSBAutomation, a front end batch processor for GSB.
Likely UI path can do more, but user Randy has said UI path etc is sometimes a bit problematic for a variety of reasons.
However even if you use UI path, more and more automation can be done inside of GSB
Here is a video kindly made on how to use UI path
Attachment: Login to view the details
|
|
|
RandyT
Member
Posts: 123
Registered: 5-12-2019
Location: Colorado, USA
Member Is Offline
|
|
| Quote: Originally posted by admin | This is not the direction i'm going it, but seeing what UI path could do made me appreciate how much better GSB will be when much more is automated.
Im going to have GSBAutomation, a front end batch processor for GSB.
Likely UI path can do more, but user Randy has said UI path etc is sometimes a bit problematic for a variety of reasons.
However even if you use UI path, more and more automation can be done inside of GSB
Here is a video kindly made on how to use UI path
|
Just to put my cards on the table in case someone wants to challenge my thinking regarding these UI automation tools...
I see these tools like UIPath, pywinauto, etc. as stop gaps for situations where the application being driven by these tools is unable or unwilling to
automate these tasks. The scripts created by these tools are somewhat fragile and very dependent on the application being driven to not change, and
have well written UIs that properly define all windows elements. If any of those UI elements change, it will usually result in your hard work
developing these automation scripts to be broken, requiring updates to match new UI element names and workflows.
These tools have their place, but given Peter is willing to invest in developing these automations in GSB, IMO that is the best place to do this.
Counterpoints welcome.
|
|
|
Carl
Member
Posts: 342
Registered: 10-5-2017
Member Is Offline
Mood: No Mood
|
|
| Quote: Originally posted by RandyT | | Quote: Originally posted by admin | This is not the direction i'm going it, but seeing what UI path could do made me appreciate how much better GSB will be when much more is automated.
Im going to have GSBAutomation, a front end batch processor for GSB.
Likely UI path can do more, but user Randy has said UI path etc is sometimes a bit problematic for a variety of reasons.
However even if you use UI path, more and more automation can be done inside of GSB
Here is a video kindly made on how to use UI path
|
Just to put my cards on the table in case someone wants to challenge my thinking regarding these UI automation tools...
I see these tools like UIPath, pywinauto, etc. as stop gaps for situations where the application being driven by these tools is unable or unwilling to
automate these tasks. The scripts created by these tools are somewhat fragile and very dependent on the application being driven to not change, and
have well written UIs that properly define all windows elements. If any of those UI elements change, it will usually result in your hard work
developing these automation scripts to be broken, requiring updates to match new UI element names and workflows.
These tools have their place, but given Peter is willing to invest in developing these automations in GSB, IMO that is the best place to do this.
Counterpoints welcome.
|
Hi Randy,
I agree. have worked with Blue Prism RPA (robotic process automation) in the past (not on GSB).
Every little change in the underlying software you are trying to automate by using RPA can cause the RPA script to fail.
I think GSB's development is too fast to be controlled by RPA.
Better solution is to automate the steps within GSB.
Setting up GSB could be improved by using a more process driven approach instead of data driven.
The analysis part should be a combination of process and data driven aproach I think.
What does the maker of the video think? I think I saw the name Lorenzo in the video?
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
next build has export stats. Its working now but needs some tweaks
Show is my build+stats + export macro
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
build 46 under testing
it has stats
Thanks received (1):
+1 Bruce at 2020-07-10 21:33:30
|
|
|
Bruce
Member
Posts: 115
Registered: 22-7-2018
Location: Auckland - New Zealand
Member Is Offline
Mood: No Mood
|
|
Hi Peter, I can't see 'ExportStats'' in the Macro list of actionable items, or am I missing something? Thx.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
| Quote: Originally posted by Bruce |
Hi Peter, I can't see 'ExportStats'' in the Macro list of actionable items, or am I missing something? Thx. |
It can only be seen on .46 build or above. DO you have this on any of your machines?
If not I will send you a url to the exe.
|
|
|
Bruce
Member
Posts: 115
Registered: 22-7-2018
Location: Auckland - New Zealand
Member Is Offline
Mood: No Mood
|
|
| Quote: Originally posted by admin | | Quote: Originally posted by Bruce |
Hi Peter, I can't see 'ExportStats'' in the Macro list of actionable items, or am I missing something? Thx. |
It can only be seen on .46 build or above. DO you have this on any of your machines?
If not I will send you a url to the exe.
|
Yes, I'm running .46 now, I just started a new test and I can see it now at the bottom of the list. 
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
These macros will be in .47 build (not made yet)
and the batch file in c:\gsb\gsb_batch.bat
the batch file assumes that your app settings are CL_TEST1.gsboptset
Best edit the macros to see what they do
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
| Quote: Originally posted by Bruce | | Quote: Originally posted by admin | | Quote: Originally posted by Bruce |
Hi Peter, I can't see 'ExportStats'' in the Macro list of actionable items, or am I missing something? Thx. |
It can only be seen on .46 build or above. DO you have this on any of your machines?
If not I will send you a url to the exe.
|
Yes, I'm running .46 now, I just started a new test and I can see it now at the bottom of the list.
|
Likely we need to alphabeticaly sort the list.
When you loose something and its found, you find it in the last place you look.
You should go to the last place you look first
disclaimer, some pearls of wisdom may only be clear after the event and not useful for forward testing / living
Thanks received (1):
+1 Bruce at 2020-07-10 23:55:18
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
build 47 released to all users. It has batch files, and macros in it, and version GSB_SCRIPTS_2020_06_22D+WITHUPDATEDGSBSYS1ES_V1.21 of the TS
scripts. ( has a few missing functions for those beta users who have the 100+ indicators)
|
|
|
Daniel UK1
Member
Posts: 470
Registered: 4-6-2019
Member Is Offline
|
|
Hey guys, so before i start to fiddle around with this new neat little thing.... i am trying to figure out how and in what way i shall incorporate
this into my workflow/process.. So we have possibility to control things now using dos prompt.. we also have the possibility to automate indicator
2 pass and save green orange etc.. and then we can export stats from macro...what i am thinking of is
1: Does the macro new "indicator testing" in macros, perform multiple (2) runs in one manager, and then saves final opt setting?
2: If not, then if i shall automate the flow, i assume i need to create/use this so call batch file, since i need to perform multiple tasks in a flow
order, but for this to happen i need to know before hand what name each saved opt setting from the indicator macro function will have...
3: I think it would be awesome when there is some time, if details about these new functions could be added to documentation.
What is your workflow/process when it comes to usage and folders for working with these files?
I assume i just lack proper understanding of in detail what these new functions will do/perform and how to work with batch files.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
It does 1 run in 1 manager
pass1. ie green orange or green
then pass2 normaly green
then build 50k, and do stats.
I did this 4 times to get stats on 4 different but identical tests
Here are results as an example
Avg. A Avg. B Avg. C Avg. D
28817 940 2013 3790
Avg. A Avg. B Avg. C Avg. D
28522 783 2144 4312
Avg. A Avg. B Avg. C Avg. D
28931 868 2012 3649
Avg. A Avg. B Avg. C Avg. D
29115 746 2106 4970
you can edit the macros supplied to see the function
 
|
|
|
Daniel UK1
Member
Posts: 470
Registered: 4-6-2019
Member Is Offline
|
|
Peter, i tried quickly the macro "indicator testing" and used green only, and save app setting to true ( i initially read t quickly and thougth it was
OPT setting)
So my observation is like this... stats for params. look different compared to when done manually and when done by macro, a bug or feature ?
I ran the macro 3 times after each other after manually resetting the params ... the file name is saved by adding a "green" wording aafter each file
saved, feature or bug ? i assume its somehow a feature to differentiate from multiple runs...
I am confused by the option "save app setting" in the macro, since it would be logical if it was OPT setting, but app setting ?
I can see the OPT setting getting saved, after running the macro, but i cant see any APP setting getting saved despite my was set to true by mistake..
Anyway, i understand we are just in the beginning of these features and i think it will save lots of time going ahead, after a proper understanding of
how to incorporate them into the workflow process.
Cheers
 
|
|
|
NickW
Junior Member
Posts: 29
Registered: 12-2-2020
Member Is Offline
|
|
Peter I have done some testing.
It would be nice to have option for managers to stay open after completion and then batch will continue with next run.
Instead now it is waiting for the manager to be closed before continuing...
|
|
|
NickW
Junior Member
Posts: 29
Registered: 12-2-2020
Member Is Offline
|
|
Peter, also when exporting stats is it possible to NOT divide by 1000 and do any rounding?
If we using different fitness functions we might not get any digits if it's less than 1000.
Is it possible to export all the stats just like we do when we right-click and export to csv?
|
|
|
| Pages:
1
2
3
..
10 |
![[*]](images/davis/default_icon.gif){kind=icon}
