| Pages:
1
..
31
32
33
34
35
..
98 |
RandyT
Member
Posts: 123
Registered: 5-12-2019
Location: Colorado, USA
Member Is Offline
|
|
Greetings all, I have a few quick questions regarding setup of Resource Manager.
I'm running on two machines and RM is showing 10 active workers between the two nodes. I have a system build running that is only showing 7 "running".
1. Is this just lag in updating or is there something more I should do to encourage use of these workers.
2. What are the recommended settings for CPU Cores and any other relevant tuning in Machine Resources tunables? (included screenshot)
Thanks for your help and all of the other things shared here in the forum.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
Quote: Originally posted by RandyT  | Greetings all, I have a few quick questions regarding setup of Resource Manager.
I'm running on two machines and RM is showing 10 active workers between the two nodes. I have a system build running that is only showing 7 "running".
1. Is this just lag in updating or is there something more I should do to encourage use of these workers.
2. What are the recommended settings for CPU Cores and any other relevant tuning in Machine Resources tunables? (included screenshot)
Thanks for your help and all of the other things shared here in the forum. |
yes, there is lag of minutes.
if you have 256gb of ram, you can increase the cache settings
https://trademaid.info/forum/viewthread.php?tid=92#pid1347
|
|
|
RandyT
Member
Posts: 123
Registered: 5-12-2019
Location: Colorado, USA
Member Is Offline
|
|
| Quote: Originally posted by admin | | Quote: Originally posted by RandyT | Greetings all, I have a few quick questions regarding setup of Resource Manager.
I'm running on two machines and RM is showing 10 active workers between the two nodes. I have a system build running that is only showing 7 "running".
1. Is this just lag in updating or is there something more I should do to encourage use of these workers.
2. What are the recommended settings for CPU Cores and any other relevant tuning in Machine Resources tunables? (included screenshot)
Thanks for your help and all of the other things shared here in the forum. |
yes, there is lag of minutes.
if you have 256gb of ram, you can increase the cache settings
https://trademaid.info/forum/viewthread.php?tid=92#pid1347 |
Even after running for 12 hours, the Master only shows 9 of my workers being used, but RM shows a combined 10 workers that are busy. Not a huge
difference...
I'll work to extrapolate some changes in memory usage for my 64GB Master machine and my second 96GB worker only machine. CPU is pinned to 100% on both
machines but memory usage is only about 60% on each machine.
|
|
|
RandyT
Member
Posts: 123
Registered: 5-12-2019
Location: Colorado, USA
Member Is Offline
|
|
Trying to do some tuning of worker resources. I'm getting the following message in the logs. What parameter controls this CPU limit?
| Code: | 2019/12/18 15:38:57 Kill worker due to High CPU
2019/12/18 15:38:57 KILL WORKER 7248 CPU=9.16073520978292% RAM=4095MB C:\GSB\Cloud Workers\GSBWorker.56.120.exe |
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
| Quote: Originally posted by RandyT | Trying to do some tuning of worker resources. I'm getting the following message in the logs. What parameter controls this CPU limit?
| Code: | 2019/12/18 15:38:57 Kill worker due to High CPU
2019/12/18 15:38:57 KILL WORKER 7248 CPU=9.16073520978292% RAM=4095MB C:\GSB\Cloud Workers\GSBWorker.56.120.exe |
|
the first two settings
cpu usage high. if this is exceeded worker killed
cpu usage low. If this is exceeded no new workers are started
|
|
|
RandyT
Member
Posts: 123
Registered: 5-12-2019
Location: Colorado, USA
Member Is Offline
|
|
Custom Indicators
Greetings all, I would like to add into GSB some custom indicators that I have access to so that they are applied to the system development process
just as the built-in indicators are. As I read through the docs for Custom Indicators, I cannot help but think that this has some other purpose that I
am not understanding.
Could someone (Peter?) expand a bit on what I see in the docs and also make clear some of the limitations that you document. It is not entirely clear
from what I read. I suspect there may be a typo in here at the very least.
You write: can have
| Code: | Limitation of custom indicators.
You can not use bars derived from 1 time frame to make another time frame.
IE you can have 1 minute data and get GSB to make 30 minute bars.
You cannot use multiple time frames / symbols at once.
IE build systems on 29,30,31 minute bars, or build systems on ES,EMD,YM at the same time. |
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
| Quote: Originally posted by RandyT | Greetings all, I would like to add into GSB some custom indicators that I have access to so that they are applied to the system development process
just as the built-in indicators are. As I read through the docs for Custom Indicators, I cannot help but think that this has some other purpose that I
am not understanding.
Could someone (Peter?) expand a bit on what I see in the docs and also make clear some of the limitations that you document. It is not entirely clear
from what I read. I suspect there may be a typo in here at the very least.
You write: can have
| Code: | Limitation of custom indicators.
You can not use bars derived from 1 time frame to make another time frame.
IE you can have 1 minute data and get GSB to make 30 minute bars.
You cannot use multiple time frames / symbols at once.
IE build systems on 29,30,31 minute bars, or build systems on ES,EMD,YM at the same time. |
|
Hi Randy,
Currently we use 29,30,31 minute bars to build systems. With CI you can only use one time frame.
Currently we can make all bar time frames out of 1 minute bars.
With CI, you can only use the time frame the bar was made on.
ie to get 30 min bars, you can only use 30 minute bars.
This will all be improved down the track, but there are more pressing issues.
If you have non propriety indicators you want added into GSB, this can be done.
I feel the current indicator range is too small. I had some annoying issues expanding it. Forgot who it was, but the author says need to ask
permission to use indicators (that were on public domain) Author wouldn't reply to my request to use them.
|
|
|
RandyT
Member
Posts: 123
Registered: 5-12-2019
Location: Colorado, USA
Member Is Offline
|
|
| Quote: Originally posted by admin |
Hi Randy,
Currently we use 29,30,31 minute bars to build systems. With CI you can only use one time frame.
Currently we can make all bar time frames out of 1 minute bars.
With CI, you can only use the time frame the bar was made on.
ie to get 30 min bars, you can only use 30 minute bars.
This will all be improved down the track, but there are more pressing issues.
If you have non propriety indicators you want added into GSB, this can be done.
I feel the current indicator range is too small. I had some annoying issues expanding it. Forgot who it was, but the author says need to ask
permission to use indicators (that were on public domain) Author wouldn't reply to my request to use them. |
Peter,
So the following statement in the doc at https://trademaid.info/gsbhelp/Customindicators1.html, in the context of CI seems to be a typo:
"IE you can have 1 minute data and get GSB to make 30 minute bars."
The indicators I wish to add are proprietary, so I cannot work with you to add these but am happy to do that for others if there are specific ones you
would like me to try to tackle.
Is there a way to add proprietary indicators via a DLL?
Is there example code as to what you need to do to port indicators to GSB?
Would it be possible to open source the current GSB indicators since I believe they are not proprietary? That might enable some of us to add other
open or proprietary indicators which could then be loaded via a DLL?
I'm also happy to take a try at chasing down other developers to get responses to questions about adding their indicators. Seems if the code is in the
public domain, it is probably legally fair game.
|
|
|
cdbrown84
Junior Member
Posts: 6
Registered: 31-1-2018
Member Is Offline
Mood: No Mood
|
|
GSB Download files
Hi, i've been gone for a while, does anyone know where the GSB download files are?
|
|
|
RandyT
Member
Posts: 123
Registered: 5-12-2019
Location: Colorado, USA
Member Is Offline
|
|
Default directory for config files, macros, data, etc.
Is there a way to specify a default root directory for Data, Macros, Settings, etc?
I see ability to set path for Data and I can walk the directory to save settings, but in both cases, GSB seems to default to the location of the
binary install of GSB. I would like to be able to store these other files in Dropbox for example. I see workarounds for Data and Settings but in the
case of creating Macros, it seems to always default to the C:\GSB root.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
| Quote: Originally posted by RandyT | Is there a way to specify a default root directory for Data, Macros, Settings, etc?
I see ability to set path for Data and I can walk the directory to save settings, but in both cases, GSB seems to default to the location of the
binary install of GSB. I would like to be able to store these other files in Dropbox for example. I see workarounds for Data and Settings but in the
case of creating Macros, it seems to always default to the C:\GSB root.
|
You can put gsb in c:\dropbox\gsb etc
or d:\gsb\dropbox...
I think all paths are relative. Keep in mind resource manager needs to point to the correct folders too.
apart from the data folder, no other paths can be changed, apart from data making sub folders.
|
|
|
RandyT
Member
Posts: 123
Registered: 5-12-2019
Location: Colorado, USA
Member Is Offline
|
|
| Quote: Originally posted by admin | | Quote: Originally posted by RandyT | Is there a way to specify a default root directory for Data, Macros, Settings, etc?
I see ability to set path for Data and I can walk the directory to save settings, but in both cases, GSB seems to default to the location of the
binary install of GSB. I would like to be able to store these other files in Dropbox for example. I see workarounds for Data and Settings but in the
case of creating Macros, it seems to always default to the C:\GSB root.
|
You can put gsb in c:\dropbox\gsb etc
or d:\gsb\dropbox...
I think all paths are relative. Keep in mind resource manager needs to point to the correct folders too.
apart from the data folder, no other paths can be changed, apart from data making sub folders. |
Was really looking for a way to keep GSB on local hard drive and the files I am creating on Dropbox. Perhaps a feature request?
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
| Quote: Originally posted by RandyT | | Quote: Originally posted by admin | | Quote: Originally posted by RandyT | Is there a way to specify a default root directory for Data, Macros, Settings, etc?
I see ability to set path for Data and I can walk the directory to save settings, but in both cases, GSB seems to default to the location of the
binary install of GSB. I would like to be able to store these other files in Dropbox for example. I see workarounds for Data and Settings but in the
case of creating Macros, it seems to always default to the C:\GSB root.
|
You can put gsb in c:\dropbox\gsb etc
or d:\gsb\dropbox...
I think all paths are relative. Keep in mind resource manager needs to point to the correct folders too.
apart from the data folder, no other paths can be changed, apart from data making sub folders. |
Was really looking for a way to keep GSB on local hard drive and the files I am creating on Dropbox. Perhaps a feature request?
|
Well as is, the files can be kept in dropbox and the local drive. You have both already. Dont think it really matters to seperate the exe files from
the others.
While I work hard to accommodate new feature requests, I dont see upside to this, and have to work on features that give max return to the user base
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
| Quote: Originally posted by RandyT | | Quote: Originally posted by admin |
Hi Randy,
Currently we use 29,30,31 minute bars to build systems. With CI you can only use one time frame.
Currently we can make all bar time frames out of 1 minute bars.
With CI, you can only use the time frame the bar was made on.
ie to get 30 min bars, you can only use 30 minute bars.
This will all be improved down the track, but there are more pressing issues.
If you have non propriety indicators you want added into GSB, this can be done.
I feel the current indicator range is too small. I had some annoying issues expanding it. Forgot who it was, but the author says need to ask
permission to use indicators (that were on public domain) Author wouldn't reply to my request to use them. |
Peter,
So the following statement in the doc at https://trademaid.info/gsbhelp/Customindicators1.html, in the context of CI seems to be a typo:
"IE you can have 1 minute data and get GSB to make 30 minute bars."
The indicators I wish to add are proprietary, so I cannot work with you to add these but am happy to do that for others if there are specific ones you
would like me to try to tackle.
Is there a way to add proprietary indicators via a DLL?
Is there example code as to what you need to do to port indicators to GSB?
Would it be possible to open source the current GSB indicators since I believe they are not proprietary? That might enable some of us to add other
open or proprietary indicators which could then be loaded via a DLL?
I'm also happy to take a try at chasing down other developers to get responses to questions about adding their indicators. Seems if the code is in the
public domain, it is probably legally fair game.
|
Yes, code may be in the public domain by the author, but if they say you need permission, and they fail to respond to my request... its the sort of
thing court cases come from. I feel thats very unwise for me to do. Private propriety indicators could be added as a paid service, if I had the
programing resources, but thats not even close to happening. This would slow down development for the average user & is not a good idea right now.
Plus there would be lots more code that could be added that is truly open source.
The other option is you make your propriety indicators public on GSB, or public for GSB purchasers only. Why GSB is as good as it is, is many people
collectively contributed various ideas to make the whole package better. If I kept GSB to myself, it would be no where near as good.
I will fix the typo. Thank you.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
You should have GSB resoucemonitor installed. This gives you updates.
It also has to be a version or RM from the last few months. There was a major update in RM and old version was made silently redundant.
New version has features like auto update, so we never have to concern ourselves with updates. Also has CPU throttling by temperature, temp graphs
etc.
download from here.
https://trademaid.info/forum/viewthread.php?tid=208
send me the two rego codes if your not registered.
docs are here
https://trademaid.info/gsbhelp/GSBResourceManager.html
A high speed read is good to do.
|
|
|
RandyT
Member
Posts: 123
Registered: 5-12-2019
Location: Colorado, USA
Member Is Offline
|
|
| Quote: Originally posted by admin | | Quote: Originally posted by RandyT | | Quote: Originally posted by admin | | Quote: Originally posted by RandyT | Is there a way to specify a default root directory for Data, Macros, Settings, etc?
I see ability to set path for Data and I can walk the directory to save settings, but in both cases, GSB seems to default to the location of the
binary install of GSB. I would like to be able to store these other files in Dropbox for example. I see workarounds for Data and Settings but in the
case of creating Macros, it seems to always default to the C:\GSB root.
|
You can put gsb in c:\dropbox\gsb etc
or d:\gsb\dropbox...
I think all paths are relative. Keep in mind resource manager needs to point to the correct folders too.
apart from the data folder, no other paths can be changed, apart from data making sub folders. |
Was really looking for a way to keep GSB on local hard drive and the files I am creating on Dropbox. Perhaps a feature request?
|
Well as is, the files can be kept in dropbox and the local drive. You have both already. Dont think it really matters to seperate the exe files from
the others.
While I work hard to accommodate new feature requests, I dont see upside to this, and have to work on features that give max return to the user base
|
My concern Peter is the potential impact of multiple RM processes attempting to update GSB binaries at the same time. If I share GSB binaries across
all severs through Dropbox, that is likely to happen. Could result in loss of installed binaries that kills a long running process...
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
| Quote: Originally posted by RandyT | | Quote: Originally posted by admin | | Quote: Originally posted by RandyT | | Quote: Originally posted by admin | | Quote: Originally posted by RandyT | Is there a way to specify a default root directory for Data, Macros, Settings, etc?
I see ability to set path for Data and I can walk the directory to save settings, but in both cases, GSB seems to default to the location of the
binary install of GSB. I would like to be able to store these other files in Dropbox for example. I see workarounds for Data and Settings but in the
case of creating Macros, it seems to always default to the C:\GSB root.
|
You can put gsb in c:\dropbox\gsb etc
or d:\gsb\dropbox...
I think all paths are relative. Keep in mind resource manager needs to point to the correct folders too.
apart from the data folder, no other paths can be changed, apart from data making sub folders. |
Was really looking for a way to keep GSB on local hard drive and the files I am creating on Dropbox. Perhaps a feature request?
|
Well as is, the files can be kept in dropbox and the local drive. You have both already. Dont think it really matters to seperate the exe files from
the others.
While I work hard to accommodate new feature requests, I dont see upside to this, and have to work on features that give max return to the user base
|
My concern Peter is the potential impact of multiple RM processes attempting to update GSB binaries at the same time. If I share GSB binaries across
all severs through Dropbox, that is likely to happen. Could result in loss of installed binaries that kills a long running process...
|
Good thought.
Ive been running rm and gsb on dropbox from day1 of GSB. It works fine.
|
|
|
RandyT
Member
Posts: 123
Registered: 5-12-2019
Location: Colorado, USA
Member Is Offline
|
|
Exporting Data to Portfolio Analyzer
Peter,
Given the limited data used in some of the system development, exporting to PA from GSB does not give a complete picture.
Is it best to use the EL code to export trades directly from TS or MC?
Or is it best to use the XML file from the performance reports?
Ideally, I would like to have a set of systems running on the production machine that are constantly updating the trade list so that PA can track
performance.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
| Quote: Originally posted by RandyT | Peter,
Given the limited data used in some of the system development, exporting to PA from GSB does not give a complete picture.
Is it best to use the EL code to export trades directly from TS or MC?
Or is it best to use the XML file from the performance reports?
Ideally, I would like to have a set of systems running on the production machine that are constantly updating the trade list so that PA can track
performance. |
Ive done this so its fully automated on the web.
ie
https://trademaid.info/gsbhelp/GSBfreesystems.html
I havent promoted this as its a fair bit of extra support on my end with no revenue, and not sure how much demand for the service.
However the simpler option is to add the eld to your chart, and it will update when the chart is opened.
It is VIP you follow the directions.
You need two charts. One to open for historical records. IE the date goes back to say 1/1/2000. Do not leave this chart open for trading. It may write
out your trade list again at the end of each bar. (resource hog) Open these charts when you want PA files to be updated. It is possible to trade of
this, via a modified version of the file, but there are issues if you do. (the short story)
The other chart you have say 1 years data, and you use this for live trading.
I think the ELD is called exportpa, or portfolioexport etc. my TS computer is about to be rebooted now, so i cant check right now. I wasnt aware but
all this isnt in the docs yet,
|
|
|
Sten
Junior Member
Posts: 35
Registered: 25-10-2019
Member Is Offline
|
|
| Quote: Originally posted by Sten | Hi Peter,
Here are a couple of fresh bugs in GSB:
1. I set "Macros / On Opt. Completed" == true, and run optimization process. When I pause optimization macro automatically starts, which is totally
unexpected. When I manually terminate optimization process by pressing terminate button, macro also starts automatically, which is counter-intuitive
as I canceled everything.
I expect GSB not to start automatically any macro when users pauses or terminates optimization process.
|
Hi Peter! The issue above with Macro being run automatically when I terminate or pause build is not fixed (the last build I checked: 1.0.56.18). Can
you, please, tell programmers to fix this issue? (as it is quite annoying)
2. Another issue that bugs me: when I ask GSB to do 250 Walk-Forward tests, then cancel them, GSB only cancels actively running WF tests. And the ones
in the queue remain enabled and occasionally start running.
So what I observe: GSB cancels all actively running WF tests,let's say 10 out of 250 become "Canceled". All the remaining WF tests have "Waiting"
status and remain in the queue. Then GSB starts some of the "Waiting" WF tests and runs them they became "Active". But I already canceled them!
So right now it is virtually impossible to cancel all Walk-Forward tests. Coupled with issue above, that macro autostarts automatically when I
cancel/terminate the build, this makes user experience, well, less than ideal.
What I expect: GSB should cancel all WF tests, even the ones that are in queue having "Waiting" status.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
| Quote: Originally posted by Sten | | Quote: Originally posted by Sten | Hi Peter,
Here are a couple of fresh bugs in GSB:
1. I set "Macros / On Opt. Completed" == true, and run optimization process. When I pause optimization macro automatically starts, which is totally
unexpected. When I manually terminate optimization process by pressing terminate button, macro also starts automatically, which is counter-intuitive
as I canceled everything.
I expect GSB not to start automatically any macro when users pauses or terminates optimization process.
|
Hi Peter! The issue above with Macro being run automatically when I terminate or pause build is not fixed (the last build I checked: 1.0.56.18). Can
you, please, tell programmers to fix this issue? (as it is quite annoying)
2. Another issue that bugs me: when I ask GSB to do 250 Walk-Forward tests, then cancel them, GSB only cancels actively running WF tests. And the ones
in the queue remain enabled and occasionally start running.
So what I observe: GSB cancels all actively running WF tests,let's say 10 out of 250 become "Canceled". All the remaining WF tests have "Waiting"
status and remain in the queue. Then GSB starts some of the "Waiting" WF tests and runs them they became "Active". But I already canceled them!
So right now it is virtually impossible to cancel all Walk-Forward tests. Coupled with issue above, that macro autostarts automatically when I
cancel/terminate the build, this makes user experience, well, less than ideal.
What I expect: GSB should cancel all WF tests, even the ones that are in queue having "Waiting" status.
|
agree on all points. Im not sure where the macro issue is in the job que, but shouldnt be hard to fix. wf might be harder. The whole WF submission may
eventually get a complete code re-write. Im not keen to do that in a hurry as while its annoying, there are more pressing issues.
the work around on macro issue is, if your going to stop gsb, turn auto run of macros off.
|
|
|
Daniel UK1
Member
Posts: 470
Registered: 4-6-2019
Member Is Offline
|
|
Peter, an issue right now is that whenever you open a previous saved opt setting, and make no change, is still shows as the file has been changed with
current date.... it would be good if the file did not show as changed when it actually was opened without anything changed..
It could help when you try to understand if previous saved opt settings has been changed or not.. Thanks
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
| Quote: Originally posted by Daniel UK1 | Peter, an issue right now is that whenever you open a previous saved opt setting, and make no change, is still shows as the file has been changed with
current date.... it would be good if the file did not show as changed when it actually was opened without anything changed..
It could help when you try to understand if previous saved opt settings has been changed or not.. Thanks |
Under windows file manger you can view the created, last changed and last read date. Will that help for now
I will discuss this with the programer.
|
|
|
RandyT
Member
Posts: 123
Registered: 5-12-2019
Location: Colorado, USA
Member Is Offline
|
|
VBasePlusMinus
Could someone explain to me what VBasePlusMinus is measuring when used as a Fitness Criteria?
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
Just added this in the docs for ewfo two days ago.
see https://trademaid.info/gsbhelp/Fitnesstypes.html
|
|
|
| Pages:
1
..
31
32
33
34
35
..
98 |
![[*]](images/davis/default_icon.gif){kind=icon}
