| Pages:
1
2 |
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
GSB Client / Server
GSB client / server beta has arrived.
I enclose a screen shot of it running.
You can now run multiple copies of GSB on one machine to increase the speed.
(GSB uses only a part of full CPU usage, esp on the 8/16 + core machines)
and you can run on multiple computers if you have a GSB license for each computer.
We are using a dropbox folder for GSB client server to communicate, or you can use a local lan shared folder.
Documentation is here.
Attachment: Login to view the details
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
With 4 pc,s I reached the speed of 60,000 systems per minute, using ES & spx 30 minute bars.
See screen shot.
More updates coming in the next week.
Client server also works with google drive.
|
|
|
cyrus68
Member
Posts: 171
Registered: 5-6-2017
Member Is Offline
Mood: No Mood
|
|
As I understand it, one licensed copy (the manager) is essentially redundant, in the sense that it does not participate in the grunt work of number
crunching. Licensed copies 2, 3, ...etc.. (the workers) would do the processing, whether on the same computer as the manager or on other computers on
the Lan.
Regarding drives, my own preference is to use a shared folder on a NAS.
As for systems, the typical system I would run would be based on date1, 2, 3, 4 and 5; as well as 2 custom indicators on 60,000 bars.
I see that there is no restriction on the number of cores that GSB is allowed to use. This could potentially make other apps unusable while GSB is
running.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
Your correct that it doesn't participate, but this is no big deal. It uses almost no ram and shouldnt use much CPU. We could make the manager work
too, but there is no big advantage of this.
GSB is not disk intensive, so shared nas will be a step up from dropbox.
You can set process priority to lowest on all the GSB, but if your running nearly 100% on GSB other apps might be slow. You could also UN-assign other
CPU cores for your other apps.
My pcs were running fine with 9 GSB at once. Main thing is you have spare ram.
|
|
|
heyligerb
Junior Member
Posts: 40
Registered: 22-5-2017
Member Is Offline
Mood: No Mood
|
|
This is great Peter! I'm running 70K systems/min!!!!
For our own understanding, do the workers inherit the settings specified in the manager, or do we need to set them all individual in the workers?
The reason I ask is because it doesn't seem like manager is dividing up one large population, but rather running x workers populations
simultaneous..., thus testing more systems in the same period of time, verses running the managers settings quicker.
BTW, this is great either way, I'm so happy with GSB!
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
Im very happy your happy. Havnt had a lot of feedback on client / server.
The next version of GSB is 100% stable. On your version some workers just stop and the speed rating declines.
In answer to your question.
The manager sends the settings to all the workers.
The population is NOT divided up. Total iterations = populations * generations * restarts * workers.
Next build has a metric for cumulative iterations, not just worker iterations.
see enclosed picture.
70k is pretty thrilling. Its about 10x faster than what GSB standalone is, and about 100x Adaptrade Builder.
|
|
|
heyligerb
Junior Member
Posts: 40
Registered: 22-5-2017
Member Is Offline
Mood: No Mood
|
|
Manager Not Displaying Results
Is it necessary to restart all the workers each time you start a new run from manager?
The reason I ask is that I'm noticing that if I don't, then the results from the current run won't show up in manager. It seems like there's some kind
of a disconnect between workers and manager if everything isn't manually reset before the next run begins...
Hopefully it's not by design, because it's somewhat time consuming to do so...
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
I havnt noticed that, but im on a newer build. You should be able to start a new run from the old manager without starting new workers.
You cant start a new manager without starting new workers..
However there are shortcuts to killing all the workers and manager, and shortcuts to running multiple workers.
I would rename your mangager to gsb.manager to it doesnt get killed with the workers.
Im hoping for a update to the manger software soon but its got some issues to be fixed still.
batchfile to start 4 workers.
start "" "c:\Dropbox\gsb\GSB-Workplace-Test\GSB (Workers)DriveD\GSBworker.exe"
start "" "c:\Dropbox\gsb\GSB-Workplace-Test\GSB (Workers)DriveD\GSBworker.exe"
start "" "c:\Dropbox\gsb\GSB-Workplace-Test\GSB (Workers)DriveD\GSBworker.exe"
start "" "c:\Dropbox\gsb\GSB-Workplace-Test\GSB (Workers)DriveD\GSBworker.exe"
batchfile to kill workers
taskkill /IM GSBworker.exe /F
pause
|
|
|
heyligerb
Junior Member
Posts: 40
Registered: 22-5-2017
Member Is Offline
Mood: No Mood
|
|
oh cool thanks! Brings me back to my DOS days lol... here's the files I created that work for me - for the benefit of all.
Attachment: Login to view the details
Attachment: Login to view the details
|
|
|
cyrus68
Member
Posts: 171
Registered: 5-6-2017
Member Is Offline
Mood: No Mood
|
|
I'm trying out version 37.29 of the manager/worker and I can't get it to work from the very first step. As a first trial, I started with the test data
files and path.
So I copied the test data into C:\dropbox\GSB-workplace-test\Data (Dropbox shared folder)\Workplaces. This is all done according to the manual.
To begin with, I want to use a single manger/worker. So I set the # of Workers to "0" and the Can Run As Worker to "False".
When I click on Primary Data and look in the above default folder, populated with the test data, it sees none of the 3 files. Instead, I get hundreds
of error messages saying "Exception; could not find part of the path. I have to use Task Manager to shut down GSB.
If I try to change the default data-path setting to my LAN drive where I have data, it can't see any of the files either. Again, I get the same error
messages and use task Manager to shut it down.
Has anybody been able to make this thing work?
|
|
|
cyrus68
Member
Posts: 171
Registered: 5-6-2017
Member Is Offline
Mood: No Mood
|
|
Does anybody know if there is a version of client/server, where you can set the default Lan directory and you can load data from that source, without
the software crashing?
It is not even clear what is the default directory for the test data on C:\ . Anybody know what it is?
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
Im traveling today. Will look into this in 24 hours. Thanks for your patience.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
please send the execption file. its under gsb folder
|
|
|
cyrus68
Member
Posts: 171
Registered: 5-6-2017
Member Is Offline
Mood: No Mood
|
|
I ran 37.29 several times yesterday and it bombed. Today, I did the same thing and it worked.
Run the manager.
Set # of workers to 0
Set Run as worker to false. This is counter-intuitive because the idea is to turn the manager into a worker.
Anyway, it works. I can also set the default directory to the Lan drive without crashing.
I'm not interested in using Dropbox as a data server.
|
|
|
cyrus68
Member
Posts: 171
Registered: 5-6-2017
Member Is Offline
Mood: No Mood
|
|
Sorry, I spoke to soon about getting version 37.29 to work. It is still buggy.
Here are the steps:
I loaded the Manager and set it to standalone mode.
I set the default directory to my Lan drive. Mercifully, it did not crash.
I clicked on "Primary Data" to load in the data file.
I opened the Lan directory and selected the correct file.
Unfortunately, I immediately got an error message;
GSB
Please select files from the default directory only,
\\Diskstation\gsb\Data\Price Data
Please correct this error and try again.
I had selected the correct file in the "Data" folder. There is no "Price Data" folder.
The default directory was set as: \\Diskstation\gsb\Data
|
|
|
cyrus68
Member
Posts: 171
Registered: 5-6-2017
Member Is Offline
Mood: No Mood
|
|
Next, I tried GSB in 1 manager 1 worker mode.
Following the manual, I loaded the Manager and set the default data directory.
Then I loaded the Worker, which had the "Can run as worker" correctly set to True.
However, in the title bar, it indicated Manager rather than Worker. I'm not sure if this indicates a problem.
I tried to change the data directory to the default one. At this point it bombed, generating similar, interminable, error messages, and I had to use
Task Manager to shut it down.
Exception: Could not find a part of the path
‘\\Diskstation\gsb\Data\Workplaces.
For more details, please check C:\GSB2\GSB (Managers)\GSB
(Workers)\Exceptions\20170927-075245-732604.txt
This is nonsense. There is no "Workplaces" folder. The data files are in "Data".
At this point, I won't waste any more time on the client/server version.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
I have been using client server for a month or so, as are other GSB users without these issues. However Im happy to fix them for you. Next beta has
improvements to the way manager / worker / standalone is chosen. Currently its not as clear as it should be.
I have replicated your problem.
the public directory has to go to
c:\dropbox\GSB-Workplace-Test\Data (DropBox Shared Folder) {or similar}
this folder must contain price data & workplaces folders.
Your post much earlier mapped to Data (DropBox Shared Folder)\workplaces {incorrect}
It looks like you have the same mistake above.
The worker starts as manager in the title bar, but will change to worker once its received start command from the manager.
this will get tweaked later on.
|
|
|
cyrus68
Member
Posts: 171
Registered: 5-6-2017
Member Is Offline
Mood: No Mood
|
|
If I understand you correctly, one has to use a SPECIFIC location [c:\dropbox\GSB-Workplace-Test\Data (DropBox Shared Folder)] and create a "Price
Data" folder that contains the data, in order to get client/server to work.
From reading the manual, I thought that one could set the default data directory to ANY shared folder, including a Lan drive. This is what I tried to
do. \\Diskstation\gsb\Data is a folder on a Lan drive. Maybe others have been successful in doing this, but I haven't. If they have successfully used
a Lan drive for client/server, I would appreciate knowing how it's done.
In the standalone version 36.12, I have no problem in setting the Lan drive as the default data directory.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
that lan drive doesnt look like its mapped. This is not tested. The fact that it worked in 36.12 is a good sign.
can you map a drive letter to this location?
More importantly you should copy all files from the install files folder gsb-workplace-test\data(dropbox shared folder)
before you run GSB to your shared location.
|
|
|
cyrus68
Member
Posts: 171
Registered: 5-6-2017
Member Is Offline
Mood: No Mood
|
|
It works perfectly well in 36.12. The gsb\Data folder on Diskstation is accessible in Windows Explorer, any other computer on the Lan and Syncbackpro.
Potentially, a second GSB manager and associated workers on computer #2, on the Lan, would be able to access this location.
I have not mapped a drive letter to this location. There is no need. It is already accessible from everywhere and by everything.
Not sure why I should copy data files from the C:\ drive location to the Lan drive. I already have my own data files populating the data folder on the
Lan drive. They were used successfully in 36.12 without a hitch.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
Quote: Originally posted by cyrus68  |
Not sure why I should copy data files from the C:\ drive location to the Lan drive. I already have my own data files populating the data folder on the
Lan drive. They were used successfully in 36.12 without a hitch. |
You should be correct about the paths, its just that I have not tested this.
The reason why you should copy all the contents of the shared folder is, I know this should work.
The shared folder also contains other folders / settings files etc.
Once your working then use your own files etc.
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
GSB Client server documentation updated for today's Beta GSB. Its now much simpler to run GSB client server.
Install the file, run a number of workers, start the manager. Enjoy the speed.
|
|
|
kiran
Junior Member
Posts: 19
Registered: 10-11-2017
Member Is Offline
Mood: No Mood
|
|
I have an i5 (4 logical processors / 2 cores) 2.5GHz and 16MB RAM - from my Task Mgr->Performance.
Not sure what logical processor means and if it helps Manager/Worker mode.
- makes sense to run GSB in stand-alone mode, correct? No performance gain from Manager-worker mode on 2 cores?
Kiran
|
|
|
admin
Super Administrator
Posts: 5060
Registered: 7-4-2017
Member Is Offline
Mood: No Mood
|
|
| Quote: Originally posted by kiran | I have an i5 (4 logical processors / 2 cores) 2.5GHz and 16MB RAM - from my Task Mgr->Performance.
Not sure what logical processor means and if it helps Manager/Worker mode.
- makes sense to run GSB in stand-alone mode, correct? No performance gain from Manager-worker mode on 2 cores?
Kiran
|
Correct, + the ram would be a bit low. If you have a second computer, you might be able to run copie(s) on it
Ideally you want a high end i7 i 9, though its not critical.
|
|
|
| Pages:
1
2 |
![[*]](images/davis/default_icon.gif){kind=icon}
