GSB Forums - Powered by XMB 1.9.11

GSB Client / Server

admin - 25-8-2017 at 04:55 PM

GSB client / server beta has arrived.
I enclose a screen shot of it running.

You can now run multiple copies of GSB on one machine to increase the speed.
(GSB uses only a part of full CPU usage, esp on the 8/16 + core machines)
and you can run on multiple computers if you have a GSB license for each computer.

We are using a dropbox folder for GSB client server to communicate, or you can use a local lan shared folder.
Documentation is here.
Attachment: Login to view the details

admin - 27-8-2017 at 07:03 PM

admin - 31-8-2017 at 05:01 AM

With 4 pc,s I reached the speed of 60,000 systems per minute, using ES & spx 30 minute bars.
See screen shot.
More updates coming in the next week.
Client server also works with google drive.

cyrus68 - 1-9-2017 at 01:12 AM

As I understand it, one licensed copy (the manager) is essentially redundant, in the sense that it does not participate in the grunt work of number crunching. Licensed copies 2, 3, ...etc.. (the workers) would do the processing, whether on the same computer as the manager or on other computers on the Lan.

Regarding drives, my own preference is to use a shared folder on a NAS.

As for systems, the typical system I would run would be based on date1, 2, 3, 4 and 5; as well as 2 custom indicators on 60,000 bars.

I see that there is no restriction on the number of cores that GSB is allowed to use. This could potentially make other apps unusable while GSB is running.

admin - 1-9-2017 at 01:19 AM

Your correct that it doesn't participate, but this is no big deal. It uses almost no ram and shouldnt use much CPU. We could make the manager work too, but there is no big advantage of this.
GSB is not disk intensive, so shared nas will be a step up from dropbox.
You can set process priority to lowest on all the GSB, but if your running nearly 100% on GSB other apps might be slow. You could also UN-assign other CPU cores for your other apps.
My pcs were running fine with 9 GSB at once. Main thing is you have spare ram.

heyligerb - 16-9-2017 at 06:53 PM

This is great Peter! I'm running 70K systems/min!!!!

For our own understanding, do the workers inherit the settings specified in the manager, or do we need to set them all individual in the workers?

The reason I ask is because it doesn't seem like manager is dividing up one large population, but rather running x workers populations simultaneous..., thus testing more systems in the same period of time, verses running the managers settings quicker.

BTW, this is great either way, I'm so happy with GSB!

admin - 17-9-2017 at 03:57 PM

Im very happy your happy. Havnt had a lot of feedback on client / server.
The next version of GSB is 100% stable. On your version some workers just stop and the speed rating declines.

In answer to your question.
The manager sends the settings to all the workers.
The population is NOT divided up. Total iterations = populations * generations * restarts * workers.
Next build has a metric for cumulative iterations, not just worker iterations.
see enclosed picture.
70k is pretty thrilling. Its about 10x faster than what GSB standalone is, and about 100x Adaptrade Builder.

Manager Not Displaying Results

heyligerb - 18-9-2017 at 07:20 PM

Is it necessary to restart all the workers each time you start a new run from manager?

The reason I ask is that I'm noticing that if I don't, then the results from the current run won't show up in manager. It seems like there's some kind of a disconnect between workers and manager if everything isn't manually reset before the next run begins...

Hopefully it's not by design, because it's somewhat time consuming to do so...

admin - 18-9-2017 at 07:48 PM

I havnt noticed that, but im on a newer build. You should be able to start a new run from the old manager without starting new workers.
You cant start a new manager without starting new workers..
However there are shortcuts to killing all the workers and manager, and shortcuts to running multiple workers.
I would rename your mangager to gsb.manager to it doesnt get killed with the workers.
Im hoping for a update to the manger software soon but its got some issues to be fixed still.

batchfile to start 4 workers.
start "" "c:\Dropbox\gsb\GSB-Workplace-Test\GSB (Workers)DriveD\GSBworker.exe"
start "" "c:\Dropbox\gsb\GSB-Workplace-Test\GSB (Workers)DriveD\GSBworker.exe"
start "" "c:\Dropbox\gsb\GSB-Workplace-Test\GSB (Workers)DriveD\GSBworker.exe"
start "" "c:\Dropbox\gsb\GSB-Workplace-Test\GSB (Workers)DriveD\GSBworker.exe"

batchfile to kill workers
taskkill /IM GSBworker.exe /F

pause

heyligerb - 19-9-2017 at 06:48 AM

oh cool thanks! Brings me back to my DOS days lol... here's the files I created that work for me - for the benefit of all.

Attachment: Login to view the details

Attachment: Login to view the details

cyrus68 - 25-9-2017 at 06:49 AM

I'm trying out version 37.29 of the manager/worker and I can't get it to work from the very first step. As a first trial, I started with the test data files and path.
So I copied the test data into C:\dropbox\GSB-workplace-test\Data (Dropbox shared folder)\Workplaces. This is all done according to the manual.
To begin with, I want to use a single manger/worker. So I set the # of Workers to "0" and the Can Run As Worker to "False".
When I click on Primary Data and look in the above default folder, populated with the test data, it sees none of the 3 files. Instead, I get hundreds of error messages saying "Exception; could not find part of the path. I have to use Task Manager to shut down GSB.
If I try to change the default data-path setting to my LAN drive where I have data, it can't see any of the files either. Again, I get the same error messages and use task Manager to shut it down.
Has anybody been able to make this thing work?

cyrus68 - 25-9-2017 at 07:51 AM

Does anybody know if there is a version of client/server, where you can set the default Lan directory and you can load data from that source, without the software crashing?

It is not even clear what is the default directory for the test data on C:\ . Anybody know what it is?

admin - 25-9-2017 at 02:16 PM

Im traveling today. Will look into this in 24 hours. Thanks for your patience.

admin - 25-9-2017 at 02:47 PM

please send the execption file. its under gsb folder

cyrus68 - 26-9-2017 at 04:58 AM

I ran 37.29 several times yesterday and it bombed. Today, I did the same thing and it worked.

Run the manager.
Set # of workers to 0
Set Run as worker to false. This is counter-intuitive because the idea is to turn the manager into a worker.
Anyway, it works. I can also set the default directory to the Lan drive without crashing.
I'm not interested in using Dropbox as a data server.

cyrus68 - 27-9-2017 at 06:09 AM

Sorry, I spoke to soon about getting version 37.29 to work. It is still buggy.
Here are the steps:
I loaded the Manager and set it to standalone mode.
I set the default directory to my Lan drive. Mercifully, it did not crash.
I clicked on "Primary Data" to load in the data file.
I opened the Lan directory and selected the correct file.
Unfortunately, I immediately got an error message;

GSB
Please select files from the default directory only,
\\Diskstation\gsb\Data\Price Data
Please correct this error and try again.

I had selected the correct file in the "Data" folder. There is no "Price Data" folder.
The default directory was set as: \\Diskstation\gsb\Data

cyrus68 - 27-9-2017 at 07:23 AM

Next, I tried GSB in 1 manager 1 worker mode.
Following the manual, I loaded the Manager and set the default data directory.
Then I loaded the Worker, which had the "Can run as worker" correctly set to True.
However, in the title bar, it indicated Manager rather than Worker. I'm not sure if this indicates a problem.
I tried to change the data directory to the default one. At this point it bombed, generating similar, interminable, error messages, and I had to use Task Manager to shut it down.

Exception: Could not find a part of the path
‘\\Diskstation\gsb\Data\Workplaces.
For more details, please check C:\GSB2\GSB (Managers)\GSB
(Workers)\Exceptions\20170927-075245-732604.txt

This is nonsense. There is no "Workplaces" folder. The data files are in "Data".
At this point, I won't waste any more time on the client/server version.

admin - 27-9-2017 at 02:16 PM

I have been using client server for a month or so, as are other GSB users without these issues. However Im happy to fix them for you. Next beta has improvements to the way manager / worker / standalone is chosen. Currently its not as clear as it should be.

I have replicated your problem.
the public directory has to go to
c:\dropbox\GSB-Workplace-Test\Data (DropBox Shared Folder) {or similar}
this folder must contain price data & workplaces folders.
Your post much earlier mapped to Data (DropBox Shared Folder)\workplaces {incorrect}
It looks like you have the same mistake above.
The worker starts as manager in the title bar, but will change to worker once its received start command from the manager.
this will get tweaked later on.

cyrus68 - 28-9-2017 at 01:25 AM

If I understand you correctly, one has to use a SPECIFIC location [c:\dropbox\GSB-Workplace-Test\Data (DropBox Shared Folder)] and create a "Price Data" folder that contains the data, in order to get client/server to work.

From reading the manual, I thought that one could set the default data directory to ANY shared folder, including a Lan drive. This is what I tried to do. \\Diskstation\gsb\Data is a folder on a Lan drive. Maybe others have been successful in doing this, but I haven't. If they have successfully used a Lan drive for client/server, I would appreciate knowing how it's done.

In the standalone version 36.12, I have no problem in setting the Lan drive as the default data directory.

admin - 28-9-2017 at 01:34 AM

that lan drive doesnt look like its mapped. This is not tested. The fact that it worked in 36.12 is a good sign.
can you map a drive letter to this location?

More importantly you should copy all files from the install files folder gsb-workplace-test\data(dropbox shared folder)
before you run GSB to your shared location.

cyrus68 - 29-9-2017 at 06:11 AM

It works perfectly well in 36.12. The gsb\Data folder on Diskstation is accessible in Windows Explorer, any other computer on the Lan and Syncbackpro. Potentially, a second GSB manager and associated workers on computer #2, on the Lan, would be able to access this location.

I have not mapped a drive letter to this location. There is no need. It is already accessible from everywhere and by everything.

Not sure why I should copy data files from the C:\ drive location to the Lan drive. I already have my own data files populating the data folder on the Lan drive. They were used successfully in 36.12 without a hitch.

admin - 29-9-2017 at 01:24 PM

Quote: Originally posted by cyrus68

Not sure why I should copy data files from the C:\ drive location to the Lan drive. I already have my own data files populating the data folder on the Lan drive. They were used successfully in 36.12 without a hitch.

You should be correct about the paths, its just that I have not tested this.
The reason why you should copy all the contents of the shared folder is, I know this should work.
The shared folder also contains other folders / settings files etc.
Once your working then use your own files etc.

admin - 11-10-2017 at 08:06 PM

GSB Client server documentation updated for today's Beta GSB. Its now much simpler to run GSB client server.
Install the file, run a number of workers, start the manager. Enjoy the speed.

kiran - 17-11-2017 at 12:20 AM

I have an i5 (4 logical processors / 2 cores) 2.5GHz and 16MB RAM - from my Task Mgr->Performance.
Not sure what logical processor means and if it helps Manager/Worker mode.

- makes sense to run GSB in stand-alone mode, correct? No performance gain from Manager-worker mode on 2 cores?

Kiran

admin - 17-11-2017 at 12:41 AM

Quote: Originally posted by kiran

I have an i5 (4 logical processors / 2 cores) 2.5GHz and 16MB RAM - from my Task Mgr->Performance.
Not sure what logical processor means and if it helps Manager/Worker mode.

- makes sense to run GSB in stand-alone mode, correct? No performance gain from Manager-worker mode on 2 cores?

Kiran

Correct, + the ram would be a bit low. If you have a second computer, you might be able to run copie(s) on it
Ideally you want a high end i7 i 9, though its not critical.

Possible to change the default path C:\Dropbox?

Petzy - 20-11-2017 at 01:35 PM

Hi,

I are in the process of setting up a client/server solution with 2 computers sharing data via onedrive.

It work fine so far but it is a little anoying that I have to change the default Public Data Directory to my onedrive directory every time I start a new worker.

Is there a way to change that once for all workers?

Regards,
Peter

P.S.
I have note yet got my licenses. Can that be the problem?

admin - 20-11-2017 at 03:46 PM

Quote: Originally posted by Petzy

Hi,

I are in the process of setting up a client/server solution with 2 computers sharing data via onedrive.

It work fine so far but it is a little anoying that I have to change the default Public Data Directory to my onedrive directory every time I start a new worker.

Is there a way to change that once for all workers?

Regards,
Peter

P.S.
I have note yet got my licenses. Can that be the problem?

Run the worker. Change the path. Then save optimizer settings.
Now all workers will start with this path. I sometimes have problems / issues with changing paths. It can be intermittent. This should be improved with the beta out late today. Your license is added.
Due to the support given over the entire world, I do less urgent work after after my dinner time till the next morning. Trial licenses are 100% functional

kelsotrader - 24-3-2018 at 02:42 AM

Got my new (used) dual xeon Dedicated system up and running today.
GSB installed and is doing around 25,000 to 30,00 a minute. Thats 8 workers local and 2 on the cloud.

Hope to do some serious development now once I learn what all the settings do.
Once I get some of my own development done I will leave some cloud workers going.

admin - 24-3-2018 at 03:05 AM

Quote: Originally posted by kelsotrader

Got my new (used) dual xeon Dedicated system up and running today.
GSB installed and is doing around 25,000 to 30,00 a minute. Thats 8 workers local and 2 on the cloud.

Hope to do some serious development now once I learn what all the settings do.
Once I get some of my own development done I will leave some cloud workers going.

thanks for updates. You should be able to do more workers than that as long as youve got the ram. Collective speed will be faster, though if your focus is on doing lots of wf, keep cpu less active with less workers.