GSB Forums

GSB Resource Manager

admin - 3-12-2018 at 04:12 AM

I have made a util that kills the gsbworker that uses the most ram,
if your ram free is < x. Once ram free >y it will open up the worker again.
Is this of interest to anyone?

waldocktrades - 3-12-2018 at 12:03 PM

That would be great. I just emailed you regarding the most efficient settings for my office network.

admin - 3-12-2018 at 02:57 PM

Quote: Originally posted by waldocktrades  
That would be great. I just emailed you regarding the most efficient settings for my office network.

Progream works well. Will make one tweak and then send to you.

Bruce - 3-12-2018 at 04:44 PM

Quote: Originally posted by admin  
Quote: Originally posted by waldocktrades  
That would be great. I just emailed you regarding the most efficient settings for my office network.

Progream works well. Will make one tweak and then send to you.


Peter, I'd be keen for a copy as well.

Thx.

engtraderfx - 3-12-2018 at 10:14 PM

Ditto!

admin - 3-12-2018 at 11:02 PM

Program works great, but suspect its more for the users with fair bit of ram already.
Im getting updates so it will start new workers if ram is ok, and cpu not 100%
Hopefully release < 1week.

Carl - 4-12-2018 at 12:05 AM

Hi Peter,

I would like to have a copy as well.
Thanks

admin - 4-12-2018 at 07:05 PM

Bugs in todays build so here is version 1.0
Its Basic
Features in future build are...
Option to keep running new workers if ram and cpu permit until cpu or ram full.
Option to Kill idle workers, and restart them. This will save ram.

exe file is here.
https://trademaid.info/forum/viewthread.php?tid=129#pid2939

admin - 5-12-2018 at 12:28 AM

Docs for new version are in the config file.



Attachment: Login to view the details


admin - 5-12-2018 at 04:13 PM

version 20181205.5 is out in private forum

New version. Has budget of ram each worker likely to use.
Without this I could have crashed in this situation.
ram was nearly full due to high amount of open managers doing nth change etc.
workers idle.
so we started max amount of workers. Ram useage was tiny.
When Manager starts workers, 10 workers would start up with only 20 GB of ram

admin - 21-12-2018 at 03:41 PM

Its really the same topic, but I put a post here on GSB ram2.0
https://trademaid.info/forum/viewthread.php?tid=201#pid3094

admin - 8-1-2019 at 10:16 PM

GSB ram is almost ready. Took massive amount of time to build, but has big cloud improvement implications for all of us. This is why cloud workers has increased of late.

Full docs in the enclosed help file / pdf
put the help file in your GSB folder. Then Help in top right of GSB


rmdocs.png - 257kB

Attachment: Login to view the details

Attachment: Login to view the details


admin - 8-1-2019 at 10:51 PM

Forgot to add this to the docs


save.set.png - 54kB

admin - 13-1-2019 at 10:04 PM

exe file is here
https://trademaid.info/forum/viewthread.php?tid=208

admin - 22-1-2019 at 08:12 PM

Updated docs here.



Attachment: Login to view the details


admin - 15-2-2019 at 07:03 PM

New RM out in about a week.
Can run when computer starts up.
Can run workers as soon as RM opened. (you dont have to hit start)
Can run x workers when a group starts at 0. This means you get more works starting up faster.

This upgrade is not essential. Likely I will add zipped update of the new files with a later build of GSB.
You will need to unzip them and put them in your rm folder.



rm.updates.png - 44kB

admin - 25-2-2019 at 12:44 AM

There is a updated RM coming soon.
When RM detects we run out of ram, it runs a free ram up program. It puts some ram into the swap file (Virtual memory)
Shown here the effect on a server with 320 GB ram, and one with 32 GB
This allows us to still run 3 workers on the 32GB machine. I expect a slight speed penalty as GSB cache will be slower to access. for a short period.



rm-32gb.png - 159kBrm-highRam.png - 12kB

admin - 25-2-2019 at 07:54 PM

Here is the latest docs. Update on RM.
This is not a essential update.
Whats new is on page 108 to 109


Attachment: Login to view the details


admin - 26-4-2019 at 01:47 AM

There is a new build of RM, in your GSB folder when I do the next GSB update.
To upgrade, close your old RM
Unzip GSBResourceManager.20190426.5 and put it in the same folder as your current rm.
Then start the old build. This is not a essential update.

It has improved logging and auto kill of all workers >50gb of ram. The 50 GB is a input that is adjustable.
I had one worker hit 160 GB of ram. This has only happened once, and I dont expect to see the issue again.
But this RM features is to protect you from running out of ram if this ever happens again.

admin - 9-6-2019 at 11:26 PM

An update to RM is almost ready.
It has auto config for new users, depending on how much ram your computer has.

New build of Rm will updated Version.txt each time we get a new version of GSB.

The GSB new installer users version.txt to launched the must current build of gsb from the desktop shortcuts.

Old versions of RM did not update sub folders which mean your not going to get new eld and macros when there are updates.

admin - 14-8-2019 at 10:37 PM

New build of RM with full installer file released
see top of thread
https://trademaid.info/forum/viewthread.php?tid=208



admin - 19-9-2019 at 09:34 PM

Im intending to get RM upgraded to give these sorts of graphs.
Unless there are no objections, all RM may post this info, but the only identifying feature will be the machine name. GSB3 in this case
RM should have an opt out field anyway

What this is going to tell users (I hope) is the extent to what the free gsb cloud is available / used, plus you can remotely see your own machines useage.
Useful if you want to check that the machine is going, or system building finished etc



graph1.png - 94kB

admin - 25-9-2019 at 05:02 AM

new cloud base reporting on machines with the most current (to be released) resource monitor.

comments welcome
https://trademaid.info/grafana/d/BYDsOIpWz/gsb?orgId=1&refre...

Carl - 25-9-2019 at 01:04 PM

Beautiful!

Thanks Peter

admin - 28-10-2019 at 11:24 PM

There is a new RM out today. It should auto update for all users if you have a more current RM.
You can now start / kill workers according to CPU temperature.

Useful if you hate noise and happy to run slower when its hot,
or one user has a high end I9 cpu with lack of proper CPU cooling (best have a 3 fan water cooler for i9)

You need to run RM as windows administrator for it to work, and have temp enabled to true.
There also is CPU power saving mode too. IF CPU is very low, go to power saving mode. (Not recommend for a live trading computer)

this link shows how to make RM run as adminstrator mode.
https://www.google.com/search?client=firefox-b-d&q=how+to+ma...




power.png - 11kBtemp.png - 14kB

admin - 8-11-2019 at 06:38 PM

20191108.1 build out. Had run as admin mode. Essential if oyu want CPU temperature throttling


admin.png - 7kB

JasonT - 8-11-2019 at 07:47 PM

Quote: Originally posted by admin  
20191108.1 build out. Had run as admin mode. Essential if oyu want CPU temperature throttling


Hi Peter, can you confirm where the most recent RM version is? The version in the attached image (20190926.2)seems different to that listed in your post (20191108.1).

Can you point me in the right direction please?

Thanks, Jason

Current RM Version.png - 84kB

admin - 8-11-2019 at 08:44 PM

092602 or later should update to 20191108.01
If it doesnt, send me teamviewer detials

JasonT - 9-11-2019 at 12:52 AM

Quote: Originally posted by admin  
092602 or later should update to 20191108.01
If it doesnt, send me teamviewer detials


Thanks Peter that worked. Previously we had to download new versions of RM from the forum. It is good to see that it now updates itself as well as GSB.

2019-11-09.png - 9kB

admin - 5-12-2019 at 01:19 AM

updates to RM will come soon.
Fix for the following
new version of manager doesnt appear in c:\gsb
rm sometimes goes to stopped mode after internal error

The update will be automatic for all users

admin - 1-5-2020 at 01:51 AM

New RM released today. 20200212.1
It has better allocation of CPU usaged in that if you start using your workers when the cloud ones are running, it kills the cloud workers in a more precise way.

Old build sometimes left a cloud work running even when your using all your workers

Daniel UK1 - 1-5-2020 at 05:46 AM

Peter, it says downloading failed, when i click on yes to the question if i want to install the new RM

Something wrong on my side?

Daniel

admin - 1-5-2020 at 05:47 AM

Quote: Originally posted by Daniel UK1  
Peter, it says downloading failed, when i click on yes to the question if i want to install the new RM

Something wrong on my side?

Daniel

close rm and update these files


File removed

Daniel UK1 - 1-5-2020 at 06:23 AM

Quote: Originally posted by admin  
Quote: Originally posted by Daniel UK1  
Peter, it says downloading failed, when i click on yes to the question if i want to install the new RM

Something wrong on my side?

Daniel

close rm and update these files


Thanks, did the trick

admin - 26-5-2020 at 02:27 AM

new rm 20200525.2
Has temperature throttling if your cpu gets to hot.
default is off

Must be in windows administrator mode to work.
Its good incase your cpu ends up cooking.
Ive seen this on a I9 with only 2 fan water cooler. They normally need 3 fan.
Once had super micro ipmi bios screw up and not run the cooling on one cpu.
Had a motherboard on a bench with heatsink and fan just held by gravity. fan got knocked off.... RM shut down workers


tempgraph.png - 29kB temp-settings.png - 27kB

admin - 26-5-2020 at 05:53 AM

GSB resource manger should auto update by itself. If it doesnt get files below and over write the old ones.
These are the updated files, NOT all the files required to run RM

https://u.pcloud.link/publink/show?code=XZtEaqkZgAGICfscdhF0...

engtraderfx - 26-5-2020 at 11:53 PM

thanks for link peter, had same error running update.

admin - 26-5-2020 at 11:56 PM

Quote: Originally posted by engtraderfx  
thanks for link peter, had same error running update.


a few users did. I can fix for all if you give me teamviewer.com details
I need to make a copy of the logs

Daniel UK1 - 27-5-2020 at 02:22 AM

This auto update went flawlessly, however i also had previous mentioned issue in last update but i manually changed files from Peters link, and then it worked and also now in future auto updates.. so not sure if it helps Peter, but just wanted to chip in.

Daniel UK1 - 4-7-2020 at 03:01 AM

A good tip is to make sure you have the correct settings on RM, i have been using my RM for around a year, not really thinking so much of the settings, my RM gave me around 3 workers.. after a random Teamviever session with Peter for an unrelated issue... he changed some settings on my RM, and from that point my RM gave me 8 workers on this PC ... this happened a couple of month ago... So been wasting CPU resources for years before that :) .. Take away... keep check on your RM setting

admin - 13-7-2020 at 08:53 PM

20200713.1 resource manager
It has likely fix for some users managers not updating.
Reason we think is if a manager is open, dll files are locked and update aborted.
(There were updates to dll in the last few months)
Please confirm this downloads when you start RM (should update regardless)

uhrbi - 14-7-2020 at 09:22 AM

RM won't update to new version. It starts the process and stops immediately.

Carl - 14-7-2020 at 09:53 AM

Hi uhrbi,

Here the same issue.

I decided to just start RM without updating.
And then the update started.

uhrbi - 14-7-2020 at 09:58 AM

Hey Carl,

that worked, thx for the tip.

BlackBox - 15-7-2020 at 03:34 PM

The folder C:\GSB\GSBResourceMonitor\temp is probably missing, according to the log file.
When I create that folder, my update runs smoothly.

BlackBox - 15-7-2020 at 03:52 PM

Another glitch, don't forget to update the shortcut too.

RM.JPG - 51kB

admin - 15-7-2020 at 04:13 PM

next time someone has a rm that wont update, let me know as I want to see one in fault condition.
There are still minor updates to Rm coming in the future.

admin - 16-10-2020 at 11:31 PM

New RM is built, but if I release it it will give option to download when you start RM.
If you say yes, the download will fail.
Regardless it will auto update later on.
This fix for this issue is in the 20201013.2 build
Also better CPU calculation measurements for high end machines. It means you can drive the CPU closer to 100%
my dual 2699v3 servers improved with this build.
Also the option to NOT download GSB when there is a new build. (best leave as auto download unless you have issues)

admin - 10-1-2021 at 11:45 PM

new rm is here
https://trademaid.info/forum/post.php?action=edit&fid=2&tid=...
I will push it out in a few days of testing

admin - 8-4-2021 at 02:44 AM

build 20210408.2 is out, with isntaller file.
I will push via auto update after another day of testing.
No known issues
download from here
https://trademaid.info/forum/viewthread.php?tid=208#pid3239

admin - 8-9-2021 at 08:19 PM

build 20210908.1 Bug fix
There was a bug where workers were not updated if they were running when a new build of GSB was released

admin - 18-11-2022 at 12:15 AM

Updates to RM are as follows
you can tell the expiry date of rm, when your maintenance is due.
Support for new CPU's. Old build did not read temperature of very new hardware.
(Temperature feature really useful should you get failed cooling system)
start x workers on startup for all groups of workers
One more improvement to go before its rolled out




rm-expires.png - 171kB

admin - 30-5-2024 at 05:04 AM

update of GSB resource manager done via auto update

Has softkill of workers, which makes the back end data base run much better.
All users should be on 202405xx build to be on the new GSB database server, and to get updates of new GSB versions.
There will be no more updates of GSB on the older RM
New RM 202405 build is in private forum, and this updates to todays build

admin - 6-6-2024 at 01:44 AM

The private forum has a new msi installer to fix the error, newer build already installed.
If your on a May 2024 build of RM, not need to do anything.
More updates to RM expected in the next month. Working on further improvements so workers are never hard killed. My guess is 2 to 5% of workers get a hard kill (terminate) rather than a soft kill (close)

see the top of https://trademaid.info/forum/viewthread.php?tid=208#pid3239

admin - 4-12-2025 at 10:02 PM

There is a new build of Resource manager in the private forum.
It has a fix for false positive in microsoft anti virus, and some other refinements like improved priority for windows 11 machines.
It is not essential users update