@Kagashe Editing the script solved it, thanks Sebastian.

@Sebastian-Roth Weird I figured that was the issue, so I whitelisted the machine on my firewall just to test but still didn’t work and there’s nothin in the firewall logs to suggest that it’s blocking anything, it’s a strange one…
Will give your suggestion a go now.

@Sebastian-Roth All servers are Ubuntu 16.04, below are the logs

/usr/bin/lsb_release
/bin/systemctl
Reading package lists...
Building dependency tree...
Reading state information...
ntpdate is already the newest version (1:4.2.8p4+dfsg-3ubuntu5.9).
software-properties-common is already the newest version (0.96.20.7).
python-software-properties is already the newest version (0.96.20.7).
The following packages were automatically installed and are no longer required:
  libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap libbrotli1
  libgd3 libjansson4 libjbig0 liblua5.2-0 libnghttp2-14 libtiff5 libwebp6
  php-common
Use 'sudo apt autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
29 Nov 13:40:51 ntpdate[8213]: adjust time server 46.17.63.196 offset -0.019258 sec
Generating locales (this might take a while)...
  en_US.UTF-8... done
Generation complete.
gpg: keyring `/tmp/tmpr79_9sh8/secring.gpg' created
gpg: keyring `/tmp/tmpr79_9sh8/pubring.gpg' created
gpg: requesting key E5267A6C from hkp server keyserver.ubuntu.com
Error: retrieving gpg key timed out.
gpg: /tmp/tmpr79_9sh8/trustdb.gpg: trustdb created
gpg: key E5267A6C: public key "Launchpad PPA for Ondřej Surý" imported
gpg: Total number processed: 1
gpg:               imported: 1  (RSA: 1)
OK
gpg: keyring `/tmp/tmp0z4tf8uy/secring.gpg' created
gpg: keyring `/tmp/tmp0z4tf8uy/pubring.gpg' created
gpg: requesting key E5267A6C from hkp server keyserver.ubuntu.com
Error: retrieving gpg key timed out.
gpg: /tmp/tmp0z4tf8uy/trustdb.gpg: trustdb created
gpg: key E5267A6C: public key "Launchpad PPA for Ondřej Surý" imported
gpg: Total number processed: 1
gpg:               imported: 1  (RSA: 1)
OK

@Sebastian-Roth Have upgraded all the sites to 1.5.5.1 except one where I’m getting the following error

Adding Needed Repository…Failed!

Apart from that, all seems to be going well.

@george1421 Aaaaaaand it just happened again

@george1421 Yes that was the last change I made to the config.

@george1421 This seems so have solved the issue so far, I’ve added to more mirrors to the mix and still haven’t had the 504 error again.

@george1421 Sorry haven’t answered been a hectic few days, have updated my config with the script you posted, will test it and feedback. Thanks for all the help so far, it’s much appreciated.

Hi Sebastian and George,

I currently have around 300 hosts and around 10 Mirrors with the locations add-on registered but aim to get to 600 odd hosts and 36 mirrors in the coming months.
Top 3 processes CPU usage is php-fpm: pool www with at most about 12% each.
Load on the system is showing as 0.34 0.33 0.29
System is an i3 Processor with 16GB of DDR4 Ram a 120GB solid state and a 1TB Mechanical drive mounted at /images.
Running Ubuntu Server 16.04.

Apche Log shows the following error every 2 odd seconds

[Fri Nov 02 14:13:10.001117 2018] [proxy_fcgi:error] [pid 3236] [client 10.10.3.7:41454] AH01071: Got error 'PHP message: PHP Notice:  A non well formed numeric value encountered in /var/www/fog/status/bandwidth.php on line 109\nPHP message: PHP Notice:  A non well formed numeric value encountered in /var/www/fog/status/bandwidth.php on line 109\nPHP message: PHP Notice:  A non well formed numeric value encountered in /var/www/fog/status/bandwidth.php on line 110\nPHP message: PHP Notice:  A non well formed numeric value encountered in /var/www/fog/status/bandwidth.php on line 110\n

php-fpm log loops the following statement

[25-Sep-2018 15:01:01] NOTICE: fpm is running, pid 29251
[25-Sep-2018 15:01:01] NOTICE: ready to handle connections
[25-Sep-2018 15:01:01] NOTICE: systemd monitor interval set to 10000ms
[25-Sep-2018 15:03:40] NOTICE: Terminating ...
[25-Sep-2018 15:03:40] NOTICE: exiting, bye-bye!

Hi George,

Made the changes and still seem to get the error but getting less, seems to happen most when I add another storage location, also having very long load times in the browser.

@george1421

Found it, let me give it a run and see how it goes, thanks for the help.

Hi George,

FOG is on 1.5.4 running on Ubuntu 16.04.
Where do i have to make the adjustment?

hi Guys,

My server keeps going offline with the following error, what could be causing it?

Hi guys, I have very slow links and a lot of nodes to replicate two but often need the image at a certain node before others, is there a way that I can force replicate to a specific node first?

Hi Guys,

I want to check the integrity of the images on my mirrors, will the file integrity plugin do this for me? if so how do i go about it?

Thanks I figured as much but was wondering why my storage nodes only had minimal traffic between them even though i had re-uploaded an image.

Hi Guys,

If I make a change to an image and reupload it, does fog replicate the difference or does it resend the whole image?

Hi Guys,

My bandwidth graph seems to be unhappy with life has been this way since 1.5.2, any idea how i can solve it?

Just an Update,

Ram Usage remains high however the UI has gone back to normal loading times so happy with that. One other issue I ran into is when adding or editing a snapin FOG says a name is required even though I have entered a name?

@tom-elliott there was a 1.5.0 binaries folder sitting there which I deleted and that solved the binaries error, thanks for that, will monitor the ram usage as have upgraded to 1.5.2 and feedback the results.