Posts made by sbenson

sbenson

Thank you everyone, this has been resolved. I will say the replication/node setup was the most confusing thing about fog. Everything else is straight forward. Maybe it was just me but a “Storage Nodes for Noobs” might be a good sticky post that explains how to setup a simple 2 server storage node. Other than that everything has been awesome. Thanks for all your hard work.

sbenson

@Tom-Elliott I didn’t realize the restarting of the service deleted the file and recreated it. I thought it would just append to it

sbenson

ok…good news…it’s replicating an image…that I dont want it to(it was set to replicate). So i know replication is working now. Now to test if I deploy a machine from MHB to see if it hits SRO at all… I will keep you updated. Need to reach out to someone in MHB

sbenson

@Tom-Elliott said in FogReplicator and Storage Nodes.:

True true true.

restarted on both
SRO

[17:05:16] root@SRO-FOG-01[0]:/var/log/fog$ systemctl restart FOGImageReplicator FOGSnapinReplicator; tail -n10 -f fogreplicator.log
[05-13-17 12:03:41 am]  * Found Image to transfer to 1 node
[05-13-17 12:03:41 am]  | Image Name: W7P-T460s
[05-13-17 12:03:42 am]  | W7P-T460s: No need to sync d1.fixed_size_partitions file to MHB-Slave
[05-13-17 12:03:42 am]  | W7P-T460s: No need to sync d1.mbr file to MHB-Slave
[05-13-17 12:03:43 am]  | W7P-T460s: No need to sync d1.minimum.partitions file to MHB-Slave
[05-13-17 12:03:43 am]  | W7P-T460s: No need to sync d1.original.fstypes file to MHB-Slave
[05-13-17 12:03:43 am]  | W7P-T460s: No need to sync d1.original.swapuuids file to MHB-Slave
[05-13-17 12:03:43 am]  | W7P-T460s: No need to sync d1.partitions file to MHB-Slave
[05-13-17 12:03:44 am]  | W7P-T460s: No need to sync d1p1.img file to MHB-Slave
[05-13-17 12:03:44 am]  | W7P-T460s: No need to sync d1p2.img file to MHB-Slave

MHB

[17:05:40] root@MHB-FOG-01[0]:/var/log/fog$ systemctl restart FOGImageReplicator FOGSnapinReplicator;tail -n10 -f fogreplicator.log
[05-03-17 4:01:10 am]  *  | This is not the master node
[05-04-17 4:11:10 am]  *  | This is not the master node
[05-05-17 4:21:10 am]  *  | This is not the master node
[05-06-17 4:31:11 am]  *  | This is not the master node
[05-07-17 4:41:11 am]  *  | This is not the master node
[05-08-17 4:51:11 am]  *  | This is not the master node
[05-09-17 5:01:11 am]  *  | This is not the master node
[05-10-17 5:11:11 am]  *  | This is not the master node
[05-11-17 5:21:11 am]  *  | This is not the master node
[05-12-17 5:31:11 am]  *  | This is not the master node

sbenson

@Tom-Elliott said in FogReplicator and Storage Nodes.:

So:
SRO side Needs:
Master (SRO-FOG-01)
Slave (MHB-FOG-01)
MHB Side Needs:
Master (MHB-FOG-01)

Done, SRO has

| MHB-Slave  |        | 10.63.57.42 | fog  | BaLVo | ens160    |
| SRO-Master | 1      | 10.63.76.44 | fog  | RoiYx | ens160    |

MHB has

| MHB-Master | 1      | 10.63.57.42 | fog  | BaLVo | ens160    |

sbenson

@Tom-Elliott said in FogReplicator and Storage Nodes.:

Unless you need it, the MHB Server does not need a second node. There is literally no point for it.

It’s only there because George said so

@george1421 said in FogReplicator and Storage Nodes.:

OK we need to get something cleared up. Tom and I have been chatting and we need to understand. At site MHB how many fog servers are installed master or slave nodes. I think we’ve been adding complexity because I misunderstood something

There are a TOTAL of 2 servers in the whole company, SRO-FOG-01 and MHB-FOG-01. Both of these machines are installed on our vmware infrastructures(no not the same ESXI hosts).

sbenson

@george1421
SRO

mysql> select ngmMemberName as name,ngmIsMasterNode as master, ngmHostname as host,ngmUser as user, left(ngmPass,5) as pass, ngmInterface as interface from nfsGroupMembers;
+------------+--------+-------------+------+-------+-----------+
| name       | master | host        | user | pass  | interface |
+------------+--------+-------------+------+-------+-----------+
| MHB-Slave  |        | 10.63.57.42 | fog  | BaLVo | ens160    |
| SRO-Master | 1      | 10.63.76.44 | fog  | RoiYx | ens160    |
+------------+--------+-------------+------+-------+-----------+
2 rows in set (0.00 sec)

MHB

mysql> select ngmMemberName as name,ngmIsMasterNode as master, ngmHostname as host,ngmUser as user, left(ngmPass,5) as pass, ngmInterface as interface from nfsGroupMembers;
+------------------+--------+-------------+------+-------+-----------+
| name             | master | host        | user | pass  | interface |
+------------------+--------+-------------+------+-------+-----------+
| MHB-Master       | 1      | 10.63.57.42 | fog  | BaLVo | ens160    |
| MHB-Storage_Node |        | 10.63.57.42 | fog  | BaLVo | ens160    |
+------------------+--------+-------------+------+-------+-----------+
2 rows in set (0.00 sec)

sbenson

@george1421 But the userid and password are required…or atleast they have an asterisk next to them making it seem like they are. I did notice a problem, the interfaces on these boxes aren’t eth0, they are ens160 on both. I can’t imagine that would cause the traffic to magically be routed to the SRO machine.

sbenson

@george1421

On SRO

mysql> select ngmMemberName as name,ngmIsMasterNode as master, ngmHostname as host,ngmUser as user, left(ngmPass,5) as pass from nfsGroupMembers;
+------------+--------+-------------+------+-------+
| name       | master | host        | user | pass  |
+------------+--------+-------------+------+-------+
| MHB-Slave  |        | 10.63.57.42 | fog  | BaLVo |
| SRO-Master | 1      | 10.63.76.44 | fog  | RoiYx |
+------------+--------+-------------+------+-------+

On MHB

mysql> select ngmMemberName as name,ngmIsMasterNode as master, ngmHostname as host,ngmUser as user, left(ngmPass,5) as pass from nfsGroupMembers;
+------------------+--------+-------------+------+-------+
| name             | master | host        | user | pass  |
+------------------+--------+-------------+------+-------+
| MHB-Master       | 1      | 10.63.57.42 | fog  | BaLVo |
| MHB-Storage_Node |        | 10.63.76.44 | fog  | RoiYx |
+------------------+--------+-------------+------+-------+

sbenson

@george1421 In the past I was under the impression that you were saying 2 Nodes on each host, one Master and Slave per each. So SRO-Master@SRO -> SRO-Slave@MHB, and MHB-Master@MHB -> MHB-Slave@SRO. Kind of providing a round robin syncing. This has been changed to match your setup. I do have a question about the passwords in this setup
MHB-Master@MHB will have the PW from
/opt/fog/.fogsettings
username=‘fog’
password=“passwordA”

MHB-Storage_Node@MHB will have the PW from SRO:/opt/fog/.fogsettings

SRO-Master@SRO will have SRO’s
and MHB-Slave@SRO will have MHB’s?

sbenson

@Tom-Elliott how does a “storage group” contain information about the nodes? It seems as if each node has to be told it is part of a specific storage group(so it’s a little backward). Also will it cause a problem if the storage groups on both servers are the “Default” or will it require a separate group on each server?

sbenson

@Tom-Elliott @george1421
I have recreated the nodes, and had someone at the MHB office try and deploy an image(W7P-HP6300). The image was originally created on the SRO server, but synced to the MHB server months ago. I had the machine register with fog, on the MHB(10.63.57.42) server. On a side note the MHB office has 2 network ranges 10.63.57.x and 10.63.65.x). After registering the server, we went in to the MHB fog web gui, set the Image to the W7P-HP6300 image, Tasks, basic, deploy. We then rebooted the machine and selected pxe boot. This started pulling down the image, but a lot slower than we would expect for a gigabit network. This machine was pulling the Image from SRO over our 100mb MPLS network.

We have confirmed that both DHCP pools point to the 10.63.57.42 server.

I dumped the fog database on MHB and the only time 10.63.76.44 is mentioned is in the node defenition previously shown

How does a machine being imaged, boot from the fog server in the same office, register to that server, have an image pushed to it from that server, yet the traffic comes from our main server in SRO?

W7P-HP6300 on MHB

             imageID: 10
           imageName: W7P-HP6300
           imageDesc: Conference Room PC
HP ProDesk 6300
Office
Sysprep
           imagePath: W7PHP6300
        imageProtect: 0
      imageMagnetUri:
       imageDateTime: 2017-05-12 13:28:34
       imageCreateBy: sbenson
       imageBuilding: 0
           imageSize: 104853504.000000:27798433792.000000:
         imageTypeID: 1
imagePartitionTypeID: 1
           imageOSID: 5
         imageFormat:
     imageLastDeploy: 0000-00-00 00:00:00
       imageCompress: 1
        imageEnabled: 1
      imageReplicate: 1

W7P-HP6300 on SRO

             imageID: 5
           imageName: W7P-HP6300
           imageDesc: Conference Room PC
HP ProDesk 6300
Office
Sysprep
           imagePath: W7PHP6300
        imageProtect: 0
      imageMagnetUri:
       imageDateTime: 2016-10-24 21:41:02
       imageCreateBy: sbenson
       imageBuilding: 0
           imageSize: 104853504.000000:6786727.000000:27798433792.000000:
         imageTypeID: 1
imagePartitionTypeID: 1
           imageOSID: 5
         imageFormat:
     imageLastDeploy: 2016-10-24 21:57:14
       imageCompress: 1
        imageEnabled: 1
      imageReplicate: 1

[13:53:20] root@MHB-FOG-01[0]:/opt$ cd fog/
[13:53:21] root@MHB-FOG-01[0]:/opt/fog$ grep 10.63.76.44 -r *
[13:53:31] root@MHB-FOG-01[0]:/opt/fog$ cd /var/www/html/fog/
[13:53:44] root@MHB-FOG-01[0]:/var/www/html/fog$ grep 10.63.76.44 -r *
[13:54:49] root@MHB-FOG-01[0]:/images$ cd W7PHP6300/
[13:55:00] root@MHB-FOG-01[0]:/images/W7PHP6300$ ls -lsa
total 13031508
       4 drwxrwxrwx  2 fog root        4096 Oct 24  2016 .
       4 drwxrwxr-x 14 fog root        4096 May  5 17:08 ..
       4 -rwxrwxrwx  1 fog root           3 Oct 24  2016 d1.fixed_size_partitions
    1024 -rwxrwxrwx  1 fog root     1048576 Oct 24  2016 d1.mbr
       4 -rwxrwxrwx  1 fog root         190 Oct 24  2016 d1.minimum.partitions
       4 -rwxrwxrwx  1 fog root          15 Oct 24  2016 d1.original.fstypes
       0 -rwxrwxrwx  1 fog root           0 Oct 24  2016 d1.original.swapuuids
    9172 -rwxrwxrwx  1 fog root     9390413 Oct 24  2016 d1p1.img
13021288 -rwxrwxrwx  1 fog root 13333793671 Oct 24  2016 d1p2.img
       4 -rwxrwxrwx  1 fog root         190 Oct 24  2016 d1.partitions
[13:55:04] root@MHB-FOG-01[0]:/images/W7PHP6300$ grep 10.63.76.44 d1\.*

sbenson

SRO/MASTER

ngmID: 4
       ngmMemberName: SRO
ngmMemberDescription: Local fog storage in SRO
     ngmIsMasterNode: 1
          ngmGroupID: 1
         ngmRootPath: /images
          ngmSSLPath: /opt/fog/snapins/ssl
          ngmFTPPath: /images
       ngmMaxBitrate:
       ngmSnapinPath: /opt/fog/snapins
        ngmIsEnabled: 1
         ngmHostname: x.x.76.44
       ngmMaxClients: 10
   ngmBandwidthLimit: 2000
             ngmUser: sync
             ngmPass: Some PasswordA
              ngmKey:
        ngmInterface: eth0
     ngmGraphEnabled: 1
          ngmWebroot: /fog

MHB slave

        ngmID: 4
       ngmMemberName: MHB
ngmMemberDescription:
     ngmIsMasterNode: 1
          ngmGroupID: 1
         ngmRootPath: /images
          ngmSSLPath: /opt/fog/snapins/ssl
          ngmFTPPath: /images
       ngmMaxBitrate:
       ngmSnapinPath: /opt/fog/snapins
        ngmIsEnabled: 1
         ngmHostname: x.x.57.42
       ngmMaxClients: 1
   ngmBandwidthLimit: 1
             ngmUser: NONVALIDUSER
             ngmPass: Gibberish password
              ngmKey:
        ngmInterface: eth0
     ngmGraphEnabled: 1
          ngmWebroot: /fog
*************************** 2. row ***************************
               ngmID: 5
       ngmMemberName: SRO
ngmMemberDescription:
     ngmIsMasterNode:
          ngmGroupID: 1
         ngmRootPath: /images
          ngmSSLPath: /opt/fog/snapins/ssl
          ngmFTPPath: /images
       ngmMaxBitrate:
       ngmSnapinPath: /opt/fog/snapins
        ngmIsEnabled: 1
         ngmHostname: x.x.76.44
       ngmMaxClients: 10
   ngmBandwidthLimit: 20000
             ngmUser: sync
             ngmPass: Some PasswordA
              ngmKey:
        ngmInterface: eth0
     ngmGraphEnabled: 1
          ngmWebroot: /fog

Does this look correct?

sbenson

@george1421 said in FogReplicator and Storage Nodes.:

In this case SRO server should ONLY have the MHB fog server, with the SRO fog server setup as master. All others not the master. This will tell the Master FOG server to replicate to everyone else that is not a master.
On the MHB fog server I think you have one storage node, If that is the case create the MHB fog server as the master node and your MHB storage node as not the master.
This setup will then only sync SRO FOG server -> MHB fog server and MHB Fog server -> MHB Storage node. That way there is only one replication across the WAN.

Sorry for the delay in getting back to you, been busy with other projects. So fog servers pull from the master node, not get pushes from the master node?

So on SRO I create an SRO node where it is the master, it’s own IP and set a user/pass for it
On MHB I set MHB as a master node(storing images in /images?) and a SRO as a client node(also storing images in /images?)

Edit, wait that is totally backwards from what you just said, let me re-work this

sbenson

@george1421 said in FogReplicator and Storage Nodes.:

So in this case you should be able to power off the fog server at SRO and the MHB fog server and clients should image without issue. This IS the design.

This is what we were looking for, that is why we wanted it to sync automatically during the middle of the night. Then possibly the only thing we would have to do after a sync is export the images(txt file) on SRO, and import them on the MHB server

sbenson

@george1421 said in FogReplicator and Storage Nodes.:

https://forums.fogproject.org/topic/6014/create-the-concept-of-a-foreignmasterstorage-deployment-node/13

That is super confusing.

sbenson

@george1421 2 Physical servers SRO-FOG-01 and MHB-FOG-01.
for all intents and purposes SRO-FOG-01 is the Main server that will have the majority of work done on it(Creating new images, deployments, changes, etc). The MHB-FOG-01 will deploy images that I would have created on SRO-FOG-01, and synced over to MHB-FOG-01. The MHB-FOG-01 should NEVER tell anyone in the Southern California(MHB-FOG-01) network to pull from the Northern California(SRO-FOG-01) server.

From what you explained it kinda matches what I have…except some things are weird.

SRO-FOG-01 has 2 storage nodes listed, SyncMHB(Not master) and SyncSRO(Master).
…SyncMHB is set to IP x.x.57.42(the IP of MHB-FOG-01), Storage Group default, Img Path = /images, etc…
…SyncSRO is set to the local IP x.x.76.44, Storage Group default, same Image path, etc.

MHB-FOG-01 has one storage node, SRO(Not Master, I was told the name didn’t matter)
…SRO is set to x.x.76.44, default storage group, paths, etc…

It may be best to just start over and say this. I have fog servers in 2 different cities, on 2 different internet circuits. I want the Images on Server 1 to be replicated on Server 2. What is the best method to complete this?

sbenson

@george1421 here is a quick question. Am I supposed to have a default storage node and an extra one for SRO? This might be the problem. The original default storage node was removed so there is only a SRO storage node listed. tho the SRO server has 2 storage nodes. One labeled SyncMHB and one labeled SyncSRO. I will admit the Storage nodes have been extremely confusing from other replication services I have used in the past.

sbenson

@george1421 said in FogReplicator and Storage Nodes.:

I wonder if the spike in network traffic your network admin saw was actually image replication between the two fog servers??

This is not the case, I actually have the replication service set on a 24 hour cycle, and restart the service at 2am(iirc). This was the only way to make the replication happen at a given scheduled time.

sbenson

@george1421 I haven’t tried powering off the main server. I can give that a shot and see if the MHB server even responds. I do feel this has to do with some snafu in my storage nodes. When I originally tried setting the syncing up I was under the impression it was the opposite direction(pull vs push).