Posts made by adukes40

@Wayne-Workman Well the workstation says 12:30 and the latest timestamp in the log says 12:30… of course I am typing this at 12:30. Could the server time have been knocked out of sync? All of our workstations are set with GPO to pull time from NTP from our state network.

@Wayne-Workman

Well what I provided was between 11:14 and 11:19, the time is right because I brought the log over at 11:47, and the latest time in the log was 11:47. But the times I gave you was while the nic was enabled. Give me a few minutes and I will show you what it does right now. I just cant keep the nic turned on for long because its floods it.

@Wayne-Workman

Here is 5 minutes worth: Starting at 11:14 right around the time the NIC was reenabled:

------------------------------------------------------------------------------
---------------------------------ClientUpdater--------------------------------
------------------------------------------------------------------------------
 9/14/2016 11:14 AM Client-Info Client Version: 0.11.4
 9/14/2016 11:14 AM Client-Info Client OS:      Windows
 9/14/2016 11:14 AM Client-Info Server Version: 1.3.0-RC-10
 9/14/2016 11:14 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:14 AM Middleware::Response ERROR: Object reference not set to an instance of an object.

------------------------------------------------------------------------------
----------------------------------TaskReboot----------------------------------
------------------------------------------------------------------------------
 9/14/2016 11:14 AM Client-Info Client Version: 0.11.4
 9/14/2016 11:14 AM Client-Info Client OS:      Windows
 9/14/2016 11:14 AM Client-Info Server Version: 1.3.0-RC-10
 9/14/2016 11:14 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:14 AM Middleware::Response ERROR: Object reference not set to an instance of an object.

------------------------------------------------------------------------------
--------------------------------HostnameChanger-------------------------------
------------------------------------------------------------------------------
 9/14/2016 11:14 AM Client-Info Client Version: 0.11.4
 9/14/2016 11:14 AM Client-Info Client OS:      Windows
 9/14/2016 11:14 AM Client-Info Server Version: 1.3.0-RC-10
 9/14/2016 11:14 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:14 AM Middleware::Response ERROR: Object reference not set to an instance of an object.

------------------------------------------------------------------------------
---------------------------------SnapinClient---------------------------------
------------------------------------------------------------------------------
 9/14/2016 11:14 AM Client-Info Client Version: 0.11.4
 9/14/2016 11:14 AM Client-Info Client OS:      Windows
 9/14/2016 11:14 AM Client-Info Server Version: 1.3.0-RC-10
 9/14/2016 11:14 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:14 AM Middleware::Response ERROR: Object reference not set to an instance of an object.

------------------------------------------------------------------------------
--------------------------------PrinterManager--------------------------------
------------------------------------------------------------------------------
 9/14/2016 11:14 AM Client-Info Client Version: 0.11.4
 9/14/2016 11:14 AM Client-Info Client OS:      Windows
 9/14/2016 11:14 AM Client-Info Server Version: 1.3.0-RC-10
 9/14/2016 11:14 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:14 AM Middleware::Response ERROR: Object reference not set to an instance of an object.

------------------------------------------------------------------------------
--------------------------------PowerManagement-------------------------------
------------------------------------------------------------------------------
 9/14/2016 11:14 AM Client-Info Client Version: 0.11.4
 9/14/2016 11:14 AM Client-Info Client OS:      Windows
 9/14/2016 11:14 AM Client-Info Server Version: 1.3.0-RC-10
 9/14/2016 11:14 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:14 AM Middleware::Response ERROR: Object reference not set to an instance of an object.

------------------------------------------------------------------------------
----------------------------------UserTracker---------------------------------
------------------------------------------------------------------------------
 9/14/2016 11:14 AM Client-Info Client Version: 0.11.4
 9/14/2016 11:14 AM Client-Info Client OS:      Windows
 9/14/2016 11:14 AM Client-Info Server Version: 1.3.0-RC-10
 9/14/2016 11:14 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:14 AM Middleware::Response ERROR: Object reference not set to an instance of an object.
 9/14/2016 11:14 AM Middleware::Communication URL: http://10.103.72.49/fog/management/index.php?sub=requestClientInfo&configure&newService&json
 9/14/2016 11:14 AM Middleware::Communication ERROR: Could not contact FOG server
 9/14/2016 11:14 AM Middleware::Communication ERROR: Unable to connect to the remote server
 9/14/2016 11:14 AM Middleware::Response Success
 9/14/2016 11:14 AM Service Sleeping for 60 seconds
 9/14/2016 11:15 AM Middleware::Communication URL: http://10.103.72.49/fog/management/index.php?sub=requestClientInfo&mac=78:2B:CB:A8:58:E8||00:00:00:00:00:00:00:E0&newService&json
 9/14/2016 11:15 AM Middleware::Authentication Waiting for authentication timeout to pass
 9/14/2016 11:15 AM Middleware::Communication Download: http://10.103.72.49/fog/management/other/ssl/srvpublic.crt
 9/14/2016 11:15 AM Data::RSA FOG Server CA cert found
 9/14/2016 11:15 AM Middleware::Authentication Cert OK
 9/14/2016 11:15 AM Middleware::Communication POST URL: http://10.103.72.49/fog/management/index.php?sub=requestClientInfo&authorize&newService
 9/14/2016 11:16 AM Middleware::Response Success
 9/14/2016 11:16 AM Middleware::Authentication Authenticated
 9/14/2016 11:16 AM Middleware::Communication URL: http://10.103.72.49/fog/management/index.php?sub=requestClientInfo&mac=78:2B:CB:A8:58:E8||00:00:00:00:00:00:00:E0&newService&json
 9/14/2016 11:16 AM Middleware::Communication ERROR: Could not contact FOG server
 9/14/2016 11:16 AM Middleware::Communication ERROR: Unable to connect to the remote server
 9/14/2016 11:16 AM Middleware::Response Success
 9/14/2016 11:16 AM Middleware::Communication URL: http://10.103.72.49/fog/service/getversion.php?clientver&newService&json
 9/14/2016 11:16 AM Middleware::Communication URL: http://10.103.72.49/fog/service/getversion.php?newService&json

 9/14/2016 11:17 AM Service Creating user agent cache
 9/14/2016 11:17 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:17 AM Middleware::Response ERROR: Object reference not set to an instance of an object.
 9/14/2016 11:17 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:17 AM Middleware::Response ERROR: Object reference not set to an instance of an object.
 9/14/2016 11:17 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:17 AM Middleware::Response ERROR: Object reference not set to an instance of an object.

------------------------------------------------------------------------------
---------------------------------ClientUpdater--------------------------------
------------------------------------------------------------------------------
 9/14/2016 11:17 AM Client-Info Client Version: 0.11.4
 9/14/2016 11:17 AM Client-Info Client OS:      Windows
 9/14/2016 11:17 AM Client-Info Server Version: 1.3.0-RC-10
 9/14/2016 11:17 AM Middleware::Response Success
 9/14/2016 11:17 AM Middleware::Communication Download: http://10.103.72.49/fog/client/SmartInstaller.exe
 9/14/2016 11:17 AM Data::RSA FOG Project cert found
 9/14/2016 11:17 AM Data::RSA ERROR: Certificate validation failed
 9/14/2016 11:17 AM Data::RSA ERROR: Trust chain did not complete to the known authority anchor. Errors: A required certificate is not within its validity period when verifying against the current system clock or the timestamp in the signed file. (NotTimeValid)
 9/14/2016 11:17 AM ClientUpdater ERROR: Update file is not authentic
------------------------------------------------------------------------------


------------------------------------------------------------------------------
----------------------------------TaskReboot----------------------------------
------------------------------------------------------------------------------
 9/14/2016 11:17 AM Client-Info Client Version: 0.11.4
 9/14/2016 11:17 AM Client-Info Client OS:      Windows
 9/14/2016 11:17 AM Client-Info Server Version: 1.3.0-RC-10
 9/14/2016 11:17 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:17 AM Middleware::Response ERROR: Object reference not set to an instance of an object.

------------------------------------------------------------------------------
--------------------------------HostnameChanger-------------------------------
------------------------------------------------------------------------------
 9/14/2016 11:17 AM Client-Info Client Version: 0.11.4
 9/14/2016 11:17 AM Client-Info Client OS:      Windows
 9/14/2016 11:17 AM Client-Info Server Version: 1.3.0-RC-10
 9/14/2016 11:17 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:17 AM Middleware::Response ERROR: Object reference not set to an instance of an object.

------------------------------------------------------------------------------
---------------------------------SnapinClient---------------------------------
------------------------------------------------------------------------------
 9/14/2016 11:17 AM Client-Info Client Version: 0.11.4
 9/14/2016 11:17 AM Client-Info Client OS:      Windows
 9/14/2016 11:17 AM Client-Info Server Version: 1.3.0-RC-10
 9/14/2016 11:17 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:17 AM Middleware::Response ERROR: Object reference not set to an instance of an object.

------------------------------------------------------------------------------
--------------------------------PrinterManager--------------------------------
------------------------------------------------------------------------------
 9/14/2016 11:17 AM Client-Info Client Version: 0.11.4
 9/14/2016 11:17 AM Client-Info Client OS:      Windows
 9/14/2016 11:17 AM Client-Info Server Version: 1.3.0-RC-10
 9/14/2016 11:17 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:17 AM Middleware::Response ERROR: Object reference not set to an instance of an object.

------------------------------------------------------------------------------
--------------------------------PowerManagement-------------------------------
------------------------------------------------------------------------------
 9/14/2016 11:17 AM Client-Info Client Version: 0.11.4
 9/14/2016 11:17 AM Client-Info Client OS:      Windows
 9/14/2016 11:17 AM Client-Info Server Version: 1.3.0-RC-10
 9/14/2016 11:17 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:17 AM Middleware::Response ERROR: Object reference not set to an instance of an object.

------------------------------------------------------------------------------
----------------------------------UserTracker---------------------------------
------------------------------------------------------------------------------
 9/14/2016 11:17 AM Client-Info Client Version: 0.11.4
 9/14/2016 11:17 AM Client-Info Client OS:      Windows
 9/14/2016 11:17 AM Client-Info Server Version: 1.3.0-RC-10
 9/14/2016 11:17 AM Middleware::Response ERROR: Unable to get subsection
 9/14/2016 11:17 AM Middleware::Response ERROR: Object reference not set to an instance of an object.
 9/14/2016 11:17 AM Middleware::Communication URL: http://10.103.72.49/fog/management/index.php?sub=requestClientInfo&configure&newService&json
 9/14/2016 11:17 AM Middleware::Response Success
 9/14/2016 11:17 AM Service Sleeping for 80 seconds
 9/14/2016 11:18 AM Middleware::Communication URL: http://10.103.72.49/fog/management/index.php?sub=requestClientInfo&mac=78:2B:CB:A8:58:E8||00:00:00:00:00:00:00:E0&newService&json
 9/14/2016 11:19 AM Middleware::Communication ERROR: Could not contact FOG server
 9/14/2016 11:19 AM Middleware::Communication ERROR: Unable to connect to the remote server
 9/14/2016 11:19 AM Middleware::Response Success
 9/14/2016 11:19 AM Middleware::Communication URL: http://10.103.72.49/fog/service/getversion.php?clientver&newService&json
 9/14/2016 11:19 AM Service ERROR: Unable to get cycle data
 9/14/2016 11:19 AM Service ERROR: Unable to connect to the remote server
 9/14/2016 11:19 AM Middleware::Response Success

Mod edited to use code box.

@Wayne-Workman

I know this only shows 40 seconds, but i let atop run for 3 minutes, and nothing changed. when I hit ctrl C. its just dumps me back to the terminal

And here is the bandwidth usage. As you can see I re-enabled the NIC at 11:15… instantly starts heading to maxed out.

@Tom-Elliott As discussed last night, around 6pm bandwidth ded down and the GUI ran fine. This morning it is back to what it was doing yesterday. As requested here is the tail -f of the access.log

root@MSDCATS09:/var/log/apache2# tail -f access.log
::1 - - [14/Sep/2016:08:05:39 -0400] “OPTIONS * HTTP/1.0” 200 125 “-” “Apache/2. 4.7 (Ubuntu) OpenSSL/1.0.1f (internal dummy connection)”
10.102.12.182 - - [14/Sep/2016:08:05:39 -0400] “-” 408 0 “-” “-”
::1 - - [14/Sep/2016:08:05:40 -0400] “OPTIONS * HTTP/1.0” 200 125 “-” “Apache/2. 4.7 (Ubuntu) OpenSSL/1.0.1f (internal dummy connection)”
::1 - - [14/Sep/2016:08:05:41 -0400] “OPTIONS * HTTP/1.0” 200 125 “-” “Apache/2. 4.7 (Ubuntu) OpenSSL/1.0.1f (internal dummy connection)”
::1 - - [14/Sep/2016:08:05:42 -0400] “OPTIONS * HTTP/1.0” 200 125 “-” “Apache/2. 4.7 (Ubuntu) OpenSSL/1.0.1f (internal dummy connection)”
::1 - - [14/Sep/2016:08:05:43 -0400] “OPTIONS * HTTP/1.0” 200 125 “-” “Apache/2. 4.7 (Ubuntu) OpenSSL/1.0.1f (internal dummy connection)”
::1 - - [14/Sep/2016:08:05:44 -0400] “OPTIONS * HTTP/1.0” 200 125 “-” “Apache/2. 4.7 (Ubuntu) OpenSSL/1.0.1f (internal dummy connection)”
::1 - - [14/Sep/2016:08:05:45 -0400] “OPTIONS * HTTP/1.0” 200 125 “-” “Apache/2. 4.7 (Ubuntu) OpenSSL/1.0.1f (internal dummy connection)”
::1 - - [14/Sep/2016:08:05:46 -0400] “OPTIONS * HTTP/1.0” 200 125 “-” “Apache/2. 4.7 (Ubuntu) OpenSSL/1.0.1f (internal dummy connection)”
::1 - - [14/Sep/2016:08:05:47 -0400] “OPTIONS * HTTP/1.0” 200 125 “-” “Apache/2. 4.7 (Ubuntu) OpenSSL/1.0.1f (internal dummy connection)”

Also here is a screenshot of what I see on the bandwidth monitor:

You can see the 6PM, and then this morning when I disabled the NIC, other than that something is being pushed from this server, but no clue what.

@Wayne-Workman Only way I could figure out how to do them “easily”. With little time to play with to get them deployed before summer.

@Tom-Elliott

mysql> update snapins set sHash=‘’;
Query OK, 0 rows affected (0.01 sec)
Rows matched: 746 Changed: 0 Warnings: 0

I have to go for now, keep the message coming and I will respond once I get a minutes, I have to take my son to soccer practice.

@Tom-Elliott

I can find the command again yea

@Tom-Elliott
In all it says size is 244,133 bytes of the snapins directory

@Tom-Elliott

about 700ish powershell scripts. Thats it, but they are all at the nodes. I did see in the Snapin Replication log it mentions these.

@Tom-Elliott

10.104.12.83 - - [13/Sep/2016:15:45:49 -0400] “-” 408 0 “-” “-”
10.104.12.196 - - [13/Sep/2016:15:47:02 -0400] “-” 408 0 “-” “-”
10.104.12.13 - - [13/Sep/2016:15:49:13 -0400] “-” 408 0 “-” “-”
10.104.12.103 - - [13/Sep/2016:15:49:15 -0400] “-” 408 0 “-” “-”
10.104.12.59 - - [13/Sep/2016:15:50:04 -0400] “-” 408 0 “-” “-”
10.104.12.105 - - [13/Sep/2016:15:50:20 -0400] “-” 408 0 “-” “-”
10.105.13.139 - - [13/Sep/2016:15:51:16 -0400] “-” 408 0 “-” “-”
10.104.12.20 - - [13/Sep/2016:15:55:27 -0400] “-” 408 0 “-” “-”
10.102.12.74 - - [13/Sep/2016:15:57:08 -0400] “-” 408 0 “-” “-”
10.104.12.96 - - [13/Sep/2016:15:57:12 -0400] “-” 408 0 “-” “-”

@Tom-Elliott Stopping them doesnt seem to stop the traffic. All sites are back up to high usage, with master site 100% outgoing traffic pegged. This is after stopping those two services on all nodes

@Tom-Elliott so far I receive this on the nodes:

root@MSDBETS09:~# service FOGImageReplicator stop

• Stopping FOG Computer Imaging Solution: FOGImageReplicator start-stop-daemon: warning: failed to kill 1148: No such process
  [ OK ]
  root@MSDBETS09:~# service FOGSnapinReplicator stop
• Stopping FOG Computer Imaging Solution: FOGSnapinReplicator start-stop-daemon: warning: failed to kill 1179: No such process
  [ OK ]

@Tom-Elliott ok give me a few minutes

@Tom-Elliott I stopped them, but I am not seeing anything in the replicator.log, seems pretty empty. And that was from 8:47 this morning. anything with newer timestamps doesn’t make sense or isn’t one of the sites in question.

@Tom-Elliott Trying to, but GUI is getting bogged down again. Where on the server itself can I find the logs for that?

Something noticed. So I updated the servers to RC-10 this morning around 7:30am. Since then we have had three sites fully maxed out on bandwidth. a 10mb site, and 2 100mb sites. Complete 100% full pipe. I just disabled the virtual NIC on the master FOG server, and wala bandwidth dropped majorly.

What can cause this to happen? it also happened last month when I upgraded to RC-7. In that case it start replicated images for what ever reason. But since that time I turned off replication on the images so it would not happen next time. So from 7:30 this morning until 3:00 this afternoon, the outbound traffic of the master site has been maxed out while other sites incoming have been maxed or extremely high, and it was resolved by disabling the NIC.

@lukebarone Sorry you are correct. I remember now

I took the 3350’s and grabbed their MAC address from the BIOS and input them in fog manually. Then I assigned them to groups and mass updated them. I did it for 3 carts worth of laptops. Didn’t really take me that long by my self.

Then yes once the 3350’s got the pci=noacpi argument, they ran right through.

Ok back from lunch. it seems to be hit or miss i fit loads, which is better than it was. Starts to look like the normal pages. Still having timeouts, and slow performance. Checkin while trying to image still takes time. and here is TOP

For our 3350’s you have to set

Host Kernel Arguments pci=noacpi

for each host. (maybe needs to be for 5520s as well??) We do not have any here, so I don’t know.

But I created a group, registered them all to the group, and mass updated all the host arguments.