Apache2 restart failed after trunk update

Psycholiquid · Mar 1, 2016, 12:05 AM

So I’m lost I need it to regenerate or I need to replace with the backed up one

Tom Elliott · Mar 1, 2016, 12:28 AM

@Psycholiquid validity period, can you make sure the windows and fog servers are matching with their time? As you do tend to rely on snapshots of course.

Tom Elliott · Mar 1, 2016, 12:30 AM

@Wayne-Workman ca and private key is not regenerated every install, just the csr and public cert.

Wayne Workman · Mar 1, 2016, 12:47 AM

@Tom-Elliott That’s what I meant.

Psycholiquid · Mar 1, 2016, 3:04 PM

OK so what would I need to do to resolve this. I am in another state trying to get the node working so I dont have to touch every machine but cant due to this.

Psycholiquid · Mar 1, 2016, 3:08 PM

I mean I could roll back but I would rather move forward. The times seem to be just fine so far as I can tell. but my server is being slammed now due to bad requests.

Psycholiquid · Mar 1, 2016, 3:15 PM

Just verified the dates and times are matching perfectly

Psycholiquid · Mar 1, 2016, 9:22 AM

Update:

So it leads me to believe that it is something on the client now? I am really lost on this.

Getting this now:

------------------------------------------------------------------------------
--------------------------------Authentication--------------------------------
------------------------------------------------------------------------------
 3/1/2016 8:18 AM Client-Info Version: 0.9.11
 3/1/2016 8:18 AM Middleware::Communication URL: http://fog-server/fog/management/other/ssl/srvpublic.crt
 3/1/2016 8:18 AM Data::RSA FOG Server CA cert found
 3/1/2016 8:18 AM Middleware::Authentication Cert OK
 3/1/2016 8:18 AM Middleware::Communication POST URL: http://fog-server/fog/management/index.php?sub=authorize
 3/1/2016 8:18 AM Middleware::Communication Response: Invalid security token
 3/1/2016 8:18 AM Service Sleeping for 120 seconds```

Psycholiquid · Mar 1, 2016, 3:35 PM

Update:

So I went through the though that with the last error maybe it needed to be reinstalled on the client. Did that and then reset the encryption data on the host from the interface. That seems to clear the error, now I am getting different errors on that host. Please see below. Seems to run in circles.

------------------------------------------------------------------------------
--------------------------------Authentication--------------------------------
------------------------------------------------------------------------------
 3/1/2016 8:28 AM Client-Info Version: 0.9.11
 3/1/2016 8:28 AM Middleware::Communication URL: http://fog-server/fog/management/other/ssl/srvpublic.crt
 3/1/2016 8:28 AM Data::RSA FOG Server CA cert found
 3/1/2016 8:28 AM Middleware::Authentication Cert OK
 3/1/2016 8:28 AM Middleware::Communication POST URL: http://fog-server/fog/management/index.php?sub=authorize
 3/1/2016 8:29 AM Middleware::Communication Response: Invalid security token
 3/1/2016 8:29 AM Service Sleeping for 120 seconds

------------------------------------------------------------------------------
--------------------------------Authentication--------------------------------
------------------------------------------------------------------------------
 3/1/2016 8:31 AM Client-Info Version: 0.9.11
 3/1/2016 8:31 AM Middleware::Communication URL: http://fog-server/fog/management/other/ssl/srvpublic.crt
 3/1/2016 8:31 AM Data::RSA FOG Server CA cert found
 3/1/2016 8:31 AM Middleware::Authentication Cert OK
 3/1/2016 8:31 AM Middleware::Communication POST URL: http://fog-server/fog/management/index.php?sub=authorize
 3/1/2016 8:31 AM Middleware::Communication Response: Success
 3/1/2016 8:31 AM Middleware::Authentication Authenticated

 3/1/2016 8:31 AM Bus Registering ParseBus in channel Power

------------------------------------------------------------------------------
---------------------------------ClientUpdater--------------------------------
------------------------------------------------------------------------------
 3/1/2016 8:31 AM Client-Info Version: 0.9.11
 3/1/2016 8:31 AM ClientUpdater Running...
 3/1/2016 8:31 AM Middleware::Communication URL: http://fog-server/fog/service/servicemodule-active.php?moduleid=clientupdater&mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1
 3/1/2016 8:31 AM Middleware::Communication Response: Success
 3/1/2016 8:31 AM Middleware::Communication URL: http://fog-server/fog/service/getversion.php?client&newService=1
------------------------------------------------------------------------------


------------------------------------------------------------------------------
----------------------------------TaskReboot----------------------------------
------------------------------------------------------------------------------
 3/1/2016 8:31 AM Client-Info Version: 0.9.11
 3/1/2016 8:31 AM TaskReboot Running...
 3/1/2016 8:31 AM Middleware::Communication URL: http://fog-server/fog/service/servicemodule-active.php?moduleid=taskreboot&mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1
 3/1/2016 8:31 AM Middleware::Communication Response: Success
 3/1/2016 8:31 AM Middleware::Communication URL: http://fog-server/fog/service/jobs.php?mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1
 3/1/2016 8:31 AM Middleware::Communication Response: Invalid host certificate
 3/1/2016 8:31 AM Middleware::Communication URL: http://fog-server/fog/management/other/ssl/srvpublic.crt
 3/1/2016 8:31 AM Data::RSA FOG Server CA cert found
 3/1/2016 8:31 AM Middleware::Authentication Cert OK
 3/1/2016 8:31 AM Middleware::Communication POST URL: http://fog-server/fog/management/index.php?sub=authorize
 3/1/2016 8:31 AM Middleware::Communication Response: Success
 3/1/2016 8:31 AM Middleware::Authentication Authenticated
 3/1/2016 8:31 AM Middleware::Communication URL: http://fog-server/fog/service/jobs.php?mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1&newService=1
 3/1/2016 8:31 AM Middleware::Communication Response: Invalid host certificate
 3/1/2016 8:31 AM Middleware::Communication URL: http://fog-server/fog/management/other/ssl/srvpublic.crt
 3/1/2016 8:31 AM Data::RSA FOG Server CA cert found
 3/1/2016 8:31 AM Middleware::Authentication Cert OK
 3/1/2016 8:31 AM Middleware::Communication POST URL: http://fog-server/fog/management/index.php?sub=authorize
 3/1/2016 8:31 AM Middleware::Communication Response: Success
 3/1/2016 8:31 AM Middleware::Authentication Authenticated
 3/1/2016 8:31 AM Middleware::Communication URL: http://fog-server/fog/service/jobs.php?mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1&newService=1&newService=1
 3/1/2016 8:32 AM Middleware::Communication Response: Invalid host certificate
 3/1/2016 8:32 AM Middleware::Communication URL: http://fog-server/fog/management/other/ssl/srvpublic.crt
 3/1/2016 8:32 AM Data::RSA FOG Server CA cert found
 3/1/2016 8:32 AM Middleware::Authentication Cert OK
 3/1/2016 8:32 AM Middleware::Communication POST URL: http://fog-server/fog/management/index.php?sub=authorize
 3/1/2016 8:32 AM Middleware::Communication Response: Success
 3/1/2016 8:32 AM Middleware::Authentication Authenticated
 3/1/2016 8:32 AM Middleware::Communication URL: http://fog-server/fog/service/jobs.php?mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1&newService=1&newService=1&newService=1
 3/1/2016 8:32 AM Middleware::Communication Response: Invalid host certificate
 3/1/2016 8:32 AM Middleware::Communication URL: http://fog-server/fog/management/other/ssl/srvpublic.crt
 3/1/2016 8:32 AM Data::RSA FOG Server CA cert found
 3/1/2016 8:32 AM Middleware::Authentication Cert OK
 3/1/2016 8:32 AM Middleware::Communication POST URL: http://fog-server/fog/management/index.php?sub=authorize
 3/1/2016 8:32 AM Middleware::Communication Response: Success
 3/1/2016 8:32 AM Middleware::Authentication Authenticated
 3/1/2016 8:32 AM Middleware::Communication URL: http://fog-server/fog/service/jobs.php?mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1&newService=1&newService=1&newService=1&newService=1
 3/1/2016 8:32 AM Middleware::Communication Response: Invalid host certificate
 3/1/2016 8:32 AM Middleware::Communication URL: http://fog-server/fog/management/other/ssl/srvpublic.crt
 3/1/2016 8:32 AM Data::RSA FOG Server CA cert found
 3/1/2016 8:32 AM Middleware::Authentication Cert OK
 3/1/2016 8:32 AM Middleware::Communication POST URL: http://fog-server/fog/management/index.php?sub=authorize
 3/1/2016 8:32 AM Middleware::Communication Response: Success
 3/1/2016 8:32 AM Middleware::Authentication Authenticated
 3/1/2016 8:32 AM Middleware::Communication URL: http://fog-server/fog/service/jobs.php?mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1&newService=1&newService=1&newService=1&newService=1&newService=1

Wayne Workman · Mar 1, 2016, 4:15 PM

Bringing in the big guns to maybe shed light on what’s going.
Informing @Jbob

Psycholiquid · Mar 1, 2016, 4:19 PM

@Wayne-Workman Yeah it is very weird, its like it wants to work, but then it gets all confused. I did manually install the client. But I see where it is trying to run also.

Wayne Workman · Mar 1, 2016, 4:22 PM

@Psycholiquid Is fog-server your fog server’s actual name and is there a DNS entry for it?

Psycholiquid · Mar 1, 2016, 4:24 PM

@Wayne-Workman it is a cname but it works no problem, I can ping it from anywhere on the network. It is not however the server name. I was using IP addresses before but didnt like that. But this has been in place for about 8 months now

Wayne Workman · Mar 1, 2016, 4:29 PM

@Psycholiquid If it were me in your position - I would roll back to when it was working,

And I would copy /opt/fog/snapins/CA to /root for safe keeping, I’d also copy /opt/fog/snapins/ssl to /root.

cp -r /opt/fog/snapins/CA /root
cp -r /opt/fog/snapins/ssl /root

I know that it wasn’t long ago that all the paths and stuff changed for the CA and ssl directories - so you’ll just need to pay close attention to those after you update forwards.

This should take no time. Roll back, backup your CA and ssl folders, update to the latest. Check everything.

However it’s perfectly fine if you want to wait for further input from Tom or Jbob and I’d take zero offense from that.

Psycholiquid · Mar 1, 2016, 4:30 PM

Yeah I will wait but I agree making a backup of those is not a bad idea at all.

Psycholiquid · Mar 2, 2016, 2:35 PM

Any ideas guys? OR should I just roll back?

Psycholiquid · Mar 2, 2016, 4:53 PM

For now I have rolled back to the working version. Let me know if anyone has any ideas.

@Wayne-Workman I have now made a backup for those files we were discussing.

Psycholiquid · Mar 4, 2016, 1:30 PM

Update, so I rolled back now the system is forcing client to update to client version 0.9.11 and breaking the whole system, anyone out there that can help would be greatly appreciated.

Psycholiquid · Mar 4, 2016, 1:42 PM

This is the log from a client installed fresh with 0.9.7 and service turned on:

 3/4/2016 7:39 AM RegistryHandler 64 bit registry detected
 3/4/2016 7:39 AM Middleware::Communication URL: http://fog-server/fog/management/other/ca.cert.der
 3/4/2016 7:40 AM Bus Became bus server
 3/4/2016 7:40 AM Bus {
  "channel": "Status",
  "data": "{\r\n  \"action\": \"load\"\r\n}"
}
 3/4/2016 7:40 AM Bus Emmiting message on channel: Status

------------------------------------------------------------------------------
--------------------------------Authentication--------------------------------
------------------------------------------------------------------------------
 3/4/2016 7:40 AM Client-Info Version: 0.9.7
 3/4/2016 7:40 AM Middleware::Communication URL: http://fog-server/fog/management/other/ssl/srvpublic.crt
 3/4/2016 7:40 AM Data::RSA FOG Server CA cert found
 3/4/2016 7:40 AM Middleware::Authentication Cert OK
 3/4/2016 7:40 AM Middleware::Communication POST URL: http://fog-server/fog/management/index.php?sub=authorize
 3/4/2016 7:40 AM Middleware::Communication Unknown Response: Private key not found
 3/4/2016 7:40 AM Bus Registering ParseBus in channel Power

------------------------------------------------------------------------------
---------------------------------ClientUpdater--------------------------------
------------------------------------------------------------------------------
 3/4/2016 7:40 AM Client-Info Version: 0.9.7
 3/4/2016 7:40 AM ClientUpdater Running...
 3/4/2016 7:40 AM Middleware::Communication URL: http://fog-server/fog/service/servicemodule-active.php?moduleid=clientupdater&mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1
 3/4/2016 7:40 AM Middleware::Communication Response: Success
 3/4/2016 7:40 AM Middleware::Communication URL: http://fog-server/fog/service/getversion.php?client&newService=1
 3/4/2016 7:40 AM Middleware::Communication URL: http://fog-server/fog/client/FOGService.msi
 3/4/2016 7:40 AM Data::RSA FOG Project cert found
 3/4/2016 7:40 AM ClientUpdater Update file is authentic
------------------------------------------------------------------------------

 3/4/2016 7:41 AM Bus {
  "channel": "Update",
  "data": "{\r\n  \"action\": \"start\"\r\n}"
}
 3/4/2016 7:41 AM Bus Emmiting message on channel: Update
 3/4/2016 7:41 AM Service-Update Spawning update helper
 3/4/2016 7:41 AM Bus Registering ParseBus in channel Power
 3/4/2016 7:41 AM Update Helper Shutting down service...
 3/4/2016 7:41 AM Service Stop requested
 3/4/2016 7:41 AM Bus {
  "channel": "Status",
  "data": "{\r\n  \"action\": \"unload\"\r\n}"
}
 3/4/2016 7:41 AM Bus Emmiting message on channel: Status
 3/4/2016 7:41 AM Update Helper Killing remaining FOG processes...
 3/4/2016 7:41 AM Update Helper Applying MSI...
 3/4/2016 7:41 AM Update Helper --> msiexec /i "C:\Program Files (x86)\FOG\tmp\FOGService.msi" /quiet USETRAY="" HTTPS="0" WEBADDRESS="fog-server" WEBROOT="/fog" ROOTLOG="1"
 3/4/2016 7:41 AM RegistryHandler 64 bit registry detected
 3/4/2016 7:41 AM Middleware::Communication URL: http://fog-server/fog/management/other/ca.cert.der
 3/4/2016 7:41 AM Update Helper Starting service...
 3/4/2016 7:41 AM Bus Became bus server
 3/4/2016 7:41 AM Bus {
  "channel": "Status",
  "data": "{\r\n  \"action\": \"load\"\r\n}"
}
 3/4/2016 7:41 AM Bus Emmiting message on channel: Status

------------------------------------------------------------------------------
--------------------------------Authentication--------------------------------
------------------------------------------------------------------------------
 3/4/2016 7:41 AM Client-Info Version: 0.9.11
 3/4/2016 7:41 AM Middleware::Communication URL: http://fog-server/fog/management/other/ssl/srvpublic.crt
 3/4/2016 7:41 AM Data::RSA FOG Server CA cert found
 3/4/2016 7:41 AM Middleware::Authentication Cert OK
 3/4/2016 7:41 AM Middleware::Communication POST URL: http://fog-server/fog/management/index.php?sub=authorize
 3/4/2016 7:41 AM Middleware::Communication Unknown Response: Private key not found
 3/4/2016 7:41 AM Service Sleeping for 120 seconds```

Psycholiquid · Mar 4, 2016, 1:48 PM

This is with the client update service turned off on the client, still getting cert errors:

 3/4/2016 7:46 AM RegistryHandler 64 bit registry detected
 3/4/2016 7:46 AM Middleware::Communication URL: http://fog-server/fog/management/other/ca.cert.der
 3/4/2016 7:47 AM Bus Became bus server
 3/4/2016 7:47 AM Bus {
  "channel": "Status",
  "data": "{\r\n  \"action\": \"load\"\r\n}"
}
 3/4/2016 7:47 AM Bus Emmiting message on channel: Status

------------------------------------------------------------------------------
--------------------------------Authentication--------------------------------
------------------------------------------------------------------------------
 3/4/2016 7:47 AM Client-Info Version: 0.9.7
 3/4/2016 7:47 AM Middleware::Communication URL: http://fog-server/fog/management/other/ssl/srvpublic.crt
 3/4/2016 7:47 AM Data::RSA FOG Server CA cert found
 3/4/2016 7:47 AM Middleware::Authentication Cert OK
 3/4/2016 7:47 AM Middleware::Communication POST URL: http://fog-server/fog/management/index.php?sub=authorize
 3/4/2016 7:47 AM Middleware::Communication Unknown Response: Private key not found
 3/4/2016 7:47 AM Bus Registering ParseBus in channel Power

------------------------------------------------------------------------------
---------------------------------ClientUpdater--------------------------------
------------------------------------------------------------------------------
 3/4/2016 7:47 AM Client-Info Version: 0.9.7
 3/4/2016 7:47 AM ClientUpdater Running...
 3/4/2016 7:47 AM Middleware::Communication URL: http://fog-server/fog/service/servicemodule-active.php?moduleid=clientupdater&mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1
 3/4/2016 7:47 AM Middleware::Communication Response: Module is disabled on the host
------------------------------------------------------------------------------


------------------------------------------------------------------------------
----------------------------------TaskReboot----------------------------------
------------------------------------------------------------------------------
 3/4/2016 7:47 AM Client-Info Version: 0.9.7
 3/4/2016 7:47 AM TaskReboot Running...
 3/4/2016 7:47 AM Middleware::Communication URL: http://fog-server/fog/service/servicemodule-active.php?moduleid=taskreboot&mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1
 3/4/2016 7:47 AM Middleware::Communication Response: Success
 3/4/2016 7:47 AM Middleware::Communication URL: http://fog-server/fog/service/jobs.php?mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1
 3/4/2016 7:47 AM Middleware::Communication Response: Invalid host certificate
 3/4/2016 7:47 AM Middleware::Communication URL: http://fog-server/fog/management/other/ssl/srvpublic.crt
 3/4/2016 7:47 AM Data::RSA FOG Server CA cert found
 3/4/2016 7:47 AM Middleware::Authentication Cert OK
 3/4/2016 7:47 AM Middleware::Communication POST URL: http://fog-server/fog/management/index.php?sub=authorize
 3/4/2016 7:47 AM Middleware::Communication Unknown Response: Private key not found
------------------------------------------------------------------------------


------------------------------------------------------------------------------
--------------------------------HostnameChanger-------------------------------
------------------------------------------------------------------------------
 3/4/2016 7:47 AM Client-Info Version: 0.9.7
 3/4/2016 7:47 AM HostnameChanger Running...
 3/4/2016 7:47 AM Middleware::Communication URL: http://fog-server/fog/service/servicemodule-active.php?moduleid=hostnamechanger&mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1
 3/4/2016 7:47 AM Middleware::Communication Response: Success
 3/4/2016 7:47 AM Middleware::Communication URL: http://fog-server/fog/service/hostname.php?moduleid=hostnamechanger&mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1
 3/4/2016 7:47 AM Middleware::Communication Response: Invalid host certificate
 3/4/2016 7:47 AM Middleware::Communication URL: http://fog-server/fog/management/other/ssl/srvpublic.crt
 3/4/2016 7:47 AM Data::RSA FOG Server CA cert found
 3/4/2016 7:47 AM Middleware::Authentication Cert OK
 3/4/2016 7:47 AM Middleware::Communication POST URL: http://fog-server/fog/management/index.php?sub=authorize
 3/4/2016 7:47 AM Middleware::Communication Unknown Response: Private key not found
------------------------------------------------------------------------------


------------------------------------------------------------------------------
---------------------------------SnapinClient---------------------------------
------------------------------------------------------------------------------
 3/4/2016 7:47 AM Client-Info Version: 0.9.7
 3/4/2016 7:47 AM SnapinClient Running...
 3/4/2016 7:47 AM Middleware::Communication URL: http://fog-server/fog/service/servicemodule-active.php?moduleid=snapinclient&mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1
 3/4/2016 7:47 AM Middleware::Communication Response: Success
 3/4/2016 7:47 AM Middleware::Communication URL: http://fog-server/fog/service/snapins.checkin.php?mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1
 3/4/2016 7:47 AM Middleware::Communication Response: No snapins
------------------------------------------------------------------------------


------------------------------------------------------------------------------
--------------------------------PrinterManager--------------------------------
------------------------------------------------------------------------------
 3/4/2016 7:47 AM Client-Info Version: 0.9.7
 3/4/2016 7:47 AM PrinterManager Running...
 3/4/2016 7:47 AM Middleware::Communication URL: http://fog-server/fog/service/servicemodule-active.php?moduleid=printermanager&mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1
 3/4/2016 7:47 AM Middleware::Communication Response: Module is disabled globally on the FOG server
------------------------------------------------------------------------------


------------------------------------------------------------------------------
-----------------------------------GreenFOG-----------------------------------
------------------------------------------------------------------------------
 3/4/2016 7:47 AM Client-Info Version: 0.9.7
 3/4/2016 7:47 AM GreenFOG Running...
 3/4/2016 7:47 AM Middleware::Communication URL: http://fog-server/fog/service/servicemodule-active.php?moduleid=greenfog&mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1
 3/4/2016 7:47 AM Middleware::Communication Response: Module is disabled globally on the FOG server
------------------------------------------------------------------------------


------------------------------------------------------------------------------
----------------------------------UserTracker---------------------------------
------------------------------------------------------------------------------
 3/4/2016 7:47 AM Client-Info Version: 0.9.7
 3/4/2016 7:47 AM UserTracker Running...
 3/4/2016 7:47 AM Middleware::Communication URL: http://fog-server/fog/service/servicemodule-active.php?moduleid=usertracker&mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1
 3/4/2016 7:47 AM Middleware::Communication Response: Success
 3/4/2016 7:47 AM Middleware::Communication URL: http://fog-server/fog/service/usertracking.report.php?action=login&user=NASDCV80002\Administrator&mac=00:50:56:86:1F:C7||00:00:00:00:00:00:00:E0&newService=1
------------------------------------------------------------------------------

 3/4/2016 7:47 AM Middleware::Communication URL: http://fog-server/fog/management/index.php?node=client&sub=configure&newService=1
 3/4/2016 7:47 AM Middleware::Communication Response: Success
 3/4/2016 7:47 AM Service Sleeping for 60 seconds

Apache2 restart failed after trunk update

243

12.0k

17.3k

155.2k