Constant bandwidth suck



  • Lately I’ve noticed there’s been constant activity on the bandwidth graph on the FOG Dashboard. I didn’t realize how bad it was until I looked at the stats for the past week in our firewall:
    0_1467990196594_fog_bandwidth issue.PNG
    I’m taking a constant 5M+ hit from the FOG server on our MPLS network. Checking jnettop I see this:
    0_1467990263124_fog_bandwidth issue2.PNG
    It looks as if every client is constantly trying to download the SmartInstaller.exe, over and over.

    I’m on version 8215; Ubuntu 14.04



  • @Joe-Schmitt said in Constant bandwidth suck:

    Either re run your fog server installer or upgrade. The smart installer can’t be downloaded from your server. This means it wasn’t obtained properly when you last upgraded your server.

    I moved .fogsettings to .fogsettings.old and ran the upgrade. Seems to have fixed all my remaining issues, including my broken replication. Thanks for that. I’ve been upgrading regularly for months now and I’m not sure now if it’s just coincidence that I moved .fogsettings and let it regenerate. In any case, looks like I’m back to normal here. Thanks again.


  • Senior Developer

    Either re run your fog server installer or upgrade. The smart installer can’t be downloaded from your server. This means it wasn’t obtained properly when you last upgraded your server.



  • @Joe-Schmitt said in Constant bandwidth suck:

    Need a fog.log from a host.

    I do see some errors in the log:

    ------------------------------------------------------------------------------
     7/8/2016 10:14 AM Client-Info Client Version: 0.10.5
     7/8/2016 10:14 AM Client-Info Client OS:      Windows
     7/8/2016 10:14 AM Client-Info Server Version: 8215
     7/8/2016 10:14 AM Middleware::Response Success
     7/8/2016 10:14 AM Middleware::Communication Download: http://192.168.19.200/fog/client/SmartInstaller.exe
     7/8/2016 10:20 AM Middleware::Communication ERROR: Could not download file
     7/8/2016 10:20 AM Middleware::Communication ERROR: The operation has timed out.
     7/8/2016 10:20 AM Data::RSA FOG Project cert found
     7/8/2016 10:20 AM ClientUpdater Update file is authentic
    ------------------------------------------------------------------------------
    
     7/8/2016 10:20 AM Bus {
      "self": true,
      "channel": "Update",
      "data": "{\r\n  \"action\": \"start\"\r\n}"
    }
     7/8/2016 10:20 AM Bus Emmiting message on channel: Update
     7/8/2016 10:20 AM Service-Update Spawning update helper
     7/8/2016 10:20 AM UpdaterHelper Shutting down service...
     7/8/2016 10:20 AM UpdaterHelper Killing remaining processes...
     7/8/2016 10:20 AM UpdaterHelper Applying update...
     7/8/2016 10:20 AM Process ERROR: Unable to run process
     7/8/2016 10:20 AM Process ERROR: The specified executable is not a valid application for this OS platform.
     7/8/2016 10:20 AM UpdaterHelper Starting service...
     7/8/2016 10:20 AM Main Overriding exception handling
     7/8/2016 10:20 AM Main Bootstrapping Zazzles
     7/8/2016 10:20 AM Controller Initialize
     7/8/2016 10:20 AM entry Creating obj
     7/8/2016 10:20 AM Controller Start
    
     7/8/2016 10:20 AM Service Starting service
     7/8/2016 10:20 AM Service ERROR: Could not clear last session data
     7/8/2016 10:20 AM Service ERROR: Access to the path 'FOGUpdateHelper.exe' is denied.
     7/8/2016 10:20 AM Bus Became bus server
     7/8/2016 10:20 AM Bus {
      "self": true,
      "channel": "Status",
      "data": "{\r\n  \"action\": \"load\"\r\n}"
    }
     7/8/2016 10:20 AM Bus Emmiting message on channel: Status
    
    ------------------------------------------------------------------------------
    --------------------------------Authentication--------------------------------
    ------------------------------------------------------------------------------
     7/8/2016 10:20 AM Client-Info Version: 0.10.5
     7/8/2016 10:20 AM Client-Info OS:      Windows
     7/8/2016 10:20 AM Middleware::Authentication Waiting for authentication timeout to pass
     7/8/2016 10:20 AM Middleware::Communication Download: http://192.168.19.200/fog/management/other/ssl/srvpublic.crt
     7/8/2016 10:20 AM Data::RSA FOG Server CA cert found
     7/8/2016 10:20 AM Middleware::Authentication Cert OK
     7/8/2016 10:20 AM Middleware::Communication POST URL: http://192.168.19.200/fog/management/index.php?sub=requestClientInfo&authorize&newService
     7/8/2016 10:20 AM Middleware::Response Success
     7/8/2016 10:20 AM Middleware::Authentication Authenticated
    
    
     7/8/2016 10:20 AM Bus Registering ParseBus in channel Power
     7/8/2016 10:20 AM Middleware::Communication URL: http://192.168.19.200/fog/management/index.php?sub=requestClientInfo&mac=F8:BC:12:6D:FB:43||00:00:00:00:00:00:00:E0&newService&json
     7/8/2016 10:20 AM Middleware::Response Success
     7/8/2016 10:20 AM Middleware::Communication URL: http://192.168.19.200/fog/service/getversion.php?clientver&newService&json
     7/8/2016 10:20 AM Middleware::Communication URL: http://192.168.19.200/fog/service/getversion.php?newService&json
    
     7/8/2016 10:20 AM Service Creating user agent cache
     7/8/2016 10:20 AM Middleware::Response Module is disabled globally on the FOG server
     7/8/2016 10:20 AM Middleware::Response No Printers
    
    ------------------------------------------------------------------------------
    ---------------------------------ClientUpdater--------------------------------
    ------------------------------------------------------------------------------
     7/8/2016 10:20 AM Client-Info Client Version: 0.10.5
     7/8/2016 10:20 AM Client-Info Client OS:      Windows
     7/8/2016 10:20 AM Client-Info Server Version: 8215
     7/8/2016 10:20 AM Middleware::Response Success
     7/8/2016 10:20 AM Middleware::Communication Download: http://192.168.19.200/fog/client/SmartInstaller.exe
     7/8/2016 10:25 AM Middleware::Communication ERROR: Could not download file
     7/8/2016 10:25 AM Middleware::Communication ERROR: The operation has timed out.
     7/8/2016 10:25 AM Data::RSA FOG Project cert found
     7/8/2016 10:25 AM ClientUpdater Update file is authentic
    ------------------------------------------------------------------------------
    
     7/8/2016 10:25 AM Bus {
      "self": true,
      "channel": "Update",
      "data": "{\r\n  \"action\": \"start\"\r\n}"
    }
     7/8/2016 10:25 AM Bus Emmiting message on channel: Update
     7/8/2016 10:25 AM Service-Update Spawning update helper
     7/8/2016 10:25 AM UpdaterHelper Shutting down service...
     7/8/2016 10:25 AM UpdaterHelper Killing remaining processes...
     7/8/2016 10:25 AM UpdaterHelper Applying update...
     7/8/2016 10:25 AM Process ERROR: Unable to run process
     7/8/2016 10:25 AM Process ERROR: The specified executable is not a valid application for this OS platform.
     7/8/2016 10:25 AM UpdaterHelper Starting service...
     7/8/2016 10:25 AM Main Overriding exception handling
     7/8/2016 10:25 AM Main Bootstrapping Zazzles
     7/8/2016 10:25 AM Controller Initialize
     7/8/2016 10:25 AM entry Creating obj
     7/8/2016 10:25 AM Controller Start
    
     7/8/2016 10:25 AM Service Starting service
     7/8/2016 10:25 AM Service ERROR: Could not clear last session data
     7/8/2016 10:25 AM Service ERROR: Access to the path 'FOGUpdateHelper.exe' is denied.
     7/8/2016 10:25 AM Bus Became bus server
     7/8/2016 10:25 AM Bus {
      "self": true,
      "channel": "Status",
      "data": "{\r\n  \"action\": \"load\"\r\n}"
    }
     7/8/2016 10:25 AM Bus Emmiting message on channel: Status
    
    ------------------------------------------------------------------------------
    --------------------------------Authentication--------------------------------
    ------------------------------------------------------------------------------
     7/8/2016 10:25 AM Client-Info Version: 0.10.5
     7/8/2016 10:25 AM Client-Info OS:      Windows
     7/8/2016 10:25 AM Middleware::Authentication Waiting for authentication timeout to pass
     7/8/2016 10:25 AM Middleware::Communication Download: http://192.168.19.200/fog/management/other/ssl/srvpublic.crt
     7/8/2016 10:25 AM Data::RSA FOG Server CA cert found
     7/8/2016 10:25 AM Middleware::Authentication Cert OK
     7/8/2016 10:25 AM Middleware::Communication POST URL: http://192.168.19.200/fog/management/index.php?sub=requestClientInfo&authorize&newService
     7/8/2016 10:25 AM Middleware::Response Success
     7/8/2016 10:25 AM Middleware::Authentication Authenticated
    
    
     7/8/2016 10:25 AM Bus Registering ParseBus in channel Power
     7/8/2016 10:25 AM Middleware::Communication URL: http://192.168.19.200/fog/management/index.php?sub=requestClientInfo&mac=F8:BC:12:6D:FB:43||00:00:00:00:00:00:00:E0&newService&json
     7/8/2016 10:25 AM Middleware::Response Success
     7/8/2016 10:25 AM Middleware::Communication URL: http://192.168.19.200/fog/service/getversion.php?clientver&newService&json
     7/8/2016 10:25 AM Middleware::Communication URL: http://192.168.19.200/fog/service/getversion.php?newService&json
    
     7/8/2016 10:25 AM Service Creating user agent cache
     7/8/2016 10:25 AM Middleware::Response Module is disabled globally on the FOG server
     7/8/2016 10:25 AM Middleware::Response No Printers
    
    ------------------------------------------------------------------------------
    ---------------------------------ClientUpdater--------------------------------
    ------------------------------------------------------------------------------
     7/8/2016 10:25 AM Client-Info Client Version: 0.10.5
     7/8/2016 10:25 AM Client-Info Client OS:      Windows
     7/8/2016 10:25 AM Client-Info Server Version: 8215
     7/8/2016 10:25 AM Middleware::Response Success
     7/8/2016 10:25 AM Middleware::Communication Download: http://192.168.19.200/fog/client/SmartInstaller.exe
     7/8/2016 10:30 AM Middleware::Communication ERROR: Could not download file
     7/8/2016 10:30 AM Middleware::Communication ERROR: The operation has timed out.
     7/8/2016 10:30 AM Data::RSA FOG Project cert found
     7/8/2016 10:30 AM ClientUpdater Update file is authentic
    ------------------------------------------------------------------------------
    

  • Senior Developer

    I would also recommend upgrading your fog server. There was a mix up a little bit ago with how the server sent the client version. It is possible that this mix up may have inadvertently triggered an update loop. This is just a guess keep in mind, its hard to say without more info.



  • @Junkhacker said in Constant bandwidth suck:

    what version of client? automatic updating enabled?

    The 2 I checked appear to be running 0.10.5

    Client updater is enabled globally


  • Senior Developer

    Need a fog.log from a host.


  • Moderator

    Pinging the @Senior-Developers about this.


  • Developer

    what version of client? automatic updating enabled?


Log in to reply
 

Looks like your connection to FOG Project was lost, please wait while we try to reconnect.