• Recent
    • Unsolved
    • Tags
    • Popular
    • Users
    • Groups
    • Search
    • Register
    • Login
    1. Home
    2. Arrowtron
    3. Posts
    A
    • Profile
    • Following 0
    • Followers 0
    • Topics 4
    • Posts 29
    • Best 1
    • Controversial 0
    • Groups 0

    Posts made by Arrowtron

    • RE: High CPU Usage

      @Wayne-Workman Yes i’ll be changing the client check in time after posting the required information from MySQLtuner for @george1421.
      Yes 4 Cores would be nice, however due to fog not a being a critical server on our production environment it’s best not to take away resources from other servers. This might change in future though

      @george1421 Let me know if this is good info for you, I’m looking to update fog in the next couple of weeks. Maybe to the latest development version

      Server has been up for ~8 Days

       >>  MySQLTuner 1.7.19 - Major Hayden <major@mhtx.net>
       >>  Bug reports, feature requests, and downloads at http://mysqltuner.com/
       >>  Run with '--help' for additional options and output filtering
      
      [--] Skipped version check for MySQLTuner script
      Please enter your MySQL administrative login: root
      [OK] Currently running supported MySQL version 5.7.28-0ubuntu0.19.04.2
      [OK] Operating on 64-bit architecture
      
      -------- Log file Recommendations ------------------------------------------------------------------
      [OK] Log file /var/log/mysql/error.log exists
      [--] Log file: /var/log/mysql/error.log(106B)
      [OK] Log file /var/log/mysql/error.log is readable.
      [OK] Log file /var/log/mysql/error.log is not empty
      [OK] Log file /var/log/mysql/error.log is smaller than 32 Mb
      [OK] /var/log/mysql/error.log doesn't contain any warning.
      [OK] /var/log/mysql/error.log doesn't contain any error.
      [--] 0 start(s) detected in /var/log/mysql/error.log
      [--] 0 shutdown(s) detected in /var/log/mysql/error.log
      
      -------- Storage Engine Statistics -----------------------------------------------------------------
      [--] Status: +ARCHIVE +BLACKHOLE +CSV -FEDERATED +InnoDB +MEMORY +MRG_MYISAM +MyISAM +PERFORMANCE_SCHEMA
      [--] Data in InnoDB tables: 17.3M (Tables: 55)
      [OK] Total fragmented tables: 0
      
      -------- Analysis Performance Metrics --------------------------------------------------------------
      [--] innodb_stats_on_metadata: OFF
      [OK] No stat updates during querying INFORMATION_SCHEMA.
      
      -------- CVE Security Recommendations --------------------------------------------------------------
      [--] Skipped due to --cvefile option undefined
      
      -------- Performance Metrics -----------------------------------------------------------------------
      [--] Up for: 8d 2h 27m 17s (521M q [744.370 qps], 11M conn, TX: 468G, RX: 112G)
      [--] Reads / Writes: 98% / 2%
      [--] Binary logging is disabled
      [--] Physical Memory     : 3.8G
      [--] Max MySQL memory    : 2.7G
      [--] Other process memory: 0B
      [--] Total buffers: 192.0M global + 17.1M per thread (151 max threads)
      [--] P_S Max memory usage: 72B
      [--] Galera GCache Max memory usage: 0B
      [OK] Maximum reached memory usage: 1.1G (29.54% of installed RAM)
      [OK] Maximum possible memory usage: 2.7G (70.22% of installed RAM)
      [OK] Overall possible memory usage with other process is compatible with memory available
      [OK] Slow queries: 0% (0/521M)
      [OK] Highest usage of available connections: 37% (57/151)
      [OK] Aborted connections: 0.00%  (117/11896308)
      [!!] name resolution is active : a reverse name resolution is made for each new connection and can reduce performance
      [!!] Query cache may be disabled by default due to mutex contention.
      [!!] Query cache efficiency: 0.0% (0 cached / 477M selects)
      [OK] Query cache prunes per day: 0
      [OK] Sorts requiring temporary tables: 0% (15 temp sorts / 146M sorts)
      [OK] No joins without indexes
      [!!] Temporary tables created on disk: 97% (11M on disk / 12M total)
      [OK] Thread cache hit rate: 98% (210K created / 11M connections)
      [OK] Table cache hit rate: 96% (1K open / 1K opened)
      [OK] table_definition_cache(1400) is upper than number of tables(334)
      [OK] Open file limit used: 0% (6/5K)
      [OK] Table locks acquired immediately: 100% (102 immediate / 102 locks)
      
      -------- Performance schema ------------------------------------------------------------------------
      [--] Memory used by P_S: 72B
      [--] Sys schema is installed.
      
      -------- ThreadPool Metrics ------------------------------------------------------------------------
      [--] ThreadPool stat is disabled.
      
      -------- MyISAM Metrics ----------------------------------------------------------------------------
      [!!] Key buffer used: 18.2% (3M used / 16M cache)
      [OK] Key buffer size / total MyISAM indexes: 16.0M/43.0K
      [!!] Read Key buffer hit rate: 50.0% (6 cached / 3 reads)
      
      -------- InnoDB Metrics ----------------------------------------------------------------------------
      [--] InnoDB is enabled.
      [--] InnoDB Thread Concurrency: 0
      [OK] InnoDB File per table is activated
      [OK] InnoDB buffer pool / data size: 128.0M/17.3M
      [!!] Ratio InnoDB log file size / InnoDB Buffer pool size (75 %): 48.0M * 2/128.0M should be equal to 25%
      [OK] InnoDB buffer pool instances: 1
      [--] Number of InnoDB Buffer Pool Chunk : 1 for 1 Buffer Pool Instance(s)
      [OK] Innodb_buffer_pool_size aligned with Innodb_buffer_pool_chunk_size & Innodb_buffer_pool_instances
      [OK] InnoDB Read buffer efficiency: 100.00% (12493296749 hits/ 12493297691 total)
      [!!] InnoDB Write Log efficiency: 44.2% (2737439 hits/ 6192657 total)
      [OK] InnoDB log waits: 0.00% (0 waits / 3455218 writes)
      
      -------- AriaDB Metrics ----------------------------------------------------------------------------
      [--] AriaDB is disabled.
      
      -------- TokuDB Metrics ----------------------------------------------------------------------------
      [--] TokuDB is disabled.
      
      -------- XtraDB Metrics ----------------------------------------------------------------------------
      [--] XtraDB is disabled.
      
      -------- Galera Metrics ----------------------------------------------------------------------------
      [--] Galera is disabled.
      
      -------- Replication Metrics -----------------------------------------------------------------------
      [--] Galera Synchronous replication: NO
      [--] No replication slave(s) for this server.
      [--] Binlog format: ROW
      [--] XA support enabled: ON
      [--] Semi synchronous replication Master: Not Activated
      [--] Semi synchronous replication Slave: Not Activated
      [--] This is a standalone server
      
      -------- Recommendations ---------------------------------------------------------------------------
      General recommendations:
          Restrict Host for 'fogstorage'@% to fogstorage@SpecificDNSorIp
          UPDATE mysql.user SET host ='SpecificDNSorIp' WHERE user='fogstorage' AND host ='%'; FLUSH PRIVILEGES;
          Configure your accounts with ip or subnets only, then update your configuration with skip-name-resolve=1
          When making adjustments, make tmp_table_size/max_heap_table_size equal
          Reduce your SELECT DISTINCT queries which have no LIMIT clause
          Before changing innodb_log_file_size and/or innodb_log_files_in_group read this: https://bit.ly/2TcGgtU
      Variables to adjust:
          query_cache_size (=0)
          query_cache_type (=0)
          query_cache_limit (> 1M, or use smaller result sets)
          tmp_table_size (> 16M)
          max_heap_table_size (> 16M)
          innodb_log_file_size should be (=16M) if possible, so InnoDB total log files size equals to 25% of buffer pool size.
      
      posted in FOG Problems
      A
      Arrowtron
    • RE: High CPU Usage

      @Wayne-Workman
      Fair point, some of the specs are in the screenshots in htop, however I’ll document the others

      VMware Environment
      2 Cores for Virtual Machine
      Intel Xeon Silver 4214 @ 2.2Ghz per core
      3PAR iSCSI Disk | HDD | 10K SAS
      RAM 4GB
      SWAP 4GB

      posted in FOG Problems
      A
      Arrowtron
    • RE: High CPU Usage

      @george1421

      Ah that’s done it!

      mysql> ALTER TABLE hosts ENGINE=InnoDB;
      Query OK, 1116 rows affected (0.34 sec)
      Records: 1116  Duplicates: 0  Warnings: 0
      
      mysql> ALTER TABLE imagingLog ENGINE=InnoDB;
      Query OK, 1216 rows affected (0.06 sec)
      Records: 1216  Duplicates: 0  Warnings: 0
      
      mysql> ALTER TABLE inventory ENGINE=InnoDB;
      Query OK, 907 rows affected (0.16 sec)
      Records: 907  Duplicates: 0  Warnings: 0
      
      mysql> ALTER TABLE snapinTasks ENGINE=InnoDB;
      Query OK, 231 rows affected (0.11 sec)
      Records: 231  Duplicates: 0  Warnings: 0
      
      mysql> ALTER TABLE tasks ENGINE=InnoDB;
      Query OK, 87 rows affected (0.06 sec)
      Records: 87  Duplicates: 0  Warnings: 0
      
      
      mysql> SELECT TABLE_NAME,ENGINE
          -> FROM information_schema.TABLES
          -> WHERE TABLE_SCHEMA = 'fog' and ENGINE = 'MyISAM';
      Empty set (0.00 sec)
      

      I’ve reset the client polling time to 60 seconds. Let it run for 4 hrs with the newly converted tables. About ~580 PC’s online with FOG installed at the time. It fluctuates a fair bit in terms of load average. Pictures below; I’ll change client polling to 180. CPU usage is quite acceptable at 180, unless you want it to remain at 60 for the testing purpose? I’ll report back in a week with mysqltuner results

      image here

      image here

      posted in FOG Problems
      A
      Arrowtron
    • RE: High CPU Usage

      @george1421

      Added the configuration file

      sudo systemctl restart mariadb
      
      Failed to restart mariadb.service: Unit mariadb.service not found.
      

      Ran systemctl restart mysql (also restarted the server)

      Entered in your mysql command, result below:

      SELECT @@GLOBAL.sql_mode global, @@SESSION.sql_mode session;
      +--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
      | global                                                                                                       | session                                                                                                      |
      +--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
      | ONLY_FULL_GROUP_BY,STRICT_TRANS_TABLES,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION | ONLY_FULL_GROUP_BY,STRICT_TRANS_TABLES,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION |
      +--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
      1 row in set (0.00 sec)
      
      mysql> ALTER TABLE hosts ENGINE=InnoDB;
      ERROR 1046 (3D000): No database selected
      mysql> ALTER TABLE imagingLog ENGINE=InnoDB;
      ERROR 1046 (3D000): No database selected
      mysql> ALTER TABLE inventory ENGINE=InnoDB;
      ERROR 1046 (3D000): No database selected
      mysql> ALTER TABLE snapinTasks ENGINE=InnoDB;
      ERROR 1046 (3D000): No database selected
      

      Something I’m doing wrong?

      posted in FOG Problems
      A
      Arrowtron
    • RE: High CPU Usage

      @george1421 Hi George, let me know if you need me to do anything further

      posted in FOG Problems
      A
      Arrowtron
    • RE: High CPU Usage

      @george1421 said in High CPU Usage:

      /etc/mysql/conf.d/

      2 files in that location

      mysqldump.cnf

      [mysqldump]
      quick
      quote-names
      max_allowed_packet      = 16M
      

      mysql.cnf

      [mysql]
      
      posted in FOG Problems
      A
      Arrowtron
    • RE: High CPU Usage

      @george1421

      mysql> SELECT @@GLOBAL.sql_mode global, @@SESSION.sql_mode session;
      +-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
      | global                                                                                                                                    | session                                                                                                                                   |
      +-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
      | ONLY_FULL_GROUP_BY,STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION | ONLY_FULL_GROUP_BY,STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION |
      +-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
      1 row in set (0.01 sec)
      

      /etc/my.cnf doesn’t exist

      /usr/sbin/mysqld --verbose --help | grep -A 1 “Default options”

      Default options are read from the following files in the given order:
      /etc/my.cnf /etc/mysql/my.cnf ~/.my.cnf
      

      nano /etc/mysql/my.cnf

      !includedir /etc/mysql/conf.d/
      !includedir /etc/mysql/mysql.conf.d/
      

      ~/.my.cnf doesn’t exist

      posted in FOG Problems
      A
      Arrowtron
    • RE: High CPU Usage

      @george1421 I haven’t heard back from you, here are the results after 7 days
      There are roughly 597 PC’s online with FOG service Installed
      As stated from previous reply, there were a few tables that didn’t change to MyISAM
      The client polling is 60 seconds

      f1af4718-9769-44e5-a365-c52047b73d70-image.png

       >>  MySQLTuner 1.7.19 - Major Hayden <major@mhtx.net>
       >>  Bug reports, feature requests, and downloads at http://mysqltuner.com/
       >>  Run with '--help' for additional options and output filtering
      
      [--] Skipped version check for MySQLTuner script
      [OK] Logged in using credentials from Debian maintenance account.
      [OK] Currently running supported MySQL version 5.7.28-0ubuntu0.19.04.2
      [OK] Operating on 64-bit architecture
      
      -------- Log file Recommendations ----------------------------------------------                                                                                                                                                                                                                                             --------------------
      [OK] Log file /var/log/mysql/error.log exists
      [--] Log file: /var/log/mysql/error.log(0B)
      [OK] Log file /var/log/mysql/error.log is readable.
      [!!] Log file /var/log/mysql/error.log is empty
      [OK] Log file /var/log/mysql/error.log is smaller than 32 Mb
      [OK] /var/log/mysql/error.log doesn't contain any warning.
      [OK] /var/log/mysql/error.log doesn't contain any error.
      [--] 0 start(s) detected in /var/log/mysql/error.log
      [--] 0 shutdown(s) detected in /var/log/mysql/error.log
      
      -------- Storage Engine Statistics ---------------------------------------------                                                                                                                                                                                                                                             --------------------
      [--] Status: +ARCHIVE +BLACKHOLE +CSV -FEDERATED +InnoDB +MEMORY +MRG_MYISAM +My                                                                                                                                                                                                                                             ISAM +PERFORMANCE_SCHEMA
      [--] Data in InnoDB tables: 14.7M (Tables: 50)
      [--] Data in MyISAM tables: 1002.6K (Tables: 5)
      [OK] Total fragmented tables: 0
      
      -------- Analysis Performance Metrics ------------------------------------------                                                                                                                                                                                                                                             --------------------
      [--] innodb_stats_on_metadata: OFF
      [OK] No stat updates during querying INFORMATION_SCHEMA.
      
      -------- CVE Security Recommendations ------------------------------------------                                                                                                                                                                                                                                             --------------------
      [--] Skipped due to --cvefile option undefined
      
      -------- Performance Metrics ---------------------------------------------------                                                                                                                                                                                                                                             --------------------
      [--] Up for: 7d 20h 30m 0s (494M q [728.806 qps], 11M conn, TX: 439G, RX: 106G)
      [--] Reads / Writes: 98% / 2%
      [--] Binary logging is disabled
      [--] Physical Memory     : 3.8G
      [--] Max MySQL memory    : 2.7G
      [--] Other process memory: 0B
      [--] Total buffers: 192.0M global + 17.1M per thread (151 max threads)
      [--] P_S Max memory usage: 72B
      [--] Galera GCache Max memory usage: 0B
      [OK] Maximum reached memory usage: 1.1G (29.54% of installed RAM)
      [OK] Maximum possible memory usage: 2.7G (70.22% of installed RAM)
      [OK] Overall possible memory usage with other process is compatible with memory                                                                                                                                                                                                                                              available
      [OK] Slow queries: 0% (0/494M)
      [OK] Highest usage of available connections: 37% (57/151)
      [OK] Aborted connections: 0.00%  (8/11267058)
      [!!] name resolution is active : a reverse name resolution is made for each new                                                                                                                                                                                                                                              connection and can reduce performance
      [!!] Query cache may be disabled by default due to mutex contention.
      [!!] Query cache efficiency: 0.0% (0 cached / 454M selects)
      [OK] Query cache prunes per day: 0
      [OK] Sorts requiring temporary tables: 0% (9 temp sorts / 139M sorts)
      [OK] No joins without indexes
      [!!] Temporary tables created on disk: 97% (11M on disk / 11M total)
      [OK] Thread cache hit rate: 98% (209K created / 11M connections)
      [OK] Table cache hit rate: 96% (977 open / 1K opened)
      [OK] table_definition_cache(1400) is upper than number of tables(334)
      [OK] Open file limit used: 2% (144/5K)
      [OK] Table locks acquired immediately: 99% (101M immediate / 101M locks)
      
      -------- Performance schema ----------------------------------------------------                                                                                                                                                                                                                                             --------------------
      [--] Memory used by P_S: 72B
      [--] Sys schema is installed.
      
      -------- ThreadPool Metrics ----------------------------------------------------                                                                                                                                                                                                                                             --------------------
      [--] ThreadPool stat is disabled.
      
      -------- MyISAM Metrics --------------------------------------------------------                                                                                                                                                                                                                                             --------------------
      [!!] Key buffer used: 18.7% (3M used / 16M cache)
      [OK] Key buffer size / total MyISAM indexes: 16.0M/238.0K
      [OK] Read Key buffer hit rate: 100.0% (235M cached / 76 reads)
      [!!] Write Key buffer hit rate: 83.1% (154 cached / 128 writes)
      
      -------- InnoDB Metrics --------------------------------------------------------                                                                                                                                                                                                                                             --------------------
      [--] InnoDB is enabled.
      [--] InnoDB Thread Concurrency: 0
      [OK] InnoDB File per table is activated
      [OK] InnoDB buffer pool / data size: 128.0M/14.7M
      [!!] Ratio InnoDB log file size / InnoDB Buffer pool size (75 %): 48.0M * 2/128.                                                                                                                                                                                                                                             0M should be equal to 25%
      [OK] InnoDB buffer pool instances: 1
      [--] Number of InnoDB Buffer Pool Chunk : 1 for 1 Buffer Pool Instance(s)
      [OK] Innodb_buffer_pool_size aligned with Innodb_buffer_pool_chunk_size & Innodb                                                                                                                                                                                                                                             _buffer_pool_instances
      [OK] InnoDB Read buffer efficiency: 100.00% (9450445390 hits/ 9450446365 total)
      [!!] InnoDB Write Log efficiency: 59.83% (3030357 hits/ 5065232 total)
      [OK] InnoDB log waits: 0.00% (0 waits / 2034875 writes)
      
      -------- AriaDB Metrics --------------------------------------------------------                                                                                                                                                                                                                                             --------------------
      [--] AriaDB is disabled.
      
      -------- TokuDB Metrics --------------------------------------------------------                                                                                                                                                                                                                                             --------------------
      [--] TokuDB is disabled.
      
      -------- XtraDB Metrics --------------------------------------------------------                                                                                                                                                                                                                                             --------------------
      [--] XtraDB is disabled.
      
      -------- Galera Metrics --------------------------------------------------------                                                                                                                                                                                                                                             --------------------
      [--] Galera is disabled.
      
      -------- Replication Metrics ---------------------------------------------------                                                                                                                                                                                                                                             --------------------
      [--] Galera Synchronous replication: NO
      [--] No replication slave(s) for this server.
      [--] Binlog format: ROW
      [--] XA support enabled: ON
      [--] Semi synchronous replication Master: Not Activated
      [--] Semi synchronous replication Slave: Not Activated
      [--] This is a standalone server
      
      -------- Recommendations -------------------------------------------------------                                                                                                                                                                                                                                             --------------------
      General recommendations:
          Set up a Secure Password for root@localhost user: SET PASSWORD FOR 'root'@'S                                                                                                                                                                                                                                             pecificDNSorIp' = PASSWORD('secure_password');
          Restrict Host for 'fogstorage'@% to fogstorage@SpecificDNSorIp
          UPDATE mysql.user SET host ='SpecificDNSorIp' WHERE user='fogstorage' AND ho                                                                                                                                                                                                                                             st ='%'; FLUSH PRIVILEGES;
          Configure your accounts with ip or subnets only, then update your configurat                                                                                                                                                                                                                                             ion with skip-name-resolve=1
          When making adjustments, make tmp_table_size/max_heap_table_size equal
          Reduce your SELECT DISTINCT queries which have no LIMIT clause
          Before changing innodb_log_file_size and/or innodb_log_files_in_group read t                                                                                                                                                                                                                                             his: https://bit.ly/2TcGgtU
      Variables to adjust:
          query_cache_size (=0)
          query_cache_type (=0)
          query_cache_limit (> 1M, or use smaller result sets)
          tmp_table_size (> 16M)
          max_heap_table_size (> 16M)
          innodb_log_file_size should be (=16M) if possible, so InnoDB total log files                                                                                                                                                                                                                                              size equals to 25% of buffer pool size.
      
      
      posted in FOG Problems
      A
      Arrowtron
    • RE: High CPU Usage

      @george1421 Sorry didn’t get to you sooner, few work things came up

      I have changed the client polling back to 60 seconds and left for a day, screenshot taken at peak time with roughly ~600 PC’s online (with FOG service installed)

      Made a VM snapshot at this point* - can revert back if needed

      fog cpu usage111.png

      I ran into a few issues with the following tables, they wouldn’t change to InnoDB engine, seems like a corrupt row in that table

      fog mysql1.png

      I have restarted the server and appears to be loading the web/dashboard - however very slow

      I’ll keep this running and let you know if things improve, although those tables that haven’t been changed seem like important tables to change.
      Let me know how I should proceed

      posted in FOG Problems
      A
      Arrowtron
    • RE: High CPU Usage

      @george1421 said in High CPU Usage:

      @Arrowtron I have some ideas of what we can do here if you are willing to help the FOG Project team.

      Yes can do, let me know what information you need

      posted in FOG Problems
      A
      Arrowtron
    • RE: High CPU Usage

      @Sebastian-Roth
      Thanks for your reply, I have changed the client checkin time from 60 to 600 (10mins) and has made a huge difference (picture below)

      Client Maxsize: 204800000
      Grace Timeout: 60

      fog-cpu-usage1.png
      fog-cpu-usage2.png

      posted in FOG Problems
      A
      Arrowtron
    • High CPU Usage

      FOG Ver: 1.5.7.2
      Ubuntu: 19.04
      Master Server on VMWare

      Registered Hosts on the server: 1098 (maybe 200-400 could be online in this list)

      Getting consistent high CPU as shown in the screenshot below

      • Restarting the server, CPU usage isn’t as bad, eventually goes to 100% the longer it is on
      • Took a snapshot, upgraded to the latest dev-branch a couple weeks back (i think ~1.5.8.1), CPU usage was still hovering quite high, reverted back
      • Ran MySQLTuner, results below
      • Ran Database Maintenance Commands on https://wiki.fogproject.org/wiki/index.php/Troubleshoot_MySQL
      • I haven’t changed any polling/refresh rates for hosts, I’ve seen on these forums that has helped for others
      • https://forums.fogproject.org/topic/12392/fog-server-high-cpu/23?_=1582602629372 - I’ve tinkered with the settings below but no drop in CPU
      php_admin_value[memory_limit] = 256M
      pm.max_requests = 2000
      pm.max_children = 35
      pm.min_spare_servers = 5
      pm.start_servers = 5
      

      I’ve been thinking I should do a complete export of database and start on a new server (perhaps 18.04), import the database. However, the problem might come back if it is something to do with the data

      Any other suggestions?

      fog-cpu-usage.png

      Note: I have removed security suggestions from the below output

       >>  MySQLTuner 1.7.19 - Major Hayden <major@mhtx.net>
       >>  Bug reports, feature requests, and downloads at http://mysqltuner.com/
       >>  Run with '--help' for additional options and output filtering
      
      [--] Skipped version check for MySQLTuner script
      [OK] Logged in using credentials from Debian maintenance account.
      [OK] Currently running supported MySQL version 5.7.28-0ubuntu0.19.04.2
      [OK] Operating on 64-bit architecture
      
      -------- Log file Recommendations ------------------------------------------------------------------
      [OK] Log file /var/log/mysql/error.log exists
      [--] Log file: /var/log/mysql/error.log(0B)
      [OK] Log file /var/log/mysql/error.log is readable.
      [!!] Log file /var/log/mysql/error.log is empty
      [OK] Log file /var/log/mysql/error.log is smaller than 32 Mb
      [OK] /var/log/mysql/error.log doesn't contain any warning.
      [OK] /var/log/mysql/error.log doesn't contain any error.
      [--] 0 start(s) detected in /var/log/mysql/error.log
      [--] 0 shutdown(s) detected in /var/log/mysql/error.log
      
      -------- Storage Engine Statistics -----------------------------------------------------------------
      [--] Status: +ARCHIVE +BLACKHOLE +CSV -FEDERATED +InnoDB +MEMORY +MRG_MYISAM +MyISAM +PERFORMANCE_SCHEMA
      [--] Data in InnoDB tables: 16.0K (Tables: 1)
      [--] Data in MyISAM tables: 7.4M (Tables: 54)
      [OK] Total fragmented tables: 0
      
      -------- Analysis Performance Metrics --------------------------------------------------------------
      [--] innodb_stats_on_metadata: OFF
      [OK] No stat updates during querying INFORMATION_SCHEMA.
      
      -------- CVE Security Recommendations --------------------------------------------------------------
      [--] Skipped due to --cvefile option undefined
      
      -------- Performance Metrics -----------------------------------------------------------------------
      [--] Up for: 18d 0h 53m 4s (1B q [715.502 qps], 25M conn, TX: 989G, RX: 240G)
      [--] Reads / Writes: 98% / 2%
      [--] Binary logging is disabled
      [--] Physical Memory     : 3.8G
      [--] Max MySQL memory    : 2.7G
      [--] Other process memory: 0B
      [--] Total buffers: 192.0M global + 17.1M per thread (151 max threads)
      [--] P_S Max memory usage: 72B
      [--] Galera GCache Max memory usage: 0B
      [OK] Maximum reached memory usage: 1.1G (29.54% of installed RAM)
      [OK] Maximum possible memory usage: 2.7G (70.22% of installed RAM)
      [OK] Overall possible memory usage with other process is compatible with memory available
      [OK] Slow queries: 0% (0/1B)
      [OK] Highest usage of available connections: 37% (57/151)
      [OK] Aborted connections: 0.00%  (275/25414143)
      [!!] name resolution is active : a reverse name resolution is made for each new connection and can reduce performance
      [!!] Query cache may be disabled by default due to mutex contention.
      [!!] Query cache efficiency: 0.0% (0 cached / 1B selects)
      [OK] Query cache prunes per day: 0
      [OK] Sorts requiring temporary tables: 0% (17 temp sorts / 297M sorts)
      [!!] Joins performed without indexes: 5219
      [!!] Temporary tables created on disk: 97% (25M on disk / 26M total)
      [OK] Thread cache hit rate: 98% (386K created / 25M connections)
      [OK] Table cache hit rate: 95% (1K open / 1K opened)
      [OK] table_definition_cache(1400) is upper than number of tables(334)
      [OK] Open file limit used: 22% (1K/5K)
      [OK] Table locks acquired immediately: 99% (1B immediate / 1B locks)
      
      -------- Performance schema ------------------------------------------------------------------------
      [--] Memory used by P_S: 72B
      [--] Sys schema is installed.
      
      -------- ThreadPool Metrics ------------------------------------------------------------------------
      [--] ThreadPool stat is disabled.
      
      -------- MyISAM Metrics ----------------------------------------------------------------------------
      [!!] Key buffer used: 28.1% (4M used / 16M cache)
      [OK] Key buffer size / total MyISAM indexes: 16.0M/4.4M
      [OK] Read Key buffer hit rate: 100.0% (13B cached / 3K reads)
      [!!] Write Key buffer hit rate: 3.8% (123M cached / 4M writes)
      
      -------- InnoDB Metrics ----------------------------------------------------------------------------
      [--] InnoDB is enabled.
      [--] InnoDB Thread Concurrency: 0
      [OK] InnoDB File per table is activated
      [OK] InnoDB buffer pool / data size: 128.0M/16.0K
      [!!] Ratio InnoDB log file size / InnoDB Buffer pool size (75 %): 48.0M * 2/128.0M should be equal to 25%
      [OK] InnoDB buffer pool instances: 1
      [--] Number of InnoDB Buffer Pool Chunk : 1 for 1 Buffer Pool Instance(s)
      [OK] Innodb_buffer_pool_size aligned with Innodb_buffer_pool_chunk_size & Innodb_buffer_pool_instances
      [OK] InnoDB Read buffer efficiency: 100.00% (584565167 hits/ 584565370 total)
      [!!] InnoDB Write Log efficiency: 0% (2 hits/ 0 total)
      [OK] InnoDB log waits: 0.00% (0 waits / 2 writes)
      
      -------- AriaDB Metrics ----------------------------------------------------------------------------
      [--] AriaDB is disabled.
      
      -------- TokuDB Metrics ----------------------------------------------------------------------------
      [--] TokuDB is disabled.
      
      -------- XtraDB Metrics ----------------------------------------------------------------------------
      [--] XtraDB is disabled.
      
      -------- Galera Metrics ----------------------------------------------------------------------------
      [--] Galera is disabled.
      
      -------- Replication Metrics -----------------------------------------------------------------------
      [--] Galera Synchronous replication: NO
      [--] No replication slave(s) for this server.
      [--] Binlog format: ROW
      [--] XA support enabled: ON
      [--] Semi synchronous replication Master: Not Activated
      [--] Semi synchronous replication Slave: Not Activated
      [--] This is a standalone server
      
      -------- Recommendations ---------------------------------------------------------------------------
      General recommendations:
          Restrict Host for 'fogstorage'@% to fogstorage@SpecificDNSorIp
          UPDATE mysql.user SET host ='SpecificDNSorIp' WHERE user='fogstorage' AND host ='%'; FLUSH PRIVILEGES;
          Configure your accounts with ip or subnets only, then update your configuration with skip-name-resolve=1
          We will suggest raising the 'join_buffer_size' until JOINs not using indexes are found.
                   See https://dev.mysql.com/doc/internals/en/join-buffer-size.html
                   (specially the conclusions at the bottom of the page).
          When making adjustments, make tmp_table_size/max_heap_table_size equal
          Reduce your SELECT DISTINCT queries which have no LIMIT clause
          Before changing innodb_log_file_size and/or innodb_log_files_in_group read this: https://bit.ly/2TcGgtU
      Variables to adjust:
          query_cache_size (=0)
          query_cache_type (=0)
          query_cache_limit (> 1M, or use smaller result sets)
          join_buffer_size (> 256.0K, or always use indexes with JOINs)
          tmp_table_size (> 16M)
          max_heap_table_size (> 16M)
          innodb_log_file_size should be (=16M) if possible, so InnoDB total log files size equals to 25% of buffer pool size.
      
      
      posted in FOG Problems
      A
      Arrowtron
    • RE: FOG 1.5.7 Update Database Issue

      @Sebastian-Roth

      Yes found this Wiki when I was migrating, thank you

      posted in FOG Problems
      A
      Arrowtron
    • RE: FOG 1.5.7 Update Database Issue

      @Sebastian-Roth

      Yes i ran

      apt-get remove mariadb-client mariadb-server
      

      Didn’t try this command, it might have helped for the unmet dependencies problem

      killall -9 mysqld
      

      Yes i have some SQL backup’s from previous upgrade which I have restored onto a new server (just had to change IP’s etc which is fine)
      It’s on a virtual machine where as physical before, snapshots will come in handy for next time!

      Yes ran the apt --fix broken install and got the unmet dependencies for mysql errors. Didn’t have the time to keep looking into it

      All goods, thanks for your help though!

      posted in FOG Problems
      A
      Arrowtron
    • RE: FOG 1.5.7 Update Database Issue

      @Sebastian-Roth said in FOG 1.5.7 Update Database Issue:

      /var/lib/mysql

      Thanks for the reply,

      I get this when i run the command
      apt-get install mysql-client mysql-server

      There is a MySQL server running, but we failed in our attempts to stop it.
      Stop it yourself and try again!

      Tried a few commands found doing a web search that didn’t help
      apt --fix-broken install

      Failed to stop mysql.service: Unit mysql.service not loaded.
      invoke-rc.d: initscript mysql, action "stop" failed.
      invoke-rc.d returned 5
      There is a MySQL server running, but we failed in our attempts to stop it.
      Stop it yourself and try again!
      dpkg: error processing archive /var/cache/apt/archives/mysql-server-5.7_5.7.27-0ubuntu0.18.04.1_amd64.deb (--unpack):
       new mysql-server-5.7 package pre-installation script subprocess returned error exit status 1
      Errors were encountered while processing:
       /var/cache/apt/archives/mysql-server-5.7_5.7.27-0ubuntu0.18.04.1_amd64.deb
      E: Sub-process /usr/bin/dpkg returned an error code (1)
      
      install mysql-client mysql-server
      Reading package lists... Done
      Building dependency tree
      Reading state information... Done
      mysql-client is already the newest version (5.7.27-0ubuntu0.18.04.1).
      mysql-server is already the newest version (5.7.27-0ubuntu0.18.04.1).
      You might want to run 'apt --fix-broken install' to correct these.
      The following packages have unmet dependencies:
       mysql-server : Depends: mysql-server-5.7 but it is not going to be installed
      E: Unmet dependencies. Try 'apt --fix-broken install' with no packages (or specify a solution).
      

      =Update=
      accidentally ran command sudo rm -rvf /var/lib
      (thought i was typing in a new line, working too quick, was backing up mysql and purging etc) Going to start a fresh i think

      posted in FOG Problems
      A
      Arrowtron
    • RE: FOG 1.5.7 Update Database Issue

      @Arrowtron

      Update, just refreshed the page and loaded into this
      d8071618-7950-4bc1-a8d5-de8154350a75-image.png

      clicked Install/update now and can now see the dashboard, looks very empty. I will look more into this tomorrow

      posted in FOG Problems
      A
      Arrowtron
    • RE: FOG 1.5.7 Update Database Issue

      @Sebastian-Roth

      These are my results below:

      mariadb.service - MariaDB 10.1.40 database server
        Loaded: loaded (/lib/systemd/system/mariadb.service; enabled; vendor preset: enabled)
        Active: active (running) since Mon 2019-08-05 16:50:56 AEST; 9min ago
          Docs: man:mysqld(8)
                https://mariadb.com/kb/en/library/systemd/
      Main PID: 22323 (mysqld)
        Status: "Taking your SQL requests now..."
         Tasks: 34 (limit: 4419)
        CGroup: /system.slice/mariadb.service
                └─22323 /usr/sbin/mysqld
      
      drwxr-xr-x  4 mysql     mysql     4096 Aug  5 16:50 mysql
      drwx------  6 mysql     mysql     4096 Aug  5 15:25 mysql-5.7
      drwx------  2 mysql     mysql     4096 Oct 28  2018 mysql-files
      drwx------  2 mysql     mysql     4096 Mar  7  2017 mysql-keyring
      

      updated from 1.5.6 to 1.5.7, get the same issue as everyone is describing
      changed to dev branch 1.5.7.2 re-installed to see if it would fix it. still the same

      I am able to get into MariaDB with mysql -u root -p

      Welcome to the MariaDB monitor.  Commands end with ; or \g.
      Your MariaDB connection id is 28366
      Server version: 10.1.40-MariaDB-0ubuntu0.18.04.1 Ubuntu 18.04
      
      Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.
      
      Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
      
      MariaDB [(none)]> Ctrl-C -- exit!
      Aborted
      

      I have backup’s here, but not quite sure how to restore them so the installation works

      /home/fogDBbackups
      

      FileZilla.png

      posted in FOG Problems
      A
      Arrowtron
    • RE: Adding needed repository... Failed!

      @arrowtron

      Update:

      @Sebastian-Roth Post about editing \root\fogproject\lib\common\functions.sh has fixed the issue

      Thanks!

      posted in FOG Problems
      A
      Arrowtron
    • RE: Adding needed repository... Failed!

      Hi there,

      I am getting the same issue as well, please assist

      Currently running FOG 1.5.0, trying to upgrade to 1.5.2 through PUTTY

      0_1523498264074_bb171c07-b7e9-411b-b91e-ce0b482d7901-image.png

      I am not running through a Proxy, i have upgraded to 1.5.0 a few weeks ago i think

      posted in FOG Problems
      A
      Arrowtron
    • RE: DBAN FOG Boot Menu

      @sebastian-roth said in DBAN FOG Boot Menu:

      kernel ${boot-url}/dban/dban.bzi nuke=“dwipe --autonuke --method quick” silent vga=785
      boot || goto MENU

      Ah of course!
      I have tried all the commands above and this one worked well!

      kernel ${boot-url}/dban/dban.bzi nuke="dwipe --autonuke --method quick" silent vga=785
      boot || goto MENU
      

      Yes may need to update the Wiki! Thanks for your replies and assistance!

      posted in FOG Problems
      A
      Arrowtron
    • 1 / 1