Install w/ -y Skips Database Now

[Tom Elliott]

On a theory I ran a test by dropping database fog.

Then ran installer with -y and it created the database 100% properly.

[dholtz-docbox]

I am not sure what the difference in a storage server and storage node are, but when I selected the normal install type.

I had everything worked on RC15 fine, but for some reason, the sources.list file that gets distributed with it was having a lot of issues. As soon as I updated our mirror to the latest, RC21, the apt-get issues went away, but it appears that mysql doesn’t install its database now. Everything appears to have installed correctly; I just can’t get it to install the ‘fog’ database (as far as I can tell). It also appears that the system recognizes the same, as I get back the contents schemaupdaterpage.php when I run wget 0.0.0.0/fog/management.

I figured I would just curl this page and attempt to submit it, forcing the database installer/updater - just to validate that all that is missing is the database. However, I seem to be running in circles identifying both the PHP file and the parameters to submit to/with. Unless I am successfully submitting a command and nothing is occurring - which you indicate should not be the case. In which case, I circle back around to, why, given a fresh OS, does FOG successfully install w/o issues yet fail to install the ‘fog’ database.

Anything to manually kick this off though would be helpful too, just to aid in debugging scenarios such as this.

Currently, I am trying stuff like… curl -s -d "confirm=value&fogverified=value" htttp://0.0.0.0/fog/management/index.php I have also tried with other data fields and php pages, such as commons/schema.php.

-Dustin

[Tom Elliott]

@dholtz-docbox where is 0.0.0.0 coming from?

[dholtz-docbox]

PS> Output…

Installing LSB_Release as needed
 * Attempting to get release information.......................Done


   +------------------------------------------+
   |     ..#######:.    ..,#,..     .::##::.  |
   |.:######          .:;####:......;#;..     |
   |...##...        ...##;,;##::::.##...      |
   |   ,#          ...##.....##:::##     ..:: |
   |   ##    .::###,,##.   . ##.::#.:######::.|
   |...##:::###::....#. ..  .#...#. #...#:::. |
   |..:####:..    ..##......##::##  ..  #     |
   |    #  .      ...##:,;##;:::#: ... ##..   |
   |   .#  .       .:;####;::::.##:::;#:..    |
   |    #                     ..:;###..       |
   |                                          |
   +------------------------------------------+
   |      Free Computer Imaging Solution      |
   +------------------------------------------+
   |  Credits: http://fogproject.org/Credits  |
   |       http://fogproject.org/Credits      |
   |       Released under GPL Version 3       |
   +------------------------------------------+


   Version: 1.3.0-RC-21 Installer/Updater


 * Found FOG Settings from previous install at: /opt/fog/.fogsettings

 * Performing upgrade using these settings


  Starting Debian based Installation



   ######################################################################
   #     FOG now has everything it needs for this setup, but please     #
   #   understand that this script will overwrite any setting you may   #
   #   have setup for services like DHCP, apache, pxe, tftp, and NFS.   #
   ######################################################################
   # It is not recommended that you install this on a production system #
   #        as this script modifies many of your system settings.       #
   ######################################################################
   #             This script should be run by the root user.            #
   #      It will prepend the running with sudo if root is not set      #
   ######################################################################
   #           ** Notice ** FOG is difficult to setup securely          #
   #        SELinux and IPTables are usually asked to be disabled       #
   #           There have been strides in adding capabilities           #
   #          The recommendations would now be more appropriate         #
   #    to set SELinux to permissive and to disable firewall for now.   #
   #  You can find some methods to enable SELinux and maintain firewall #
   #   settings and ports. If you feel comfortable doing so please do   #
   ######################################################################
   #            Please see our wiki for more information at:            #
   ######################################################################
   #             https://wiki.fogproject.org/wiki/index.php             #
   ######################################################################

 * Here are the settings FOG will use:
 * Base Linux: Debian
 * Detected Linux Distribution: Ubuntu
 * Server IP Address: 10.1.0.11
 * Server Subnet Mask: 255.255.255.0
 * Interface: p3p1
 * Installation Type: Normal Server
 * Donate: 0
 * Internationalization: 0
 * Image Storage Location: /images
 * Using FOG DHCP: Yes
 * DHCP router Address: 



 * Installation Started

 * Installing required packages, if this fails
 | make sure you have an active internet connection.

 * Adding needed repository....................................OK
 * Preparing Package Manager...................................OK
 * Packages to be installed:

	 apache2 bc build-essential cpp curl g++ gawk gcc gzip htmldoc isc-dhcp-server lftp libapache2-mod-php5 libc6 libcurl3 m4 mysql-client mysql-server net-tools nfs-kernel-server openssh-server php5 php5-bcmath php5-cli php5-curl php5-fpm php5-gd php5-json php5-ldap php5-mcrypt php5-mysqlnd php-gettext sysv-rc-conf tar tftpd-hpa tftp-hpa vsftpd wget xinetd zlib1g 


 * Installing package: apache2.................................OK
 * Skipping package: bc........................................(Already Installed)
 * Skipping package: build-essential...........................(Already Installed)
 * Skipping package: cpp.......................................(Already Installed)
 * Skipping package: curl......................................(Already Installed)
 * Skipping package: g++.......................................(Already Installed)
 * Skipping package: gawk......................................(Already Installed)
 * Skipping package: gcc.......................................(Already Installed)
 * Skipping package: gzip......................................(Already Installed)
 * Installing package: htmldoc.................................OK
 * Skipping package: isc-dhcp-server...........................(Already Installed)
 * Installing package: lftp....................................OK
 * Installing package: libapache2-mod-php5.....................OK
 * Skipping package: libc6.....................................(Already Installed)
 * Skipping package: libcurl3..................................(Already Installed)
 * Installing package: m4......................................OK
 * Installing package: mysql-client............................OK
 * Installing package: mysql-server............................OK
 * Skipping package: net-tools.................................(Already Installed)
 * Installing package: nfs-kernel-server.......................OK
 * Skipping package: openssh-server............................(Already Installed)
 * Installing package: php5....................................OK
 * Skipping package: php5-bcmath...............................(Does not exist)
 * Skipping package: php5-cli..................................(Already Installed)
 * Installing package: php5-curl...............................OK
 * Installing package: php5-fpm................................OK
 * Installing package: php5-gd.................................OK
 * Skipping package: php5-json.................................(Already Installed)
 * Installing package: php5-ldap...............................OK
 * Installing package: php5-mcrypt.............................OK
 * Installing package: php5-mysqlnd............................OK
 * Installing package: php-gettext.............................OK
 * Installing package: sysv-rc-conf............................OK
 * Skipping package: tar.......................................(Already Installed)
 * Installing package: tftpd-hpa...............................OK
 * Installing package: tftp-hpa................................OK
 * Installing package: vsftpd..................................OK
 * Skipping package: wget......................................(Already Installed)
 * Installing package: xinetd..................................OK
 * Skipping package: zlib1g....................................(Already Installed)
 * Updating packages as needed.................................OK

 * Confirming package installation

 * Checking package: apache2...................................OK
 * Checking package: bc........................................OK
 * Checking package: build-essential...........................OK
 * Checking package: cpp.......................................OK
 * Checking package: curl......................................OK
 * Checking package: g++.......................................OK
 * Checking package: gawk......................................OK
 * Checking package: gcc.......................................OK
 * Checking package: gzip......................................OK
 * Checking package: htmldoc...................................OK
 * Checking package: isc-dhcp-server...........................OK
 * Checking package: lftp......................................OK
 * Checking package: libapache2-mod-php5.......................OK
 * Checking package: libc6.....................................OK
 * Checking package: libcurl3..................................OK
 * Checking package: m4........................................OK
 * Checking package: mysql-client..............................OK
 * Checking package: mysql-server..............................OK
 * Checking package: net-tools.................................OK
 * Checking package: nfs-kernel-server.........................OK
 * Checking package: openssh-server............................OK
 * Checking package: php5......................................OK
 * Checking package: php5-cli..................................OK
 * Checking package: php5-curl.................................OK
 * Checking package: php5-fpm..................................OK
 * Checking package: php5-gd...................................OK
 * Checking package: php5-json.................................OK
 * Checking package: php5-ldap.................................OK
 * Checking package: php5-mcrypt...............................OK
 * Checking package: php5-mysqlnd..............................OK
 * Checking package: php-gettext...............................OK
 * Checking package: sysv-rc-conf..............................OK
 * Checking package: tar.......................................OK
 * Checking package: tftpd-hpa.................................OK
 * Checking package: tftp-hpa..................................OK
 * Checking package: vsftpd....................................OK
 * Checking package: wget......................................OK
 * Checking package: xinetd....................................OK
 * Checking package: zlib1g....................................OK

 * Configuring services

 * Setting up fog user.........................................OK
 * Setting up fog password.....................................OK
 * Stopping FOGMulticastManager Service........................OK
 * Stopping FOGImageReplicator Service.........................OK
 * Stopping FOGSnapinReplicator Service........................OK
 * Stopping FOGScheduler Service...............................OK
 * Stopping FOGPingHosts Service...............................OK
 * Setting up and starting MySQL...............................OK
 * Backing up user reports.....................................Done
 * Stopping web service........................................OK
 * Setting up Apache and PHP files.............................OK
 * Testing and removing symbolic links if found................OK
 * Backing up old data.........................................OK
 * Copying new files to web folder.............................OK
 * Creating config file........................................OK
 * Getting checksum files for kernels and inits................OK
 * Downloading inits, kernels, and the fog client..............OK
 * Comparing checksums of kernels and inits....................Done
 * Enabling apache and fpm services on boot....................OK
 * Creating SSL CA.............................................OK
 * Creating SSL Private Key....................................OK
 * Creating SSL Certificate....................................OK
 * Creating auth pub key and cert..............................OK
 * Resetting SSL Permissions...................................OK
 * Setting up SSL FOG Server...................................OK
 * Restarting Apache2 for fog vhost............................OK
 * Changing permissions on apache log files....................OK
 * Backing up database.........................................OK
 * Updating Database...........................................OK
 * Setting up storage..........................................OK
 * Setting up and starting DHCP Server......................... !!! No router address found !!!
 !!! No dns address found !!!
OK
 * Setting up and starting TFTP and PXE Servers................OK
 * Setting up and starting VSFTP Server........................OK
 * Setting up FOG Snapins......................................OK
 * Setting up UDPCast..........................................OK
 * Configuring UDPCast.........................................OK
 * Building UDPCast............................................OK
 * Installing UDPCast..........................................OK
 * Installing FOG System Scripts...............................OK


 * Configuring FOG System Services


 * Setting FOGMulticastManager script executable...............OK
 * Enabling FOGMulticastManager Service........................OK
 * Setting FOGImageReplicator script executable................OK
 * Enabling FOGImageReplicator Service.........................OK
 * Setting FOGSnapinReplicator script executable...............OK
 * Enabling FOGSnapinReplicator Service........................OK
 * Setting FOGScheduler script executable......................OK
 * Enabling FOGScheduler Service...............................OK
 * Setting FOGPingHosts script executable......................OK
 * Enabling FOGPingHosts Service...............................OK
 * Setting up FOG Services.....................................OK
 * Starting FOGMulticastManager Service........................OK
 * Starting FOGImageReplicator Service.........................OK
 * Starting FOGSnapinReplicator Service........................OK
 * Starting FOGScheduler Service...............................OK
 * Starting FOGPingHosts Service...............................OK
 * Setting up exports file.....................................OK
 * Setting up and starting RPCBind.............................OK
 * Setting up and starting NFS Server..........................OK
 * Linking FOG Logs to Linux Logs..............................OK
 * Linking FOG Service config /etc.............................OK
 * Ensuring node username and passwords match..................Done

 * Setup complete

   You can now login to the FOG Management Portal using
   the information listed below.  The login information
   is only if this is the first install.

   This can be done by opening a web browser and going to:

   http://10.1.0.11/fog/management

   Default User Information
   Username: fog
   Password: password

After installation…

mysql -u root fog
ERROR 1049 (42000): Unknown database 'fog'

When I query MySQL for its databases, I only see…

information_schema
mysql
performance_schema

[dholtz-docbox]

@Tom-Elliott : that’s just for the localhost? I am running that from the machine where FOG is installed. This server is on an isolated network, so it’s easiest to do from the machine itself. Is this invalid? I only thought about trying this, knowing that, when I wget the management page, if the database isn’t installed, I am told that my “FOG database schema is not up to date” and everything else that comes with schemaupdaterpage.php. I suppose the other thing this page mentions is that my database connection appears invalid, and that I should check the credentials. Let me double check these, I assumed they would be fine as I haven’t changed anything other than updating our FOG git mirror.

-Dustin

[Tom Elliott]

@dholtz-docbox 127.0.0.1 = localhost

[dholtz-docbox]

@Tom-Elliott 0.0.0.0 and 127.0.0.1 resolve the same, unless I am mistaken about something. That said, that was just for my sample wget and curl calls, which unfortunately return the same output when switched to 127.0.0.1.

[dholtz-docbox]

Just as an update, as I am not sure what the hitch here is.

In an attempt to quarantine the issue, these are the steps being used.

Pre-installation:

• Starting from a blank Ubuntu 14.04.5 Server LVM installation
• Skipping internal bootstrap

Post-installation:

• Login
• Create /opt/fog directory
• sudo apt-get install git
• sudo git clone https://github.com/FOGProject/fogproject.git /opt/fog/dist
• Copy .fogsettings from configuration server
• cd /opt/fog/dist/bin
• sudo ./installfog.sh -y

After installfog.sh successfully completes - as denoted by the * Setup Complete prompt during FOG installation - I then try to access the fog database, using mysql -u root -D fog. At this point, I am prompted the following, “ERROR 1049 (42000): Unknown database ‘fog’.”

I am unsure what is causing this, but it simply appears, to me, that commons/schema.php isn’t being applied. I have attempted a handful of things, as well as begun digging through the repository in an attempt to better understand this. Unfortunately, I have not figured out a manual way to install the database, nor a way to identify what may be occurring that would cause this.

Further, if there is another variable I can cut down on, please let me know. I am trying to replicate the issue with as few of our own variables mixed in as possible. At this stage, we have not bootstrapped the system, and have only installed the necessary package. I have also tried running sudo apt-get update && apt-get upgrade -y --force-yes before proceeding as well, to no success. This is also using the git HEAD, so there should be no concern about our git mirror of the FOG Project intervening either.

No matter what I do with the latest RC, I cannot get the ‘fog’ database to install - outside of manually running the create+insert script myself.

Is there a way to manually install the database (read, not relying on foginstall.sh) just to validate that everything works. I suppose that’s moot, as I shouldn’t be in control of creating the schema anyway and the installer should always handle it. Just in this current state, I am curious if everything would work if I could install the database. If the -y switch is working as designed, I guess I am curious where this region of logic is handled so that I may further diagnose what the issue might be. My hope in manually doing it was that it would validate whether there was another issue at hand. That said, if there were another issue at hand, you would think the installer would fail.

I feel a little lost with this one, given that RC15 worked without a hitch, and that everything is “installed” successfully with RC21. Yet, when I go to query the ‘fog’ database, am told it doesn’t exist. Thus, indicating to me that some action wasn’t triggered/routed correctly, or that something error’d out and was silently handled.

I will be back on this tomorrow morning - I have to go vote for now.

-Dustin

[Tom Elliott]

@dholtz-docbox this makes me wonder if ufw is running? I don’t know why buy it almost seems, to me, the local link is restricting to a socket, not allowing connection via TCP.

Can you post the contents of your MySQL config file? I don’t know where it will be located. Typically it’s under /etc/mysql/my.cnf or /etc/my.cnf, but it is Ubuntu.

[Tom Elliott]

RC-22 officially released.

I don’t think it will fix the issue as you were seeing it, but one never knows.

I would more prefer a remote session if this is still not fixed for you though.

[Wayne Workman]

@dholtz-docbox For the last month or so, I’ve been quality-checking Ubuntu 16 to see if it installs without issue or not, and the last time I’ve checked it was fine. Is there a legitimate reason you’re still installing Ubuntu 14, or can you move to the new long-term-support version of Ubuntu?

[x23piracy]

@Wayne-Workman said in Install w/ -y Skips Database Now:

@dholtz-docbox For the last month or so, I’ve been quality-checking Ubuntu 16 to see if it installs without issue or not, and the last time I’ve checked it was fine. Is there a legitimate reason you’re still installing Ubuntu 14, or can you move to the new long-term-support version of Ubuntu?

Hi,
i am also still using Ubuntu 14, when i connect with ssh i see the following:

To upgrade to a supported (or longer-supported) configuration:

* Upgrade from Ubuntu 14.04 LTS to Ubuntu 16.04 LTS by running:
sudo do-release-upgrade

OR

* Switch to the current security-supported stack by running:
sudo apt-get install linux-signed-generic-lts-xenial linux-signed-image-generic-lts-xenial

and reboot your system.

someone around who did “sudo do-release-upgrade” from 14 to 16 without any issue? i also would like to update but i am a little bit afraid from getting any crashed, sure i can make a complete backup but i like to talk about in first instance.

Would i be better to switch to current security-supported stack and make a apt-get update / upgrade first?

Regards X23

[Wayne Workman]

@x23piracy Upgrading a FOG server running on Ubuntu scares me. Honestly. So many people have had bad experiences with it.

However, Tom says he has the upgrade issues worked out.

You’ll need to change /opt/fog/.fogsettings to include gawk in the packages list, and you’ll need to move to PHP 7 if you haven’t already, and remove any PHP 5 stuff in the .fogsettings file.

@Tom-Elliott anything else?

[Tom Elliott]

@Wayne-Workman I only said that I know how to perform an upgrade. Each system is different though.

Essentially the best steps to perform,

Do the release upgrade.

remove apache and php entirely by:

rm -rf /etc/{apache,php}*
apt-get purge php5* libapache*

Run the installer and all should work fine.

I know this sounds simple, but it took us “how long” to finally kind of get a track on it? I have not made these assumptions in the installer.

[x23piracy]

@Tom-Elliott if this works can i do the same with a storage node?

[Tom Elliott]

@x23piracy it isn’t a can I it’s a you should. Php and Apache is always installed regardless of node or server install.