Cannot Install Fog on new Ubuntu 16.04 Server

Sebastian Roth

@SBrady @george1421 I see several issues in the log that make me think there is something “wrong” with your internet connection. The installer tries to add software repositories to be able to install PHP 7.0 but this fails in various ways:

gpg: keyring `/tmp/tmp010gbxbg/secring.gpg' created
gpg: keyring `/tmp/tmp010gbxbg/pubring.gpg' created
gpg: requesting key E5267A6C from hkp server keyserver.ubuntu.com
gpgkeys: key 14AA40EC0831756756D7F66C4F4EA0AAE5267A6C can't be retrieved
gpg: no valid OpenPGP data found.
gpg: Total number processed: 0
gpg: keyserver communications error: keyserver helper general error
gpg: keyserver communications error: unknown pubkey algorithm
gpg: keyserver receive failed: unknown pubkey algorithm
Failed to add key.
gpg: keyring `/tmp/tmpc1vb8t4j/secring.gpg' created
gpg: keyring `/tmp/tmpc1vb8t4j/pubring.gpg' created
gpg: requesting key E5267A6C from hkp server keyserver.ubuntu.com
gpgkeys: key 14AA40EC0831756756D7F66C4F4EA0AAE5267A6C can't be retrieved
gpg: no valid OpenPGP data found.
gpg: Total number processed: 0
gpg: keyserver communications error: keyserver helper general error
gpg: keyserver communications error: unknown pubkey algorithm
gpg: keyserver receive failed: unknown pubkey algorithm
Failed to add key.
Get:1 http://ppa.launchpad.net/ondrej/apache2/ubuntu xenial InRelease
Err:1 http://ppa.launchpad.net/ondrej/apache2/ubuntu xenial InRelease
  Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
Get:2 http://ppa.launchpad.net/ondrej/php/ubuntu xenial InRelease
Err:2 http://ppa.launchpad.net/ondrej/php/ubuntu xenial InRelease
  Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
Hit:3 http://us.archive.ubuntu.com/ubuntu xenial InRelease
Get:4 http://security.ubuntu.com/ubuntu xenial-security InRelease [109 kB]
Hit:5 http://us.archive.ubuntu.com/ubuntu xenial-updates InRelease
Get:6 http://us.archive.ubuntu.com/ubuntu xenial-backports InRelease [107 kB]
Fetched 226 kB in 0s (276 kB/s)
Reading package lists...
E: Failed to fetch http://ppa.launchpad.net/ondrej/apache2/ubuntu/dists/xenial/InRelease  Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
E: Failed to fetch http://ppa.launchpad.net/ondrej/php/ubuntu/dists/xenial/InRelease  Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
E: Some index files failed to download. They have been ignored, or old ones used instead.

Especially the last three lines of the logs you see above…

Try using the following commands manually before running the installer again to see what happens:

sudo -i
add-apt-repository -y ppa:ondrej/php
add-apt-repository -y ppa:ondrej/apache2

SBrady

@Sebastian-Roth Hi Sebastian, I ran the commands you suggested and this was the outcome:

I’m able to ping google.com and use SSH. The only thing I can think of is when I create the VM I do not add the NIC until after I install Ubuntu. I can try to do a clean install and add the NIC sooner if that helps.

SBrady

@Sebastian-Roth Update: I built a new server and added the NIC before installing Ubuntu. Didn’t make a difference and got the same outcome.

Here are the logs, they might be cleaner or show something different:

foginstall.log
fog_error_1.5.7.log

Sebastian Roth

@SBrady said in Cannot Install Fog on new Ubuntu 16.04 Server:

I built a new server and added the NIC before installing Ubuntu. Didn’t make a difference and got the same outcome.

Shouldn’t make a difference as long as you have the NIC ready and configured before running the FOG installer.

My guess is that your firewall or proxy doesn’t allow the VM to connect to the keyservers. I am not exactly sure but I think some high port is used for that (not HTTP/HTTPS). Or your ISP is forcing your internet traffic to go through some kind of transparent/invisible proxy server?!

Please try to manually open this URL in your browser: http://ppa.launchpad.net/ondrej/apache2/ubuntu/dists/xenial/InRelease
Does it work? Then try wget http://ppa.launchpad.net/ondrej/apache2/ubuntu/dists/xenial/InRelease on the FOG server command line. Does it work?

SBrady

@Sebastian-Roth When I go to that link in IE or Chrome, I see all the packages and releases.

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Origin: LP-PPA-ondrej-apache2
Label: PPA for Apache 2.x
Suite: xenial
Version: 16.04
Codename: xenial
Date: Tue, 06 Aug 2019 15:45:52 UTC
Architectures: amd64 arm64 armhf i386 powerpc ppc64el s390x
Components: main
Description: Ubuntu Xenial 16.04
MD5Sum:

When I put the command in Ubuntu, I get the following:

root@SLCOXXA0002:~# wget http://ppa.launchpad.net/ondrej/apache2/ubuntu/dists/xe                                                                              nial/InRelease
--2019-08-06 09:05:47--  http://ppa.launchpad.net/ondrej/apache2/ubuntu/dists/xe                                                                              nial/InRelease
Resolving ppa.launchpad.net (ppa.launchpad.net)... 91.189.95.83
Connecting to ppa.launchpad.net (ppa.launchpad.net)|91.189.95.83|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: âInReleaseâ

InRelease                                   [ <=>                                                                          ]   4.73K  --.-KB/s    in 0.001s

2019-08-06 09:05:52 (4.46 MB/s) - âInReleaseâ saved [4845]

root@SLCOXXA0002:~#

Also, I will check with my Sr. Engineer about the other stuff you mentioned and see if they’re being blocked.

Sebastian Roth

@SBrady Let’s try to see if you can download the key information manually. Run curl "http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C" and post the full output here.

You might need to manually install curl before that. sudo apt-get install curl

If you get a proper output from the curl command you might want to manually add the apt key:

sudo -i
apt-get install wget
wget -O - "http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C" | apt-key add -

Sebastian Roth

This is a really strange issue. We have seen this a couple of times now and I guess it’s got to do with ISP’s transparent proxies or something like that:

https://forums.fogproject.org/topic/11641/adding-needed-repository-failed

SBrady

@Sebastian-Roth

ran code:

curl "http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C"

got this:

root@SLCOXXA0002:~# curl "http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C"                         <!DOCTYPE html
        PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
         "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" lang="en-US" xml:lang="en-US">
<head>
<title>lid_25793</title>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
</head>
<body content-type="text/plain; charset=UTF-8">
<span id="redir_msg" style="display: none"><p>Redirecting you to Web Security Gateway.</p></span><script language="JavaScript" x-barracuda="1">
if (0) {
  document.write('<div style="border: 1px dotted red; padding: 2px; font-family: sans; font-size: 12px; color: black; background-color: white">This portion of the requested page has been blocked.<br /><a href="http://172.27.72.27/cgi-mod/spyportal.cgi?_bcsp=1&amp;_bceq=U2FsdGVkX18hi6qjMcegkUSYaLzTSfe69rtWzlD4NaE8tL17zdWw9k8_P1686yld4UakGgxQrxtLjp2dLNpT2NgVr9-YK-n7omv1WeeS5BnvFVFtvlCHwebvdrVQPnyNWB7iLnzGvpKX-3sBBWkAGePrmHeEey4Xi8wDOHyc-HJfDhJ84SwCgMspNC5e2fFDppMN48MZqKR-K8fIYPOb7vRp2R27lEmAOHircwCYLFAtKEqaPXIGTKCiQB54NRVAF9hS2aIZRMhn9JmZnhrlv3TYX-hNSe4s8fvTdlXc-eDgDsYMNjlHwMKanjNQe9iDIgsmMhtHFCvwuwBKQpPClWjStA81ftJ4okEZz8C7mvxQ5vk1fHoj7dT2Kmk2c2X8NQ4Y5IHXOFD2AnEarGz4J8vZpShH-5m9-a2f9XeSs0HEl38MWVFlEh7HwbV-D8mRjPCAZdXMUQfah31OdUJdA61gUmu6jZ2mEvtWI2BbIJBIypra0f_gZAPaSv6Jy9QPE-dMYcdR6x0yB08VpNKwYTuh86QxVOXFSqUK4dYq-SAbbwM4kCV-qvd708SZH6JRohKglYIdwH9ocrE4XeeTckb8W_ErvP9xDieqjYPqu3H-cqW45gI8GD9DamsMHHaM-mukKH9Nvh_gJ9Wj1_Ulrg.." target="_top">Click here for details.</a></div>');
} else {
  if (!0) {
    var toploc;
    try { toploc = top.document.location }
    catch (err) { toploc = err };
    if ((toploc == document.location)) {
      document.getElementById('redir_msg').style.display = 'inline';
      if (location.replace) {
        location.replace('http://172.27.72.27/cgi-mod/spyportal.cgi?_bcsp=1&_bceq=U2FsdGVkX18hi6qjMcegkUSYaLzTSfe69rtWzlD4NaE8tL17zdWw9k8_P1686yld4UakGgxQrxtLjp2dLNpT2NgVr9-YK-n7omv1WeeS5BnvFVFtvlCHwebvdrVQPnyNWB7iLnzGvpKX-3sBBWkAGePrmHeEey4Xi8wDOHyc-HJfDhJ84SwCgMspNC5e2fFDppMN48MZqKR-K8fIYPOb7vRp2R27lEmAOHircwCYLFAtKEqaPXIGTKCiQB54NRVAF9hS2aIZRMhn9JmZnhrlv3TYX-hNSe4s8fvTdlXc-eDgDsYMNjlHwMKanjNQe9iDIgsmMhtHFCvwuwBKQpPClWjStA81ftJ4okEZz8C7mvxQ5vk1fHoj7dT2Kmk2c2X8NQ4Y5IHXOFD2AnEarGz4J8vZpShH-5m9-a2f9XeSs0HEl38MWVFlEh7HwbV-D8mRjPCAZdXMUQfah31OdUJdA61gUmu6jZ2mEvtWI2BbIJBIypra0f_gZAPaSv6Jy9QPE-dMYcdR6x0yB08VpNKwYTuh86QxVOXFSqUK4dYq-SAbbwM4kCV-qvd708SZH6JRohKglYIdwH9ocrE4XeeTckb8W_ErvP9xDieqjYPqu3H-cqW45gI8GD9DamsMHHaM-mukKH9Nvh_gJ9Wj1_Ulrg..');
      } else {
        document.location = 'http://172.27.72.27/cgi-mod/spyportal.cgi?_bcsp=1&_bceq=U2FsdGVkX18hi6qjMcegkUSYaLzTSfe69rtWzlD4NaE8tL17zdWw9k8_P1686yld4UakGgxQrxtLjp2dLNpT2NgVr9-YK-n7omv1WeeS5BnvFVFtvlCHwebvdrVQPnyNWB7iLnzGvpKX-3sBBWkAGePrmHeEey4Xi8wDOHyc-HJfDhJ84SwCgMspNC5e2fFDppMN48MZqKR-K8fIYPOb7vRp2R27lEmAOHircwCYLFAtKEqaPXIGTKCiQB54NRVAF9hS2aIZRMhn9JmZnhrlv3TYX-hNSe4s8fvTdlXc-eDgDsYMNjlHwMKanjNQe9iDIgsmMhtHFCvwuwBKQpPClWjStA81ftJ4okEZz8C7mvxQ5vk1fHoj7dT2Kmk2c2X8NQ4Y5IHXOFD2AnEarGz4J8vZpShH-5m9-a2f9XeSs0HEl38MWVFlEh7HwbV-D8mRjPCAZdXMUQfah31OdUJdA61gUmu6jZ2mEvtWI2BbIJBIypra0f_gZAPaSv6Jy9QPE-dMYcdR6x0yB08VpNKwYTuh86QxVOXFSqUK4dYq-SAbbwM4kCV-qvd708SZH6JRohKglYIdwH9ocrE4XeeTckb8W_ErvP9xDieqjYPqu3H-cqW45gI8GD9DamsMHHaM-mukKH9Nvh_gJ9Wj1_Ulrg..';
      }
    } else {
      document.write('<div style="border: 1px dotted red; padding: 2px; font-family: sans; font-size: 12px; color: black; background-color: white">This portion of the requested page has been blocked.<br /><a href="http://172.27.72.27/cgi-mod/spyportal.cgi?_bcsp=1&amp;_bceq=U2FsdGVkX18hi6qjMcegkUSYaLzTSfe69rtWzlD4NaE8tL17zdWw9k8_P1686yld4UakGgxQrxtLjp2dLNpT2NgVr9-YK-n7omv1WeeS5BnvFVFtvlCHwebvdrVQPnyNWB7iLnzGvpKX-3sBBWkAGePrmHeEey4Xi8wDOHyc-HJfDhJ84SwCgMspNC5e2fFDppMN48MZqKR-K8fIYPOb7vRp2R27lEmAOHircwCYLFAtKEqaPXIGTKCiQB54NRVAF9hS2aIZRMhn9JmZnhrlv3TYX-hNSe4s8fvTdlXc-eDgDsYMNjlHwMKanjNQe9iDIgsmMhtHFCvwuwBKQpPClWjStA81ftJ4okEZz8C7mvxQ5vk1fHoj7dT2Kmk2c2X8NQ4Y5IHXOFD2AnEarGz4J8vZpShH-5m9-a2f9XeSs0HEl38MWVFlEh7HwbV-D8mRjPCAZdXMUQfah31OdUJdA61gUmu6jZ2mEvtWI2BbIJBIypra0f_gZAPaSv6Jy9QPE-dMYcdR6x0yB08VpNKwYTuh86QxVOXFSqUK4dYq-SAbbwM4kCV-qvd708SZH6JRohKglYIdwH9ocrE4XeeTckb8W_ErvP9xDieqjYPqu3H-cqW45gI8GD9DamsMHHaM-mukKH9Nvh_gJ9Wj1_Ulrg.." target="_top">Click here for details.</a></div>');
    }
  }
}
</script><noscript><p>JavaScript has been disabled in your browser.</p> <p><a href="http://172.27.72.27/cgi-mod/spyportal.cgi?_bcsp=1&amp;_bceq=U2FsdGVkX18hi6qjMcegkUSYaLzTSfe69rtWzlD4NaE8tL17zdWw9k8_P1686yld4UakGgxQrxtLjp2dLNpT2NgVr9-YK-n7omv1WeeS5BnvFVFtvlCHwebvdrVQPnyNWB7iLnzGvpKX-3sBBWkAGePrmHeEey4Xi8wDOHyc-HJfDhJ84SwCgMspNC5e2fFDppMN48MZqKR-K8fIYPOb7vRp2R27lEmAOHircwCYLFAtKEqaPXIGTKCiQB54NRVAF9hS2aIZRMhn9JmZnhrlv3TYX-hNSe4s8fvTdlXc-eDgDsYMNjlHwMKanjNQe9iDIgsmMhtHFCvwuwBKQpPClWjStA81ftJ4okEZz8C7mvxQ5vk1fHoj7dT2Kmk2c2X8NQ4Y5IHXOFD2AnEarGz4J8vZpShH-5m9-a2f9XeSs0HEl38MWVFlEh7HwbV-D8mRjPCAZdXMUQfah31OdUJdA61gUmu6jZ2mEvtWI2BbIJBIypra0f_gZAPaSv6Jy9QPE-dMYcdR6x0yB08VpNKwYTuh86QxVOXFSqUK4dYq-SAbbwM4kCV-qvd708SZH6JRohKglYIdwH9ocrE4XeeTckb8W_ErvP9xDieqjYPqu3H-cqW45gI8GD9DamsMHHaM-mukKH9Nvh_gJ9Wj1_Ulrg..">Proceed to detail/login page</a></p></noscript>
</body>
</html>root@SLCOXXA0002:~#

Ran this:

wget -O - "http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C" | apt-key add -

Got this:

root@SLCOXXA0002:~# wget -O - "http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C" | apt-key add -
--2019-08-06 13:57:04--  http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C
Resolving keyserver.ubuntu.com (keyserver.ubuntu.com)... 162.213.33.9, 162.213.33.8
Connecting to keyserver.ubuntu.com (keyserver.ubuntu.com)|162.213.33.9|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: âSTDOUTâ

-                                           [ <=>                                                                          ]   4.99K  --.-KB/s    in 0s

2019-08-06 13:57:09 (121 MB/s) - written to stdout [5105]

gpg: no valid OpenPGP data found.
root@SLCOXXA0002:~# root@SLCOXXA0002:~# wget -O - "http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C" | apt-key add -
--2019-08-06 13:57:04--  http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C
Resolving keyserver.ubuntu.com (keyserver.ubuntu.com)... 162.213.33.9, 162.213.33.8
Connecting to keyserver.ubuntu.com (keyserver.ubuntu.com)|162.213.33.9|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: âSTDOUTâ

-                                           [ <=>                                                                          ]   4.99K  --.-KB/s    in 0s

2019-08-06 13:57:09 (121 MB/s) - written to stdout [5105]

gpg: no valid OpenPGP data found.
root@SLCOXXA0002:~#

SBrady

@Sebastian-Roth

https://forums.fogproject.org/topic/11641/adding-needed-repository-failed

This is the thread I found before posting on here regarding how to disable the repository, which worked and got me further than before. Is there anything else I can do? Or is there another known working solution on a different version of Ubuntu or FOG?

Sebastian Roth

@SBrady Well, just using a more up to date Ubuntu might help. Ubuntu 18.04 comes with a newer PHP version in the official software repos and those ought to install without an issue if you add the manual #errorStat $? fix.

Other than that it would still be worth investigating why this is not properly working in your environment. When I run the same command I get this:

curl "http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C"
-----BEGIN PGP PUBLIC KEY BLOCK-----

xo0ESX35nAEEALKDCUDVXvmW9n+T/+3G1DnTpoWh9/1xNaz/RrUH6fQKhHr568F8
hfnZP/2CGYVYkW9hxP9LVW9IDvzcmnhgIwK+ddeaPZqh3T/FM4OTA7Q78HSvR81m
Jpf2iMLm/Zvh89ZsmP2sIgZuARiaHo8lxoTSLtmKXsM3FsJVlusyewHfABEBAAHN
H0xhdW5jaHBhZCBQUEEgZm9yIE9uZMWZZWogU3Vyw73CtgQTAQIAIAUCSX35nAIb
AwYLCQgHAwIEFQIIAwQWAgMBAh4BAheAAAoJEE9OoKrlJnpsQjYD/jW1NlIFAlT6
EvF2xfVbkhERii9MapjaUsSso4XLCEmZdEGX54GQ01svXnrivwnd/kmhKvyxCqiN
LDY/dOaK8MK//bDI6mqdKmG8XbP2vsdsxhifNC+GH/OwaDPvn1TyYB653kwyruCG
FjEnCreZTcRUu2oBQyolORDl+BmF4DjL
=LLQh
-----END PGP PUBLIC KEY BLOCK-----

But as we see in your output it says: Redirecting you to Web Security Gateway. and I am sure this is causing the problem! Do you know who is ruinning this web security gateway? Should be on IP 172.27.72.27… It’s within a local subnet IP range and I guess this might be run by your IT Sec department.

Sebastian Roth

@SBrady As well try opening the following URLs in your browser and see what you get:
http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C
and
http://172.27.72.27/cgi-mod/spyportal.cgi?_bcsp=1&_bceq=U2FsdGVkX18hi6qjMcegkUSYaLzTSfe69rtWzlD4NaE8tL17zdWw9k8_P1686yld4UakGgxQrxtLjp2dLNpT2NgVr9-YK-n7omv1WeeS5BnvFVFtvlCHwebvdrVQPnyNWB7iLnzGvpKX-3sBBWkAGePrmHeEey4Xi8wDOHyc-HJfDhJ84SwCgMspNC5e2fFDppMN48MZqKR-K8fIYPOb7vRp2R27lEmAOHircwCYLFAtKEqaPXIGTKCiQB54NRVAF9hS2aIZRMhn9JmZnhrlv3TYX-hNSe4s8fvTdlXc-eDgDsYMNjlHwMKanjNQe9iDIgsmMhtHFCvwuwBKQpPClWjStA81ftJ4okEZz8C7mvxQ5vk1fHoj7dT2Kmk2c2X8NQ4Y5IHXOFD2AnEarGz4J8vZpShH-5m9-a2f9XeSs0HEl38MWVFlEh7HwbV-D8mRjPCAZdXMUQfah31OdUJdA61gUmu6jZ2mEvtWI2BbIJBIypra0f_gZAPaSv6Jy9QPE-dMYcdR6x0yB08VpNKwYTuh86QxVOXFSqUK4dYq-SAbbwM4kCV-qvd708SZH6JRohKglYIdwH9ocrE4XeeTckb8W_ErvP9xDieqjYPqu3H-cqW45gI8GD9DamsMHHaM-mukKH9Nvh_gJ9Wj1_Ulrg…

SBrady

@Sebastian-Roth Thank you for all your help. Based off of what you found in your previous post, it looks like our WebFilter is blocking the connection. I was able to get to these sites because I am an authenticated user but the Ubuntu server is unauthenticated. I changed it to be able to allow the unauthenticated connection and now it is installing with zero issues. Thank you again for your help in finding out what the issue was.

@george1421 Thank you for your help

fry_p

@SBrady I myself have been bitten by web filter issues before on my linux FOG box, so no worries there haha! If you need any additional help or if you run into any other issues, please feel free to open another thread.

Cannot Install Fog on new Ubuntu 16.04 Server

165

11.6k

17.1k

154.6k