Adding needed repository... Failed!

Nexqs · Mar 25, 2018, 4:00 PM

@Sebastian-Roth Im reinstalling ubuntu with english, we will see what happen.
@Tom-Elliott Ill install with those commands that gives me @george1421, is that ok ?

sudo apt-get update && apt-get install git

sudo -i
git clone https://github.com/FOGProject/fogproject.git /opt/fogproject
cd /opt/fogproject/bin
./installfog.sh

george1421 · Mar 25, 2018, 4:54 PM

@nexqs Yes those commands are OK.

I was going to have you check your current time and to ensure your timezone was correct and also see if you can ping keyserver.ubuntu.com which seems to be reported as a problem in your log file, but now we shall see how switching to english works. French should work because I know we have folks in France using FOG. I’m pretty sure its in their native language too.

Nexqs · Mar 26, 2018, 8:37 AM

Hey,
just screenshot timezone and when i pinged keyserver.ubuntu.com :

And now the terminal with all cmds i typed :

root@fogserver:~# sudo apt-get update && apt-get install git
Hit:1 http://nc.archive.ubuntu.com/ubuntu xenial InRelease                  
Get:2 http://nc.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] 
Hit:3 http://security.ubuntu.com/ubuntu xenial-security InRelease             
Get:4 http://nc.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB]
Fetched 204 kB in 22s (9,204 B/s)                       
Reading package lists... Done
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following additional packages will be installed:
  git-man liberror-perl
Suggested packages:
  git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk gitweb git-arch git-cvs
  git-mediawiki git-svn
The following NEW packages will be installed:
  git git-man liberror-perl
0 upgraded, 3 newly installed, 0 to remove and 383 not upgraded.
Need to get 3,857 kB of archives.
After this operation, 25.6 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://nc.archive.ubuntu.com/ubuntu xenial/main amd64 liberror-perl all 0.17-1.2 [19.6 kB]
Get:2 http://nc.archive.ubuntu.com/ubuntu xenial-updates/main amd64 git-man all 1:2.7.4-0ubuntu1.3 [736 kB]
Get:3 http://nc.archive.ubuntu.com/ubuntu xenial-updates/main amd64 git amd64 1:2.7.4-0ubuntu1.3 [3,102 kB]
Fetched 3,857 kB in 30s (127 kB/s)                                                                     
Selecting previously unselected package liberror-perl.
(Reading database ... 175107 files and directories currently installed.)
Preparing to unpack .../liberror-perl_0.17-1.2_all.deb ...
Unpacking liberror-perl (0.17-1.2) ...
Selecting previously unselected package git-man.
Preparing to unpack .../git-man_1%3a2.7.4-0ubuntu1.3_all.deb ...
Unpacking git-man (1:2.7.4-0ubuntu1.3) ...
Selecting previously unselected package git.
Preparing to unpack .../git_1%3a2.7.4-0ubuntu1.3_amd64.deb ...
Unpacking git (1:2.7.4-0ubuntu1.3) ...
Processing triggers for man-db (2.7.5-1) ...
Setting up liberror-perl (0.17-1.2) ...
Setting up git-man (1:2.7.4-0ubuntu1.3) ...
Setting up git (1:2.7.4-0ubuntu1.3) ...
root@fogserver:~# git clone https://github.com/FOGProject/fogproject.git /opt/fogproject
Cloning into '/opt/fogproject'...
remote: Counting objects: 136884, done.
remote: Compressing objects: 100% (533/533), done.
remote: Total 136884 (delta 536), reused 665 (delta 324), pack-reused 135937
Receiving objects: 100% (136884/136884), 730.32 MiB | 106.00 KiB/s, done.
Resolving deltas: 100% (96304/96304), done.
Checking connectivity... done.
root@fogserver:~# cd /opt/fogproject/bin
root@fogserver:/opt/fogproject/bin# ./installfog.sh
Installing LSB_Release as needed
 * Attempting to get release information.......................Done
systemd


   +------------------------------------------+
   |     ..#######:.    ..,#,..     .::##::.  |
   |.:######          .:;####:......;#;..     |
   |...##...        ...##;,;##::::.##...      |
   |   ,#          ...##.....##:::##     ..:: |
   |   ##    .::###,,##.   . ##.::#.:######::.|
   |...##:::###::....#. ..  .#...#. #...#:::. |
   |..:####:..    ..##......##::##  ..  #     |
   |    #  .      ...##:,;##;:::#: ... ##..   |
   |   .#  .       .:;####;::::.##:::;#:..    |
   |    #                     ..:;###..       |
   |                                          |
   +------------------------------------------+
   |      Free Computer Imaging Solution      |
   +------------------------------------------+
   |  Credits: http://fogproject.org/Credits  |
   |       http://fogproject.org/Credits      |
   |       Released under GPL Version 3       |
   +------------------------------------------+


   Version: 1.5.0 Installer/Updater

  What version of Linux would you like to run the installation for?

          1) Redhat Based Linux (Redhat, CentOS, Mageia)
          2) Debian Based Linux (Debian, Ubuntu, Kubuntu, Edubuntu)
          3) Arch Linux

  Choice: [2] 2   



  Starting Debian based Installation


 *** Detected a potential need to reinstall apache and php files.
 *** This will remove the /etc/php* and /etc/apache2* directories
 ***  and remove/purge the apache and php files from this system.
 *** If you're okay with this please type Y, anything else will
 ***  continue the installation, but may mean you will need to
 ***  remove the files later and make proper changes as 
 ***  necessary. (Y/N): 
y
 * Removing apache and php files...............................Done
 * Stopping web services.......................................Failed
 * Removing the apache and php packages........................Done
 * Resetting our variables to specify php version 7.1..........Done
  FOG Server installation modes:
      * Normal Server: (Choice N) 
          This is the typical installation type and
          will install all FOG components for you on this
          machine.  Pick this option if you are unsure what to pick.

      * Storage Node: (Choice S)
          This install mode will only install the software required
          to make this server act as a node in a storage group

  More information:  
     http://www.fogproject.org/wiki/index.php?title=InstallationModes

  What type of installation would you like to do? [N/s (Normal/Storage)] n

  What is the IP address to be used by this FOG Server? [192.168.0.24]

  Would you like to change the default network interface from enp0s3?
  If you are not sure, select No. [y/N] n

  Would you like to setup a router address for the DHCP server? [Y/n] y
  What is the IP address to be used for the router on
      the DHCP server? [192.168.0.1]

  Would you like DHCP to handle DNS? [Y/n] y
  What DNS address should DHCP allow? [127.0.1.1] 

  Would you like to use the FOG server for DHCP service? [y/N] y

  This version of FOG has internationalization support, would  
  you like to install the additional language packs? [y/N] 

   ######################################################################
   #     FOG now has everything it needs for this setup, but please     #
   #   understand that this script will overwrite any setting you may   #
   #   have setup for services like DHCP, apache, pxe, tftp, and NFS.   #
   ######################################################################
   # It is not recommended that you install this on a production system #
   #        as this script modifies many of your system settings.       #
   ######################################################################
   #             This script should be run by the root user.            #
   #      It will prepend the running with sudo if root is not set      #
   ######################################################################
   #           ** Notice ** FOG is difficult to setup securely          #
   #        SELinux and IPTables are usually asked to be disabled       #
   #           There have been strides in adding capabilities           #
   #          The recommendations would now be more appropriate         #
   #    to set SELinux to permissive and to disable firewall for now.   #
   #  You can find some methods to enable SELinux and maintain firewall #
   #   settings and ports. If you feel comfortable doing so please do   #
   ######################################################################
   #            Please see our wiki for more information at:            #
   ######################################################################
   #             https://wiki.fogproject.org/wiki/index.php             #
   ######################################################################

 * Here are the settings FOG will use:
 * Base Linux: Debian
 * Detected Linux Distribution: Ubuntu
 * Server IP Address: 192.168.0.24
 * Server Subnet Mask: 255.255.255.0
 * Interface: enp0s3
 * Installation Type: Normal Server
 * Internationalization: 0
 * Image Storage Location: /images
 * Using FOG DHCP: Yes
 * DHCP router Address: 192.168.0.1


 * Are you sure you wish to continue (Y/N) y

 * Installation Started

 * Installing required packages, if this fails
 | make sure you have an active internet connection.

 * Adding needed repository....................................Failed!
root@fogserver:/opt/fogproject/bin#  cd error_logs/
root@fogserver:/opt/fogproject/bin/error_logs# cat fog
fog_error_1.5.0.log  foginstall.log       
root@fogserver:/opt/fogproject/bin/error_logs# cat fog
fog_error_1.5.0.log  foginstall.log       
root@fogserver:/opt/fogproject/bin/error_logs# cat fog
fog_error_1.5.0.log  foginstall.log       
root@fogserver:/opt/fogproject/bin/error_logs# cat fog
fog_error_1.5.0.log  foginstall.log       
root@fogserver:/opt/fogproject/bin/error_logs# cat fog_error_1.5.0.log 
/usr/bin/lsb_release
/bin/systemctl
Reading package lists...
Building dependency tree...
Reading state information...
software-properties-common is already the newest version (0.96.20.7).
The following additional packages will be installed:
  python-apt python-pycurl
Suggested packages:
  python-apt-dbg python-apt-doc libcurl4-gnutls-dev python-pycurl-dbg
  python-pycurl-doc
The following NEW packages will be installed:
  python-apt python-pycurl python-software-properties
0 upgraded, 3 newly installed, 0 to remove and 383 not upgraded.
Need to get 203 kB of archives.
After this operation, 931 kB of additional disk space will be used.
Get:1 http://nc.archive.ubuntu.com/ubuntu xenial-updates/main amd64 python-apt amd64 1.1.0~beta1ubuntu0.16.04.1 [139 kB]
Get:2 http://nc.archive.ubuntu.com/ubuntu xenial/main amd64 python-pycurl amd64 7.43.0-1ubuntu1 [43.3 kB]
Get:3 http://nc.archive.ubuntu.com/ubuntu xenial-updates/universe amd64 python-software-properties all 0.96.20.7 [20.7 kB]
Fetched 203 kB in 21s (9,474 B/s)
Selecting previously unselected package python-apt.
(Reading database ... 175922 files and directories currently installed.)
Preparing to unpack .../python-apt_1.1.0~beta1ubuntu0.16.04.1_amd64.deb ...
Unpacking python-apt (1.1.0~beta1ubuntu0.16.04.1) ...
Selecting previously unselected package python-pycurl.
Preparing to unpack .../python-pycurl_7.43.0-1ubuntu1_amd64.deb ...
Unpacking python-pycurl (7.43.0-1ubuntu1) ...
Selecting previously unselected package python-software-properties.
Preparing to unpack .../python-software-properties_0.96.20.7_all.deb ...
Unpacking python-software-properties (0.96.20.7) ...
Setting up python-apt (1.1.0~beta1ubuntu0.16.04.1) ...
Setting up python-pycurl (7.43.0-1ubuntu1) ...
Setting up python-software-properties (0.96.20.7) ...
../lib/common/functions.sh: line 535: ntpdate: command not found
gpg: keyring `/tmp/tmphhnywf9g/secring.gpg' created
gpg: keyring `/tmp/tmphhnywf9g/pubring.gpg' created
gpg: requesting key E5267A6C from hkp server keyserver.ubuntu.com
Error: retrieving gpg key timed out.
gpg: /tmp/tmphhnywf9g/trustdb.gpg: trustdb created
gpg: key E5267A6C: public key "Launchpad PPA for Ondřej Surý" imported
gpg: Total number processed: 1
gpg:               imported: 1  (RSA: 1)
OK
gpg: keyring `/tmp/tmpmgndtbo8/secring.gpg' created
gpg: keyring `/tmp/tmpmgndtbo8/pubring.gpg' created
gpg: requesting key E5267A6C from hkp server keyserver.ubuntu.com
Error: retrieving gpg key timed out.
gpg: /tmp/tmpmgndtbo8/trustdb.gpg: trustdb created
gpg: key E5267A6C: public key "Launchpad PPA for Ondřej Surý" imported
gpg: Total number processed: 1
gpg:               imported: 1  (RSA: 1)
OK
Hit:1 http://nc.archive.ubuntu.com/ubuntu xenial InRelease
Get:2 http://nc.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB]
Get:3 http://nc.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB]
Get:4 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB]
Get:5 http://nc.archive.ubuntu.com/ubuntu xenial-updates/main amd64 DEP-11 Metadata [317 kB]
Get:6 http://nc.archive.ubuntu.com/ubuntu xenial-updates/main DEP-11 64x64 Icons [224 kB]
Get:7 http://nc.archive.ubuntu.com/ubuntu xenial-updates/universe amd64 DEP-11 Metadata [193 kB]
Get:8 http://security.ubuntu.com/ubuntu xenial-security/main amd64 DEP-11 Metadata [67.5 kB]
Get:9 http://nc.archive.ubuntu.com/ubuntu xenial-updates/universe DEP-11 64x64 Icons [275 kB]
Get:10 http://nc.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 DEP-11 Metadata [5,888 B]
Get:11 http://nc.archive.ubuntu.com/ubuntu xenial-backports/main amd64 DEP-11 Metadata [3,328 B]
Get:12 http://nc.archive.ubuntu.com/ubuntu xenial-backports/universe amd64 DEP-11 Metadata [5,084 B]
Get:13 http://security.ubuntu.com/ubuntu xenial-security/main DEP-11 64x64 Icons [81.7 kB]
Get:14 http://security.ubuntu.com/ubuntu xenial-security/universe amd64 DEP-11 Metadata [56.0 kB]
Get:15 http://security.ubuntu.com/ubuntu xenial-security/universe DEP-11 64x64 Icons [93.6 kB]
Get:16 http://ppa.launchpad.net/ondrej/apache2/ubuntu xenial InRelease [23.8 kB]
Get:17 http://ppa.launchpad.net/ondrej/php/ubuntu xenial InRelease [23.9 kB]
Get:18 http://ppa.launchpad.net/ondrej/apache2/ubuntu xenial/main amd64 Packages [13.9 kB]
Get:19 http://ppa.launchpad.net/ondrej/apache2/ubuntu xenial/main i386 Packages [14.0 kB]
Get:20 http://ppa.launchpad.net/ondrej/apache2/ubuntu xenial/main Translation-en [7,888 B]
Get:21 http://ppa.launchpad.net/ondrej/php/ubuntu xenial/main amd64 Packages [46.0 kB]
Get:22 http://ppa.launchpad.net/ondrej/php/ubuntu xenial/main i386 Packages [45.8 kB]
Get:23 http://ppa.launchpad.net/ondrej/php/ubuntu xenial/main Translation-en [26.5 kB]
Fetched 1,830 kB in 42s (42.9 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
python-software-properties is already the newest version (0.96.20.7).
The following NEW packages will be installed:
  ntpdate
0 upgraded, 1 newly installed, 0 to remove and 388 not upgraded.
Need to get 48.7 kB of archives.
After this operation, 173 kB of additional disk space will be used.
Get:1 http://nc.archive.ubuntu.com/ubuntu xenial-updates/main amd64 ntpdate amd64 1:4.2.8p4+dfsg-3ubuntu5.8 [48.7 kB]
Fetched 48.7 kB in 20s (2,393 B/s)
Selecting previously unselected package ntpdate.
(Reading database ... 175974 files and directories currently installed.)
Preparing to unpack .../ntpdate_1%3a4.2.8p4+dfsg-3ubuntu5.8_amd64.deb ...
Unpacking ntpdate (1:4.2.8p4+dfsg-3ubuntu5.8) ...
Processing triggers for man-db (2.7.5-1) ...
Setting up ntpdate (1:4.2.8p4+dfsg-3ubuntu5.8) ...
26 Mar 19:32:55 ntpdate[7409]: adjust time server 115.126.160.4 offset -0.003329 sec
Generating locales (this might take a while)...
  en_US.UTF-8... done
Generation complete.
gpg: keyring `/tmp/tmp5udgpevy/secring.gpg' created
gpg: keyring `/tmp/tmp5udgpevy/pubring.gpg' created
gpg: requesting key E5267A6C from hkp server keyserver.ubuntu.com
Error: retrieving gpg key timed out.
gpg: /tmp/tmp5udgpevy/trustdb.gpg: trustdb created
gpg: key E5267A6C: public key "Launchpad PPA for Ondřej Surý" imported
gpg: Total number processed: 1
gpg:               imported: 1  (RSA: 1)
OK
Hit:1 http://security.ubuntu.com/ubuntu xenial-security InRelease
Hit:2 http://nc.archive.ubuntu.com/ubuntu xenial InRelease
Get:3 http://nc.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB]
Get:4 http://nc.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB]
Hit:5 http://ppa.launchpad.net/ondrej/apache2/ubuntu xenial InRelease
Get:6 http://ppa.launchpad.net/ondrej/php/ubuntu xenial InRelease [23.9 kB]
Fetched 228 kB in 36s (6,305 B/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
ntpdate is already the newest version (1:4.2.8p4+dfsg-3ubuntu5.8).
software-properties-common is already the newest version (0.96.20.7).
python-software-properties is already the newest version (0.96.20.7).
0 upgraded, 0 newly installed, 0 to remove and 388 not upgraded.
26 Mar 19:34:50 ntpdate[7814]: adjust time server 115.126.160.4 offset 0.001809 sec
Generating locales (this might take a while)...
  en_US.UTF-8... done
Generation complete.
gpg: keyring `/tmp/tmph13wz5fb/secring.gpg' created
gpg: keyring `/tmp/tmph13wz5fb/pubring.gpg' created
gpg: requesting key E5267A6C from hkp server keyserver.ubuntu.com
Error: retrieving gpg key timed out.
gpg: /tmp/tmph13wz5fb/trustdb.gpg: trustdb created
gpg: key E5267A6C: public key "Launchpad PPA for Ondřej Surý" imported
gpg: Total number processed: 1
gpg:               imported: 1  (RSA: 1)
OK
root@fogserver:/opt/fogproject/bin/error_logs#

Sebastian Roth · Mar 26, 2018, 7:03 PM

@Nexqs Ok, sorry I was wrong. Does not seem to be a language thing as I thought. Would you please do a package capture of this to hopefully find out what’s exactly “timing out”.

For that open two terminal windows. In the first get the following command ready but don’t start it yet: LANG='en_US.UTF-8' LC_ALL='en_US.UTF-8' sudo add-apt-repository -y ppa:ondrej/php

In the other terminal window run: sudo tcpdump -w add-repo.pcap (it will start and not bring you back to the shell - let it sit there, go the the first terminal and run the command. When it’s done stop the tcpdump command using Crtl+c)

Now upload that packet capture file add-repo.pcap to your dropbox and post a link here.

Nexqs · Mar 27, 2018, 6:33 AM

@Sebastian-Roth Ok i did what you tell me to do, here is the file on dropbox here

Sebastian Roth · Mar 27, 2018, 1:48 PM

@Nexqs I have not found out what’s causing the issue but looking at the PCAP. There is a lot of noise from the webbrowser. Should have told you to close that before doing the capture. But I still can get the gist. I see three DNS requests to keyserver.ubuntu.com five seconds (!!!) later followed by a HTTP request to retrieve the key. To me this sounds strange. Why would it do the DNS request that often before initiating the HTTP connection? Did you run the add-apt-repository command only once or did it fail and you can it three times?

What happens of you try to download the key using curl (or wget)?

user@fogserver:~$ curl "http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C"
-----BEGIN PGP PUBLIC KEY BLOCK-----
Version: SKS 1.1.6
Comment: Hostname: keyserver.ubuntu.com

mI0ESX35nAEEALKDCUDVXvmW9n+T/+3G1DnTpoWh9/1xNaz/RrUH6fQKhHr568F8hfnZP/2C
GYVYkW9hxP9LVW9IDvzcmnhgIwK+ddeaPZqh3T/FM4OTA7Q78HSvR81mJpf2iMLm/Zvh89Zs
mP2sIgZuARiaHo8lxoTSLtmKXsM3FsJVlusyewHfABEBAAG0H0xhdW5jaHBhZCBQUEEgZm9y
IE9uZMWZZWogU3Vyw72ItgQTAQIAIAUCSX35nAIbAwYLCQgHAwIEFQIIAwQWAgMBAh4BAheA
AAoJEE9OoKrlJnpsQjYD/jW1NlIFAlT6EvF2xfVbkhERii9MapjaUsSso4XLCEmZdEGX54GQ
01svXnrivwnd/kmhKvyxCqiNLDY/dOaK8MK//bDI6mqdKmG8XbP2vsdsxhifNC+GH/OwaDPv
n1TyYB653kwyruCGFjEnCreZTcRUu2oBQyolORDl+BmF4DjL
=R5tk
-----END PGP PUBLIC KEY BLOCK-----

Should look like this.

Nexqs · Mar 27, 2018, 9:29 PM

@Sebastian-Roth I did once this commands : LANG='en_US.UTF-8' LC_ALL='en_US.UTF-8' sudo add-apt-repository -y ppa:ondrej/php after typing the commands sudo tcpdump -w add-repo.pcap
Soz i let the browser open !
Ill try to get the key via curl as you shown me : curl “http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C”

Sebastian Roth · Mar 28, 2018, 5:02 AM

@nexqs said in Adding needed repository... Failed!:

Ill try to get the key via curl as you shown me

You might need to install curl first, nor sure if it is by default in Ubuntu?!

No worries about the browser… Should have told you.

Nexqs · Mar 28, 2018, 1:05 AM

@Sebastian-Roth I just did the cmd with an wget :

fog@fogserver:~$ wget "http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C"
--2018-03-28 17:56:04--  http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C
Resolving keyserver.ubuntu.com (keyserver.ubuntu.com)... 91.189.90.55, 91.189.89.49
Connecting to keyserver.ubuntu.com (keyserver.ubuntu.com)|91.189.90.55|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 626 [application/pgp-keys]
Saving to: ‘lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C’

lookup?op=get&optio 100%[===================>]     626  --.-KB/s    in 0s      

2018-03-28 17:56:20 (43.4 MB/s) - ‘lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C’ saved [626/626]

fog@fogserver:~$

Sebastian Roth · Aug 6, 2019, 11:52 AM

@Nexqs Hope you don’t feel annoyed by all the questions and stuff I make you try out. Could you please run wget "http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C" ; cat "lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C" just to make sure you get the same key downloaded that I had.

I will setup an Ubuntu VM and try things out as well. I am sure we can figure this out. I still have a feeling that this might be some kind of network issue on your side. Not sure though.

Sebastian Roth · Mar 29, 2018, 8:49 AM

@Nexqs Ok, I got up a test VM and did some testing. It works great on my side. Taking a packet dump on my machine I noticed that two DNS requests to launchpad.net seem to be part of the add-apt-repository call. I see those in your PCAP as well (after I filtered through all the other stuff more thoroughly). Now the interesting thing I notice is that the requests from your machine seem to take some time. We are talking milliseconds here but having looked into many packet dumps I clearly notice this as a possible pointer for explaining what’s wrong. While requests in my case come three milliseconds after the other yours seem to take 400 ms at times - which is hell of a lot even in networks. It could trigger some unexpected behavior. It’s not always like this but I do see this and wonder what’s wrong. As you capture right on the server to me it would simply translate to a high load on the server. Is there other (network/calculation) “stuff” happening at the same time? Is this running on a physical server or within some kind of VM environment?

What else do I see. It takes five (!!!) seconds before it sends the initiating TCP SYN packet to start the HTTP connection after it got the DNS answer. Something is definitely wrong here. From what I see in the PCAP it’s not the network but the host itself. Please run cat /proc/loadavg and post results here.

Nexqs · Mar 29, 2018, 9:15 AM

@sebastian-roth SO if i understand everything, its my internet connection that is slow ?

fog@fogserver:~$ cat /proc/loadavg
0.23 0.50 0.25 4/392 2005
fog@fogserver:~$ 
fog@fogserver:~$ wget “http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C” 
[1] 2019
[2] 2020
fog@fogserver:~$ “http://keyserver.ubuntu.com/pks/lookup?op=get: Scheme missing.

[1]-  Exit 1                  wget “http://keyserver.ubuntu.com/pks/lookup?op=get
[2]+  Done                    options=mr
fog@fogserver:~$ cat “lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C”
[1] 2021
[2] 2022
fog@fogserver:~$ cat: '“lookup?op=get': No such file or directory

Sebastian Roth · Mar 29, 2018, 2:16 PM

@Nexqs No from the PCAP it looks like your server is slow! Is FOG installed on hardware or in a virtual machine?

Sorry for the command hickup. It did not mask the stuff as command when I posted it and that broke it when you copy & pasted it. Please try again with this:

wget -O key.txt "http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C"
cat key.txt

Nexqs · Apr 1, 2018, 3:42 AM

@Sebastian-Roth Ubuntu is installed on a VM (with 3 Go ramfor the vm : i have 8go on my laptop, an ssd and i3). It did the same thing with my VM on my desktop (i7, 6go ram for the vm and 16go in total and a ssd).
Here is the key :

fog@fogserver:~$ wget -O key.txt "http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C"
--2018-04-01 14:41:46--  http://keyserver.ubuntu.com/pks/lookup?op=get&options=mr&search=0x14AA40EC0831756756D7F66C4F4EA0AAE5267A6C
Resolving keyserver.ubuntu.com (keyserver.ubuntu.com)... 91.189.90.55, 91.189.89.49
Connecting to keyserver.ubuntu.com (keyserver.ubuntu.com)|91.189.90.55|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 626 [application/pgp-keys]
Saving to: ‘key.txt’

key.txt             100%[===================>]     626  --.-KB/s    in 0s      

2018-04-01 14:42:02 (39.4 MB/s) - ‘key.txt’ saved [626/626]

fog@fogserver:~$ cat key.txt
-----BEGIN PGP PUBLIC KEY BLOCK-----
Version: SKS 1.1.6
Comment: Hostname: keyserver.ubuntu.com

mI0ESX35nAEEALKDCUDVXvmW9n+T/+3G1DnTpoWh9/1xNaz/RrUH6fQKhHr568F8hfnZP/2C
GYVYkW9hxP9LVW9IDvzcmnhgIwK+ddeaPZqh3T/FM4OTA7Q78HSvR81mJpf2iMLm/Zvh89Zs
mP2sIgZuARiaHo8lxoTSLtmKXsM3FsJVlusyewHfABEBAAG0H0xhdW5jaHBhZCBQUEEgZm9y
IE9uZMWZZWogU3Vyw72ItgQTAQIAIAUCSX35nAIbAwYLCQgHAwIEFQIIAwQWAgMBAh4BAheA
AAoJEE9OoKrlJnpsQjYD/jW1NlIFAlT6EvF2xfVbkhERii9MapjaUsSso4XLCEmZdEGX54GQ
01svXnrivwnd/kmhKvyxCqiNLDY/dOaK8MK//bDI6mqdKmG8XbP2vsdsxhifNC+GH/OwaDPv
n1TyYB653kwyruCGFjEnCreZTcRUu2oBQyolORDl+BmF4DjL
=R5tk
-----END PGP PUBLIC KEY BLOCK-----
fog@fogserver:~$

Sebastian Roth · Apr 2, 2018, 7:22 PM

@Nexqs I am at a loss here. This seems to be such a strange issue. I have seen a lot of crazy things happen but this one I can’t get my head around. Why would apt-add-repository tell us “timed out” if it comes back adding the key anyway.

Are you keen to just modify the installer script to skip the check and go on? We can give you instructions on how to do this.

Nexqs · Apr 3, 2018, 9:13 PM

@Sebastian-Roth Yes sure ! strange issue …

Sebastian Roth · Apr 6, 2018, 6:32 AM

@Nexqs Sorry for my late reply. Please try this: Edit /opt/fogproject/lib/common/functions.sh, jump to line 623 and add a hash tag as comment at the beginning to disable, make it look like this:

...
            esac
            ;;
    esac
    #errorStat $?
    dots "Preparing Package Manager"
...

Now rerun the installer as usual.

Arrowtron · Apr 12, 2018, 1:58 AM

Hi there,

I am getting the same issue as well, please assist

Currently running FOG 1.5.0, trying to upgrade to 1.5.2 through PUTTY

I am not running through a Proxy, i have upgraded to 1.5.0 a few weeks ago i think

Arrowtron · Apr 12, 2018, 2:58 AM

@arrowtron

Update:

@Sebastian-Roth Post about editing \root\fogproject\lib\common\functions.sh has fixed the issue

Thanks!

benc · Mar 13, 2019, 8:31 PM

I just ran into this issue:

 * Adding needed repository....................................Failed!

Fresh install of Ubuntu server 18.04 LTS using network installer on an old IBM X3650 server. The only software I selected to install during Ubuntu setup was the SSH server. Downloaded and extracted the tarball from https://github.com/FOGProject/fogproject/archive/1.5.5.tar.gz. Could not get past the error until I ran this:

sudo apt-get install software-properties-common

It looks like the FOG install script expected that package to already be installed. Hope this helps someone.

Ben

Adding needed repository... Failed!

202

12.1k

17.3k

155.3k