Posts made by kortnor

Thank you for all you answers,

we are running the os on USB 3 which gives us really good results. The nuc only have 1 sata connector and there is no micro-sd connector neither.
Because I’ve to attend a summit, I wont be able to make some test before friday ( regarding what @Tom Elliot is asking) .

The ultimate aim is that my colleague can restage this micro-cluster whenever they want and check what are the real impact on on the OS layer when you’re working with new hadoop version ( e.g. we have face huge dependencies issue between centos 6.6 and centos 6.7 which was a pain in the ass to resolve it I don’t even one to mention centos 7).

Best,

Hello George,

I’m currently working on a micro-cluster composed by:

• 6 NUC ( i5)
  • 16 gigs
  • os stored on USB 3.0 ( with cento 6.6)
  • external HDD high capacity for data storage / crunching

I arrived to capture and deploy the OS throught fog, BUT if I don’t schedule any task, the client won’t normally start because he gave me the error hard disk error. I’ve tried all he possible legacy bios option and it was not possible to boot the client if the fog server is up and running.
So, I created a custome menu based on received feedback on the forum. but I was not able to put this option has the default one. This option force to boot on the usb
Now yesterday evening I’ve been able to find a patch work by modifying the fog.local (fog configuration --> fog.local --> parameter: chain -ar http://<ip>/fog/service/ipxe/grub.exe --config-file=“rootnoverify (hd1);map (hd1) (hd0);chainloader (hd1)+1 --default” || MENU )
Now its quite ugly what I’ve done. I would like to force this menu for some host but not for all of them.
By the way i’m on fog 1.2.0 6721.

NUC bios:

• Legacy boot
  • lan
  • usb
  • sata
  • legacy pxe
    I took out all the other options related to the boot like fast boot, pxe at last and co
    However, I can’t user the EFI boot because when I select it, no choice is provided to me.

Best,

hello everybody,

I’m currently stuck with my long quest which is using fog with client where the os are on usb stick

On a normal bios( laptop) there is no problem

on NUC, i’ve used the trick from :Roth
But the host will not have any screen nor other i/o plugged ( except hdd and usb)
not I would like to make a customized fog as default in the pxe menu. Actually, my opton Boot from USB key is the last one it need to be auto select

In advance thank you for your answer

Add a new iPXE menu entry (web gui -> FOG configuration -> iPXE New Menu Entry):

Menu Item: fog.bootusb
Description: Boot from USB key
Parameters: chain -ar http://${fog-ip}/${fog-webroot}/service/ipxe/grub.exe --config-file="rootnoverify (hd1);map (hd1) (hd0);chainloader (hd1)+1" || MENU
Default Item: YES (if you want that)
Menu Show With: All Hosts

@Sebastian-Roth
this is quite a challenge ahaha I don’t have enough knowledge in lvm management but I can take a look at it definitely

Anyway thank you for your time and effort.

@Sebastian-Roth hereunder the requested extraction
I suppose that my issue is coming from the fact that my /dev/sdc2 is configured has a lvm_2_member.
EDIT: after It will be applied on usb stick pf 128 gb which is a lot to store on a VM afterward

[root@laptop pla]# sfdisk -d /dev/sdc
label: dos
label-id: 0xf156c07c
device: /dev/sdc
unit: sectors

/dev/sdc1 : start=        2048, size=     1024000, type=83, bootable
/dev/sdc2 : start=     1026048, size=    30240768, type=8e
[root@laptop pla]# blkid -po udev /dev/sdc1 | grep FS_TYPE
ID_FS_TYPE=ext4
[root@laptop pla]# blkid -po udev /dev/sdc2 | grep FS_TYPE
ID_FS_TYPE=LVM2_member
[root@laptop pla]# 
[root@laptop pla]# df -h
Filesystem               Size  Used Avail Use% Mounted on
devtmpfs                 5.8G     0  5.8G   0% /dev
tmpfs                    5.8G  420K  5.8G   1% /dev/shm
tmpfs                    5.8G  1.6M  5.8G   1% /run
tmpfs                    5.8G     0  5.8G   0% /sys/fs/cgroup
/dev/mapper/fedora-root   13G  3.8G  8.2G  32% /
tmpfs                    5.8G   84K  5.8G   1% /tmp
/dev/sdc1                477M  108M  340M  25% /boot
tmpfs                    1.2G  8.0K  1.2G   1% /run/user/42
tmpfs                    1.2G   24K  1.2G   1% /run/user/1000
/dev/sdd1                932G  897G   36G  97% /run/media/pla/Elements```

@Sebastian-Roth

So I’ve been able to capture the usb stick by following your instruction:

• Specify the host primary disk on the host manager ==> I simply added the /dev/sdc
• Also choose to GRUB_FURST_HDD to hostbios exist. Which allowed the client to boot the the usb stick if no task were scheduled.

I still need to create a postdownload script but it seems to be manageable.

Now I’ve another question. How can I reduce the image size that has been captured. the images saved has the size of the whole usb stick ( 16 gigs). Should I change the image type? I’ve actually chosen Multiple partition image- Single disk (2)
edit: on the client side, I can see tat the / partition is 13 gigs and there is actually 4 gigs used, however, the image stored on the fog server is 10gigs

@Sebastian-Roth
Due to the recent event in Brussel, I’vent had the time to try anything.
I’ll take the time this weekend to apply your suggestion I’ll keep you posted.

the thing is that I don’t want to disconnect the HDD because it would mean that I would have to open the “box” which I don’t want to at the end

Hi

I’m on my second stage of my internal project and I’ve a question for you guys.
I’ve a fog server version 6721 running on a vm centos 7 and I’m trying to make a images for a micro -cluster http://bigboards.io/
each node is an Intel NUC and the OS is installed on an USB stick. There is also a HDDof 1 TB but this one is only used for data storage nothing else.
I can register each nodes either trough the fog ui or through the pxe interface with full registration.

My questions are the following:

• When I capture the host, will fog make a copy of the USB stick or only the HDD?
  ** It seems that the captue only target the HDD however, I only need to capture the USB stick and not the HDD.
  ** in image management, I use single disk resizable.

• After the host are register on the fog and if the node starts to boot on pxe, I notice that it is impossible to tell the nodes to start on the usb stick?
  ** if the dhcp server is stopped , the node start correctly 1st pxe dchp check , 2 boot on usb stick.

• after creating an images ( after capture) is it there a possibility to configure the NIC on a static mode? or should I first let my dhcp providing an IP address to the node, then connect to the node and and change it manually?

The ultimate goal is to not open my cluster anymore and push my images on the usb stick bccause , for the moment, I do need to open each node and take out the usb stick and configure it.

In advance thank you for your answers.

Best,

@Sebastian-Roth
that’s really interresting, I’ll create a fresh new vm ( aside the my running one, ) and try what’s you’re proposing, I should do that for thursday evening

In the meantime, I need to learn how to fine tune the images because at the end I would like to apply it on a cluser created with 6 intel nuc.
On each nuc, I’ll push my images but after every nuc needs to be configurer with a static ip ( for sure different for everyone )

@Sebastian-Roth
i’m using the following package

[root@fog ~]# rpm -qa | grep -e mysql -e mariadb
mysql-5.5.48-1.el6.remi.x86_64
mysql-libs-5.5.48-1.el6.remi.x86_64
php-mysqlnd-7.0.4-1.el7.remi.x86_64
mysql-server-5.5.48-1.el6.remi.x86_64

But i can’t use mariadb also and that’s a major threat for me:
everytime I restart my server host, I need to create the /var/run/mysqld /; touch /var/run/mysqld.pid ; chown -R mysql:mysql /var/run/mysqld
otherwise mysql won’t start

@Sebastian-Roth
hereunder the result of the requested command line

[root@fog ~]# yum --enablerepo=remi list mysql
Loaded plugins: fastestmirror, replace
Loading mirror speeds from cached hostfile
 * base: ftp.belnet.be
 * epel: ftp.nluug.nl
 * extras: miroir.univ-paris13.fr
 * remi: mirror5.layerjet.com
 * remi-php70: mirror5.layerjet.com
 * remi-safe: mirror5.layerjet.com
 * rpmforge: ftp.nluug.nl
 * updates: miroir.univ-paris13.fr
Installed Packages
mysql.x86_64                                   5.5.48-1.el6.remi                                    @remi
[root@fog ~]# yum --enablerepo=remi list mariadb
Loaded plugins: fastestmirror, replace
Loading mirror speeds from cached hostfile
 * base: ftp.belnet.be
 * epel: ftp.nluug.nl
 * extras: miroir.univ-paris13.fr
 * remi: mirror5.layerjet.com
 * remi-php70: mirror5.layerjet.com
 * remi-safe: mirror5.layerjet.com
 * rpmforge: ftp.nluug.nl
 * updates: miroir.univ-paris13.fr
Available Packages
mariadb.x86_64                                 1:5.5.44-2.el7.centos                                 base

@Tom-Elliott
also, After deleting the whole opt/fog directory I suppose the install script reacts like it will be a new installation ==> so creating the folder again.

Now what I’ve done is:

• yum remove mariadb*
• check 2 time if there is no mysql pkg wih ==> yum list installed | grep mysql

make a new installation again.

Now I arrived to the fog webui

for your info the script has installed the following mysql package
mysql.x86_64 5.5.48-1.el6.remi @remi
mysql-libs.x86_64 5.5.48-1.el6.remi @remi
mysql-server.x86_64 5.5.48-1.el6.remi @remi

now, because mysql is replaced by mariadb , will there be any changed applied to the script when its run to centos 7 or rhel 7 ?

Best,

@Sebastian-Roth
I tried that also
Cleaning setup

• delete /etc/httpd/conf.d/fog
• rm -rf /var/www/html/fog
• rm -rf /opt/fog/
• fully delete mysql (lke explained before)

restart install

• cd /opt/fogGit/
• git pull
• cd bin
• ./installfog.sh

I don’ think I’m missing something.

@Tom-Elliott
I’ve noticed ( at least on a fresh installation ) that when I install centos 7 minimal on a vm (virtual box ) that when I restart the vm and I restart the mysqld daemon that he indicates me the mysqld.pid can’t be created because there is not mysqld folder in /var/run

now i’ve tried to clean the actual centos 7 from mysql meaning by that a yum remove mysql mysql-* and also delete the /var/lib/mysql
Then Ive installed mariadb ( mariadb-server mariadb-libs mariadb) with yum and configured with :

after I try a reinstallation of the trunk ( before I make a git pull in order to be sure I’m on the last version ) then I receive the following error

I would like to know also, if the script detect the specific version of centos family or does he embed it in redhat ( Base linux: Red Hat )

 * Here are the settings FOG will use:
 * Base Linux: Redhat
 * Detected Linux Distribution: CentOS Linux
 * Server IP Address: 10.10.0.15
 * Server Subnet Mask: 255.255.255.0
 * Interface: eth0
 * Installation Type: Normal Server
 * Donate: 0
 * Internationalization: 0
 * Image Storage Location: /images
 * Using FOG DHCP: Yes
 * DHCP router Address: 10.10.0.100
 * DHCP DNS Address: 10.10.0.254


 * Are you sure you wish to continue (Y/N) Y

 * Installation Started

 * Installing required packages, if this fails
 | make sure you have an active internet connection.

 * Adding needed repository....................................OK
 * Preparing Package Manager...................................OK
 * Packages to be installed:

	httpd php php-cli php-common php-gd mysql mysql-server dhcp tftp-server nfs-utils vsftpd net-tools wget xinetd tar gzip make m4 gcc gcc-c++ lftp php-mysqlnd curl php-mcrypt php-mbstring mod_ssl php-fpm php-process


 * Skipping package: httpd.....................................(Already Installed)
 * Skipping package: php.......................................(Already Installed)
 * Skipping package: php-cli...................................(Already Installed)
 * Skipping package: php-common................................(Already Installed)
 * Skipping package: php-gd....................................(Already Installed)
 * Installing package: mysql...................................Failed!

log within the error_xxx.log which indicates the script still try to install mysql in place of using the mariadb.

ransaction Summary
================================================================================
Install  1 Package (+1 Dependent package)

Total download size: 6.5 M
Installed size: 33 M
Downloading packages:
--------------------------------------------------------------------------------
Total                                              202 kB/s | 6.5 MB  00:33
Running transaction check
Running transaction test


Transaction check error:
  file /etc/my.cnf from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/lib64/mysql/libmysqlclient.so.18.0.0 from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/czech/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/danish/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/dutch/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/english/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/estonian/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/french/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/german/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/greek/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/hungarian/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/italian/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/japanese/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/korean/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/norwegian-ny/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/norwegian/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/polish/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/portuguese/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/romanian/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/russian/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/serbian/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/slovak/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/spanish/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/swedish/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64
  file /usr/share/mysql/ukrainian/errmsg.sys from install of mysql-libs-5.5.48-1.el6.remi.x86_64 conflicts with file from package mariadb-libs-1:5.5.44-2.el7.centos.x86_64

I’m wondering if the cause isn’t that now centos 7 has also passed to mariadb and fog should target the mariadb and mariadb-server package
Am I right?

Also with mysql 5.4 on centos 7, everytime you restarting your host, the folder /var/run/mysqld and the file /var/run/mysqld/mysqld.pid are disapearing

@Tom-Elliott

ok, then where can I find this information? or better is the mysql procedure handeled with the root user or with the fog user? like fog is creating the stuff on it

also I don’t see anything strange in the mysqld.log neither in the foginstall.log

EDIT

indeed there is another error

[Mon Mar 14 23:00:08.367265 2016] [:error] [pid 5160] [client 10.10.0.2:50430] PHP Warning:  mysqli::real_connect(): MySQL server has gone away in /var/www/html/fog/lib/db/mysql.class.php on line 30

EDIT 2:
WHen I restart the install
the script fails on backing up database
however there are no database fog in mysql ( show databases )

@Tom-Elliott
hm good question hereunder the print out of the installation

 * Configuring services

 * Setting up fog user.........................................Already setup
 * Setting up fog password.....................................OK
 * Stopping FOGMulticastManager.service Service................OK
 * Stopping FOGImageReplicator.service Service.................OK
 * Stopping FOGSnapinReplicator.service Service................OK
 * Stopping FOGScheduler.service Service.......................OK
 * Stopping FOGPingHosts.service Service.......................OK
 * Setting up and starting MySQL...............................OK
 * Backing up user reports.....................................OK
 * Stopping web service........................................OK
 * Removing vhost file.........................................OK
 * Is the MySQL password blank? (Y/n) Y
 * Setting up Apache and PHP files.............................OK
 * Testing and removing symbolic links if found................OK
 * Backing up old data.........................................OK
 * Copying new files to web folder.............................OK
 * Creating config file........................................OK
 * Getting checksum files for kernels and inits................OK
 * Downloading inits, kernels, and the fog client..............OK
 * Comparing checksums of kernels and inits....................Done
 * Enabling apache and fpm services on boot....................OK
 * Creating SSL CA.............................................OK
 * Creating SSL Private Key....................................OK
 * Creating SSL Certificate....................................OK
 * Creating auth pub key and cert..............................OK
 * Resetting SSL Permissions...................................OK
 * Setting up SSL FOG Server...................................OK
 * Restarting Apache2 for fog vhost............................OK
 * Changing permissions on apache log files....................OK
 * Backing up database.........................................OK

EDIT I check on mysql and i can connect with root without any password and here is no fog databases in it

Dear all,

I’m making a fresh install based on https://wiki.fogproject.org/wiki/index.php?title=CentOS_7 on fog trunk

os: centos 7
php verson : 7
I try to set up the last version on the git --> git pull last version
What other information you need ?

Step during the installation:

 * You still need to install/update your database schema.
 * This can be done by opening a web browser and going to:

   http://10.10.0.15/fog/management

 * Press [Enter] key when database is updated/installed.

I go to the following webpage with firefox http://10.10.0.15/fog/management/?node=schemaupdater

error encountered during the installation in /var/log/httpd/error_log:

[Mon Mar 14 22:19:28.092636 2016] [:error] [pid 9074] [client 10.10.0.2:49366] PHP Fatal error:  Uncaught Exception: DateTimeZone::__construct(): Unknown or bad timezone () in /var/www/html/fog/lib/fog/fogbase.class.php:65\nStack trace:
\n#0 internal function]: DateTimeZone->__construct('')
\n#1 /var/www/html/fog/lib/fog/fogbase.class.php(65): ReflectionClass->newInstanceArgs(Array)
\n#2 /var/www/html/fog/lib/fog/fogbase.class.php(233): FOGBase->getClass('DateTimeZone', '')
\n#3 /var/www/html/fog/lib/fog/fogbase.class.php(469): FOGBase->nice_date()
\n#4 /var/www/html/fog/lib/fog/eventmanager.class.php(28): FOGBase->log('Method does not...', 0)
\n#5 /var/www/html/fog/lib/plugins/location/hooks/changeitems.hook.php(58): EventManager->register('HOST_EDIT_AFTER...', Array)
\n#6 [internal function]: unknown()
\n#7 /var/www/html/fog/commons/init.php(138): spl_autoload('changeitems')
\n#8 [internal function]: Initiator->FOGLoader('changeitems')
\n#9 [internal function]: spl_autoload_call('changeitems')
\n#10 /var/www/html/fog/lib/fog/fogbase.class.php(63): ReflectionClass->__construct('changeitems')
\n#11 /var/www/html/fog/lib/fog/eve in /var/www/html/fog/lib/fog/fogbase.class.php on line 65

@Sebastian-Roth
first, thank you Sebastian for your time
I’ve completly alligned the password everywere I guess related to the fog user.
However I still have the same issue at the end. Can somebody tell me if I’ve missed a paramater? also, I can from a distant client make a ftp connection and connect the the fog server and put get and co ( epxlained in reply earlier in this topic)
I’m kind of lost

OS layer
[root@localhost ~]# echo “fog:password” | chpasswd

user management

tftp server

storage management

error from client VM