FOG 1.3.5 RC 11
-
I have a problem and don’t know if it is an error especially of 1.3.5 RC’s.
Capturing an image of Windows 10 with single partition resizable results in fog taking an resized image of boot partition. The system partition is 12 GB in size and fog displays it resizable with 9 GB. But it records only 1.2 GB of it and partclone says 1.2 GB would be 100 %. The error occured in RC 10 and 11. I use Hyper-V with dynamical vhd’s for testing. Multiple partitions ran fine.
If not excuse me. A solution would be really nice.
-
@david77 Can you please clarify?
Partclone is showing 1.2GB and capturing that much, or are you refering to the actual size on the server?
Is there a problem with the image after capturing? I’m still trying to workout what’s causing some of the resize issues, but I can’t tell, from your message here, if you’re just asking if an image size of 1.2GB is okay, or if there’s actually some issue with capturing and deploying the image.
The boot partitions, under current init’s no longer “resize” init’s by detecting if they’re “System_Reserved” or “Recovery” types, which most windows systems are. if the image was captured prior to this, this is likely the problem even on deploys.
Sorry if I seem to be missing something here, just really need some clarity.
-
@Tom-Elliott Hi,
the Partition size of Windows 10 has 12 GB of data. partclone only clones 1.2 GB. I doesn’t stop at 10 %. It says the Partition only has 1.2 GB.
Before partclone shows up there is the information with testing Partition resizing. That Information is correct with the System partition. But the text says that the boot partition test says that the boot partition could be resized to 380264 k. You said the boot Partition would not bet resized. The text implies something other.
If you want i can upload 2 sreenshots which show the problem.
David
-
@david77 you’re not on RC 11
-
Im running FOG 1.3.5 RC11 - but I got the exact same problem as described by david77.
When I’m trying to image a Windows 10 drive the resizing etc all goes well. Eventually Partclone will image the first (500 Mb.) SYSTEM RESERVED partition and recognizes it as a NTFS partition. The second partition (the normal
drive) is not properly recognized as NTFS - the file system is set to raw as shown in the screenshot of david77.I’m not sure what is happening exactly, but I do know the File system: raw is not correct, this should be NTFS. the Device Size is not correct too, the partition should be a lot bigger.
-
@Tom-Elliott I am. I took the screenshots on RC10 at work. The same error occured on RC11 too, which i a tested at home.
-
Just to exclude that the problem isn’t on my drive I’ve tried imaging with "Multiple Partition Image - Single Disk (Not Resizable) and the second partition (the normal
drive) is properly recognized as NTFS.I assume something is going wrong with the resize-process, resulting in Partclone not recognizing the 2nd partition properly. As a result it does not recognize the filesystem (should be NTFS, but is set to “raw”) and also does not recognize the size properly (my partition could be resized to roughly 20 Gb, after resize it is a 1.2 Gb. raw)
-
Have you, by chance, updated this morning?
Would you mind giving it a shot?
I added in a few last minute changes late last night as I found some other mathing errors.
I can tell you all, i’m not trying to draw this issue out any longer than necessary, I’m trying to perfect the resize process in whole. Why I can’t replicate as simply as some of you guys seem to be able to is beyond me.
Maybe somebody here has some formula’s to share about disk geometry, overlap protection, and overall minimizing->expanding assistance that might prove useful here?
-
SERVER
FOG Version: 1.3.5-RC-11
OS: Debian 8.7CLIENT
OS: Windows 10I am experiencing the same trouble while capturing my image
-
@URfog When did you update last?
-
root@fog-vm:~/fogproject# git pull
Already up-to-date.I updated about an hour (or two) ago and I still got the problem.
-
@fogschut Please rerun the installer. Git pull will not work in this instance. re-running the installer will download whatever the latest init’s are.
I just pushed a testing version using a very old version of the script that handles resizing modified slightly to adjust for some of the changes in the variables being passed in.
-
I did run a git pull followed by running the install-script (installfog.sh) and the problem is not fixed.
I still get a raw partition as 2nd partition and the uploaded image on the server is way too small to contain all the data on the server.
-
@fogschut When did you try? After I posted my message and before you posted yours?
Just need clarity. Not even 20 minutes ago a new init was uploaded Information will help me help find the problem, or at the least narrow it down.
-
immediately after your message. I’m working on another image on another PC at the moment so I can test immediately
-
Just to take away any confusion:
root@fog-vm:~/fogproject# date di mrt 7 16:19:11 CET 2017 root@fog-vm:~/fogproject# git checkout dev-branch Already on 'dev-branch' Your branch is up-to-date with 'origin/dev-branch'. root@fog-vm:~/fogproject# git pull Already up-to-date. root@fog-vm:~/fogproject# cd bin root@fog-vm:~/fogproject/bin# ./installfog.sh Installing LSB_Release as needed * Attempting to get release information.......................Done +------------------------------------------+ | ..#######:. ..,#,.. .::##::. | |.:###### .:;####:......;#;.. | |...##... ...##;,;##::::.##... | | ,# ...##.....##:::## ..:: | | ## .::###,,##. . ##.::#.:######::.| |...##:::###::....#. .. .#...#. #...#:::. | |..:####:.. ..##......##::## .. # | | # . ...##:,;##;:::#: ... ##.. | | .# . .:;####;::::.##:::;#:.. | | # ..:;###.. | | | +------------------------------------------+ | Free Computer Imaging Solution | +------------------------------------------+ | Credits: http://fogproject.org/Credits | | http://fogproject.org/Credits | | Released under GPL Version 3 | +------------------------------------------+ Version: 1.3.5-RC-11 Installer/Updater * Found FOG Settings from previous install at: /opt/fog/.fogsettings * Performing upgrade using these settings Starting Debian based Installation ###################################################################### # FOG now has everything it needs for this setup, but please # # understand that this script will overwrite any setting you may # # have setup for services like DHCP, apache, pxe, tftp, and NFS. # ###################################################################### # It is not recommended that you install this on a production system # # as this script modifies many of your system settings. # ###################################################################### # This script should be run by the root user. # # It will prepend the running with sudo if root is not set # ###################################################################### # ** Notice ** FOG is difficult to setup securely # # SELinux and IPTables are usually asked to be disabled # # There have been strides in adding capabilities # # The recommendations would now be more appropriate # # to set SELinux to permissive and to disable firewall for now. # # You can find some methods to enable SELinux and maintain firewall # # settings and ports. If you feel comfortable doing so please do # ###################################################################### # Please see our wiki for more information at: # ###################################################################### # https://wiki.fogproject.org/wiki/index.php # ###################################################################### * Here are the settings FOG will use: * Base Linux: Debian * Detected Linux Distribution: Ubuntu * Server IP Address: 10.195.0.65 * Server Subnet Mask: * Interface: eth0 * Installation Type: Normal Server * Donate: 0 * Internationalization: * Image Storage Location: /images * Using FOG DHCP: No * DHCP will NOT be setup but you must setup your | current DHCP server to use FOG for PXE services. * On a Linux DHCP server you must set: next-server and filename * On a Windows DHCP server you must set options 066 and 067 * Option 066/next-server is the IP of the FOG Server: (e.g. 10.195.0.65) * Option 067/filename is the bootfile: (e.g. undionly.kpxe) * Are you sure you wish to continue (Y/N) Y * Installation Started * Installing required packages, if this fails | make sure you have an active internet connection. * Adding needed repository....................................OK * Preparing Package Manager...................................OK * Packages to be installed: apache2 bc build-essential cpp curl g++ gawk gcc gzip htmldoc lftp libapache2-mod-php7.1 libc6 libcurl3 m4 mysql-client mysql-server net-tools nfs-kernel-serv er openssh-server php7.1 php7.1-bcmath php7.1-cli php7.1-curl php7.1-fpm php7.1-gd php7.1-json php7.1-ldap php7.1-mbstring php7.1-mcrypt php7.1-mysql php-gettext sysv -rc-conf tar tftpd-hpa tftp-hpa unzip vsftpd wget xinetd zlib1g * Skipping package: apache2...................................(Already Installed) * Skipping package: bc........................................(Already Installed) * Skipping package: build-essential...........................(Already Installed) * Skipping package: cpp.......................................(Already Installed) * Skipping package: curl......................................(Already Installed) * Skipping package: g++.......................................(Already Installed) * Skipping package: gawk......................................(Already Installed) * Skipping package: gcc.......................................(Already Installed) * Skipping package: gzip......................................(Already Installed) * Skipping package: htmldoc...................................(Already Installed) * Skipping package: lftp......................................(Already Installed) * Skipping package: libapache2-mod-php7.1.....................(Already Installed) * Skipping package: libc6.....................................(Already Installed) * Skipping package: libcurl3..................................(Already Installed) * Skipping package: m4........................................(Already Installed) * Skipping package: mysql-client..............................(Already Installed) * Skipping package: mysql-server..............................(Already Installed) * Skipping package: net-tools.................................(Already Installed) * Skipping package: nfs-kernel-server.........................(Already Installed) * Skipping package: openssh-server............................(Already Installed) * Skipping package: php7.1....................................(Already Installed) * Skipping package: php7.1-bcmath.............................(Already Installed) * Skipping package: php7.1-cli................................(Already Installed) * Skipping package: php7.1-curl...............................(Already Installed) * Skipping package: php7.1-fpm................................(Already Installed) * Skipping package: php7.1-gd.................................(Already Installed) * Skipping package: php7.1-json...............................(Already Installed) * Skipping package: php7.1-ldap...............................(Already Installed) * Skipping package: php7.1-mbstring...........................(Already Installed) * Skipping package: php7.1-mcrypt.............................(Already Installed) * Skipping package: php7.1-mysql..............................(Already Installed) * Skipping package: php-gettext...............................(Already Installed) * Skipping package: sysv-rc-conf..............................(Already Installed) * Skipping package: tar.......................................(Already Installed) * Skipping package: tftpd-hpa.................................(Already Installed) * Skipping package: tftp-hpa..................................(Already Installed) * Skipping package: unzip.....................................(Already Installed) * Skipping package: vsftpd....................................(Already Installed) * Skipping package: wget......................................(Already Installed) * Skipping package: xinetd....................................(Already Installed) * Skipping package: zlib1g....................................(Already Installed) * Updating packages as needed.................................OK * Confirming package installation * Checking package: apache2...................................OK * Checking package: bc........................................OK * Checking package: build-essential...........................OK * Checking package: cpp.......................................OK * Checking package: curl......................................OK * Checking package: g++.......................................OK * Checking package: gawk......................................OK * Checking package: gcc.......................................OK * Checking package: gzip......................................OK * Checking package: htmldoc...................................OK * Checking package: lftp......................................OK * Checking package: libapache2-mod-php7.1.....................OK * Checking package: libc6.....................................OK * Checking package: libcurl3..................................OK * Checking package: m4........................................OK * Checking package: mysql-client..............................OK * Checking package: mysql-server..............................OK * Checking package: net-tools.................................OK * Checking package: nfs-kernel-server.........................OK * Checking package: openssh-server............................OK * Checking package: php7.1....................................OK * Checking package: php7.1-bcmath.............................OK * Checking package: php7.1-cli................................OK * Checking package: php7.1-curl...............................OK * Checking package: php7.1-fpm................................OK * Checking package: php7.1-gd.................................OK * Checking package: php7.1-json...............................OK * Checking package: php7.1-ldap...............................OK * Checking package: php7.1-mbstring...........................OK * Checking package: php7.1-mcrypt.............................OK * Checking package: php7.1-mysql..............................OK * Checking package: php-gettext...............................OK * Checking package: sysv-rc-conf..............................OK * Checking package: tar.......................................OK * Checking package: tftpd-hpa.................................OK * Checking package: tftp-hpa..................................OK * Checking package: unzip.....................................OK * Checking package: vsftpd....................................OK * Checking package: wget......................................OK * Checking package: xinetd....................................OK * Checking package: zlib1g....................................OK * Configuring services * Setting up fog user.........................................Already setup * Setting up fog password.....................................OK * Stopping FOGMulticastManager Service........................OK * Stopping FOGImageReplicator Service.........................OK * Stopping FOGSnapinReplicator Service........................OK * Stopping FOGScheduler Service...............................OK * Stopping FOGPingHosts Service...............................OK * Stopping FOGSnapinHash Service..............................OK * Stopping FOGImageSize Service...............................OK * Setting up and starting MySQL...............................OK * Backing up user reports.....................................Done * Stopping web service........................................OK * Removing vhost file.........................................OK * Setting up Apache and PHP files.............................OK * Testing and removing symbolic links if found................OK * Backing up old data.........................................OK * Copying new files to web folder.............................OK * Creating config file........................................OK * Getting checksum files for kernels and inits................OK * Downloading inits, kernels, and the fog client..............OK * Comparing checksums of kernels and inits....................Done * Enabling apache and fpm services on boot....................OK * Creating SSL Certificate....................................OK * Creating auth pub key and cert..............................OK * Resetting SSL Permissions...................................OK * Setting up SSL FOG Server...................................OK * Restarting Apache2 for fog vhost............................OK * Changing permissions on apache log files....................OK * Backing up database.........................................OK * You still need to install/update your database schema. * This can be done by opening a web browser and going to: http://10.195.0.65/fog/management * Press [Enter] key when database is updated/installed. * Setting up storage..........................................OK * Setting up and starting DHCP Server.........................Skipped * Setting up and starting TFTP and PXE Servers................OK * Setting up and starting VSFTP Server........................OK * Setting up FOG Snapins......................................OK * Setting up UDPCast..........................................OK * Configuring UDPCast.........................................OK * Building UDPCast............................................OK * Installing UDPCast..........................................OK * Installing FOG System Scripts...............................OK * Configuring FOG System Services * Setting FOGMulticastManager script executable...............OK * Enabling FOGMulticastManager Service........................OK * Setting FOGImageReplicator script executable................OK * Enabling FOGImageReplicator Service.........................OK * Setting FOGSnapinReplicator script executable...............OK * Enabling FOGSnapinReplicator Service........................OK * Setting FOGScheduler script executable......................OK * Enabling FOGScheduler Service...............................OK * Setting FOGPingHosts script executable......................OK * Enabling FOGPingHosts Service...............................OK * Setting FOGSnapinHash script executable.....................OK * Enabling FOGSnapinHash Service..............................OK * Setting FOGImageSize script executable......................OK * Enabling FOGImageSize Service...............................OK * Setting up FOG Services.....................................OK * Starting FOGMulticastManager Service........................OK * Starting FOGImageReplicator Service.........................OK * Starting FOGSnapinReplicator Service........................OK * Starting FOGScheduler Service...............................OK * Starting FOGPingHosts Service...............................OK * Starting FOGSnapinHash Service..............................OK * Starting FOGImageSize Service...............................OK * Setting up exports file.....................................OK * Setting up and starting RPCBind.............................OK * Setting up and starting NFS Server..........................OK * Ensuring node username and passwords match..................Done * Setup complete You can now login to the FOG Management Portal using the information listed below. The login information is only if this is the first install. This can be done by opening a web browser and going to: http://10.195.0.65/fog/management Default User Information Username: fog Password: password After this the problem persists. Check date command on top. -
Figured out the problem.
This is because of 4k disks. I won’t go into the specifics, but I can try to show the math that equates out exactly what was happening:.
I was taking the size, making it a multiple of 1024:
9637387 * 1024 = 9868684288
On a 512 block disk (normal sized from long ago) The math than goes:
9868684288 / 512 = 19274774Then we align it as needed (no need to show that work here).
On a 4096 block disk (4k) the math was being presented as:
9868684288 / 4096 = 2409346.75Now if you make that number an int, you can immediately see it EXACTLY equals the number sectors trying to be copied.
Take that 2409346 and multiple it by 512 and you get about 1.2 GB of disk.
I’ve taken correction action on this and hope this will no longer be present.
As always, please re-run the installer and this capture issue (which appears to me to be only related to 4k disks) should be fixed.
Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.
Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)
Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG
-
Oh, and here’s the size that the (bad) was returning:
1233585536
In otherwords, 1 gb, 233 mb, 585 kb, 536b (or 1.2 GB)
-
@Tom-Elliott said in FOG 1.3.5 RC 11:
Figured out the problem.
This is because of 4k disks.
Ugh, 4kn drives… nuff said.
I would your legacy code will work for 512e drives since they are being presented externally as 512n drives but internally they are 4k.
-
I will, however, add that the “boot” partition issue you’re describing.
FOG does not resize partitions that have a label containing reserved, or recovery.
If the label isn’t there, it’s shouldn’t hurt anything to be resized. I don’t think the “non-boot” issue was due to this resizing anyway, now that I’m aware of the CHUNK_SIZE problem. If anything, it was this chunk_size issue that was causing the boot problems to begin with.
