[quote=“Tom Elliott, post: 21965, member: 7271”]r1150 released.

Should truly fix inventory deploy bug.

Was awaiting ##@GO but being sent ##. All the other scripts referencing the Post_Wipe.php file were requesting ##, so made the change to the script (fog.auto.reg) and updated the init.gz[/quote]

i’m unable to upload a image with r1150

the error on the client:

• Attempting to send inventory…
• Attempting to send inventory…
• Attempting to send inventory…
  (loop)

the error on webserver:

Tue Jan 28 08:35:28.919146 2014] [:error] [pid 21583] [client 172.24.77.119:47788] PHP Warning: mysql_query() expects parameter 2 to be resource, boolean given in /var/www/fog/lib/db/MySQL.class.php on line 109
[Tue Jan 28 08:35:28.919189 2014] [:error] [pid 21583] [client 172.24.77.119:47788] PHP Warning: array_key_exists() expects parameter 2 to be array, null given in /var/www/fog/lib/db/MySQL.class.php on line 184
[Tue Jan 28 08:35:31.924901 2014] [:error] [pid 19660] [client 172.24.77.119:47789] PHP Warning: mysql_query() expects parameter 2 to be resource, boolean given in /var/www/fog/lib/db/MySQL.class.php on line 109
[Tue Jan 28 08:35:31.924947 2014] [:error] [pid 19660] [client 172.24.77.119:47789] PHP Warning: array_key_exists() expects parameter 2 to be array, null given in /var/www/fog/lib/db/MySQL.class.php on line 184
[Tue Jan 28 08:35:34.930731 2014] [:error] [pid 21580] [client 172.24.77.119:47790] PHP Warning: mysql_query() expects parameter 2 to be resource, boolean given in /var/www/fog/lib/db/MySQL.class.php on line 109
[Tue Jan 28 08:35:34.930775 2014] [:error] [pid 21580] [client 172.24.77.119:47790] PHP Warning: array_key_exists() expects parameter 2 to be array, null given in /var/www/fog/lib/db/MySQL.class.php on line 184
[Tue Jan 28 08:35:37.936858 2014] [:error] [pid 19659] [client 172.24.77.119:47791] PHP Warning: mysql_query() expects parameter 2 to be resource, boolean given in /var/www/fog/lib/db/MySQL.class.php on line 109
[Tue Jan 28 08:35:37.936900 2014] [:error] [pid 19659] [client 172.24.77.119:47791] PHP Warning: array_key_exists() expects parameter 2 to be array, null given in /var/www/fog/lib/db/MySQL.class.php on line 184
[Tue Jan 28 08:35:40.942841 2014] [:error] [pid 19662] [client 172.24.77.119:47792] PHP Warning: mysql_query() expects parameter 2 to be resource, boolean given in /var/www/fog/lib/db/MySQL.class.php on line 109
[Tue Jan 28 08:35:40.942889 2014] [:error] [pid 19662] [client 172.24.77.119:47792] PHP Warning: array_key_exists() expects parameter 2 to be array, null given in /var/www/fog/lib/db/MySQL.class.php on line 184

and after mysqld restart:

Tue Jan 28 08:22:27.882090 2014] [:error] [pid 17254] [client 172.24.77.119:37640] PHP Fatal error: Call to a member function get() on a non-object in /var/www/fog/service/inventory.php on line 16
[Tue Jan 28 08:22:30.888979 2014] [:error] [pid 17259] [client 172.24.77.119:37641] PHP Fatal error: Call to a member function get() on a non-object in /var/www/fog/service/inventory.php on line 16
[Tue Jan 28 08:22:33.895766 2014] [:error] [pid 17261] [client 172.24.77.119:37642] PHP Fatal error: Call to a member function get() on a non-object in /var/www/fog/service/inventory.php on line 16

the error is releated to line 16 of inventory.php:

    $Inventory = $FOGCore->getClass('InventoryManager')->find(array('hostID' => $Host->get('id')));

[quote=“Tom Elliott, post: 21939, member: 7271”]r1147 released.

Fixes an issue in fog.upload where I was supposed to check if sector 63 is not the case, but actually but if sector 63 is the case.[/quote]

i test right now if upload problem ( ftp error) is solved

[quote=“fabritrento, post: 21934, member: 21607”]i installed the r1145.
now i test single disk multiple partition upload, and multicast download to 25 pc, then i report results here.

my partition schema:

sda1 ntfs
sda2 ext4
sda3 linux-swap
grub 2.x installed.

one question: FOG_PIGZ_COMP variable is to do compression when image is crated. Is used the cpu of client or cpu of fog server? support multithread/dualcore cpu?

Tom, thankyou very much for your work, if you need hardware to help developement i can donate to you, let me know.[/quote]

is all ok but a error is printed on client:

• FOGFTP: Failed to rename file. Remote Path: /images/labinfociro, Local Path: /images/dev/00215a68eb2a, Error: ftp_rename(): Rename failed.

this is a bug introduced with latest test releases.

i installed the r1145.
now i test single disk multiple partition upload, and multicast download to 25 pc, then i report results here.

my partition schema:

sda1 ntfs
sda2 ext4
sda3 linux-swap
grub 2.x installed.

one question: FOG_PIGZ_COMP variable is to do compression when image is crated. Is used the cpu of client or cpu of fog server? support multithread/dualcore cpu?

Tom, thankyou very much for your work, if you need hardware to help developement i can donate to you, let me know.

[quote=“fabritrento, post: 21891, member: 21607”]the error is when says calculating bitmap progress

contenent of /var/log/blkid.tab:
<device DEVNO=“0x0801” TIME=“1390579226.27383” UUID=“E6282FE0282FAF0D” TYPE=“ntfs”>/dev/sda1</device>
<device DEVNO=“0x0802” TIME=“1390579226.67856” UUID=“48b78e27-9a6e-4aab-a9b2-a4d2a50026f8” TYPE=“ext4”>/dev/sda2</device>
<device DEVNO=“0x0803” TIME=“1390579226.131478” UUID=“65b19640-5de4-4e1b-ba5e-105f6dbcc8cc” TYPE=“swap”>/dev/sda3</device>[/quote]

i resolved editing the partclone row, and cut the “-N -f 1” occurences (ncurses interface and refresh to 1). in this way (i don’t understand why at the moment) works

[quote=“fabritrento, post: 21888, member: 21607”]i added ${partNum} to /tmp/status.fog, now i see what appens, and what command is launched for 2nd partclone command

if not sufficient i add also debug at zero level to partimage arguments[/quote]

the error is when says calculating bitmap progress

contenent of /var/log/blkid.tab:
<device DEVNO=“0x0801” TIME=“1390579226.27383” UUID=“E6282FE0282FAF0D” TYPE=“ntfs”>/dev/sda1</device>
<device DEVNO=“0x0802” TIME=“1390579226.67856” UUID=“48b78e27-9a6e-4aab-a9b2-a4d2a50026f8” TYPE=“ext4”>/dev/sda2</device>
<device DEVNO=“0x0803” TIME=“1390579226.131478” UUID=“65b19640-5de4-4e1b-ba5e-105f6dbcc8cc” TYPE=“swap”>/dev/sda3</device>

[quote=“Tom Elliott, post: 21886, member: 7271”]can you give me exact output of blkid for ext4 stuff?[/quote]
i added ${partNum} to /tmp/status.fog, now i see what appens, and what command is launched for 2nd partclone command

if not sufficient i add also debug at zero level to partimage arguments

[quote=“Tom Elliott, post: 21867, member: 7271”]r1137 released.

Had to make tweak to blkid in fog script. Should work more fluidly with this method.

From the commit comments: “Make (hopefully) final tweak in partclone stuffs on fog script. Not done updating fog script, just hopefully done with partclone tweaks.”

I hope you know that just means I’m done, at least for now, with partclone methods. I will continue editing the fog script, and I hope to use partclone for dd (raw) imaging types in the future.[/quote]

i tryed to do a upload of a pc with:
sda1 ntfs
sda2 ext4
sda3 swap

the first partition works, and also the swap.

the ext4 partition don’t work, i think the cause is because blkid command returns ext2 ext3 ext4 and the partclone.extfs command is not called.

So i created 3 symlink in /usr/sbin on the client:

ln -s partclone.extfs partclone.ext2
ln -s partclone.extfs partclone.ext3
ln -s partclone.extfs partclone.ext4

but not works.

is possible to modify the script to make 3 different log in /var/log/partclone_[DATETIME].log ? to debug? i find only the 3th launch of partimage in the log

[quote=“fabritrento, post: 21837, member: 21607”]i’m testing image upload right now, in some minutes i say to you if patch worked…[/quote]

there is a problem, the blkid inclluded in init.gz don’t print the fstype.

on my server:
blkid
/dev/loop0: UUID=“04291dff-b6e6-4815-8549-b1a83d66f145” TYPE=“ext2”
/dev/sda1: UUID=“b842abee-3fbf-4347-a451-ec9e0b3b3aa8” TYPE=“ext2”
/dev/sda5: UUID=“0Oxvj0-osLb-ilwF-e7d0-oJeK-Za9o-IEsjcW” TYPE=“LVM2_member”
/dev/mapper/fog–vg-root: UUID=“b3e21764-e54a-4bbb-9907-0b9d05555c58” TYPE=“ext4”
/dev/mapper/fog–vg-swap_1: UUID=“82810d84-f19c-40ee-a3e8-fa51d6f6e84f” TYPE=“swap”

on the client started with init.gz:

blkid
/dev/sda1: UUID=“b842abee-3fbf-4347-a451-ec9e0b3b3aa8”
/dev/sda2: UUID=“0Oxvj0-osLb-ilwF-e7d0-oJeK-Za9o-IEsjcW”

i try to copy the binary of blkid by hand from server and re-run fog script.

[quote=“fabritrento, post: 21833, member: 21607”]alternatively we can insert this:

else
part_fs_type=blkid $part | awk 'BEGIN {FS="\""} { print $4 }'| sed -e 's/1/fs/g' |sed -e 's/2/fs/g'|sed -e 's/3/fs/g'|sed -e 's/4/fs/g' ### row patch to use correct partclone.fstype
partclone.${part_fs_type} -c -s $part -O /tmp/pigz1 -N -f 1 2>/tmp/status.fog
partclone.${fstype} -c -s $part -O /tmp/pigz1 -N -f 1 2>/tmp/status.fog
fi
what is the more correct solution?[/quote]

i’m testing image upload right now, in some minutes i say to you if patch worked…

[quote=“fabritrento, post: 21828, member: 21607”]i tryed to modify fog script.

simply modified the line:

partclone.${fs_type} -c -s $part -O /tmp/pigz1 -N -f 1 2>/tmp/status.fog

with:

part_fs_type=blkid $part | awk 'BEGIN {FS="\""} { print $4 }' ### row patch to use correct partclone.fstype
partclone.${part_fs_type} -c -s $part -O /tmp/pigz1 -N -f 1 2>/tmp/status.fog

[/quote]

alternatively we can insert this:

else
part_fs_type=blkid $part | awk 'BEGIN {FS="\""} { print $4 }'| sed -e 's/1/fs/g' |sed -e 's/2/fs/g'|sed -e 's/3/fs/g'|sed -e 's/4/fs/g' ### row patch to use correct partclone.fstype
partclone.${part_fs_type} -c -s $part -O /tmp/pigz1 -N -f 1 2>/tmp/status.fog
partclone.${fstype} -c -s $part -O /tmp/pigz1 -N -f 1 2>/tmp/status.fog
fi
what is the more correct solution?

[quote=“fabritrento, post: 21830, member: 21607”]administrator@fog:~/tmp/usr/sbin$ sudo ln -s partclone.extfs partclone.ext4
administrator@fog:~/tmp/usr/sbin$ sudo ln -s partclone.extfs partclone.ext3
administrator@fog:~/tmp/usr/sbin$ sudo ln -s partclone.extfs partclone.ext2

works like a charm :D[/quote]
exist a develop environment where i can access and do testing?

[quote=“Tom Elliott, post: 21829, member: 7271”]xz -C crc32 -z -c init > init.gz (I think)

That said, I don’t think that command will work.

extfs, ntfs, hfsp, btrfs, xfs are the partclone binary names. so if i read your script right, if it comes up as ext4, it’s going to try partclone.ext4 which is wrong.[/quote]

administrator@fog:~/tmp/usr/sbin$ sudo ln -s partclone.extfs partclone.ext4
administrator@fog:~/tmp/usr/sbin$ sudo ln -s partclone.extfs partclone.ext3
administrator@fog:~/tmp/usr/sbin$ sudo ln -s partclone.extfs partclone.ext2

works like a charm

[quote=“Tom Elliott, post: 21774, member: 7271”]It’s all good. You can decompress the init.gz with xz -d -c init.gz > init

Then mount the init file created to another directory. I Usually create a tmp folder inside /tftpboot/fog/images/
[code]
mkdir tmp
xz -d -c init.gz > init
mount -o loop init tmp
[/code]

[/quote]

i tryed to modify fog script.

simply modified the line:

partclone.${fs_type} -c -s $part -O /tmp/pigz1 -N -f 1 2>/tmp/status.fog

with:

part_fs_type=blkid $part | awk 'BEGIN {FS="\""} { print $4 }' ### row patch to use correct partclone.fstype
partclone.${part_fs_type} -c -s $part -O /tmp/pigz1 -N -f 1 2>/tmp/status.fog

in upload section. I think that must work, but to test i recreated init.gz with:

umount ./init
xz -z -c init > init.gz
and overwrited original init.gz into tftp/fog dir : don’t boots

what i must do to recreate a working init.gz?

i suggest also to modify fog to do this:

GRUB2 stage1 location:
[LIST]
[][B]Stage 1[/B]: boot.img is stored in the master boot record (MBR), or optionally in any of the [URL=‘http://en.wikipedia.org/wiki/Volume_boot_record’]volume boot records[/URL] (VBRs), and addresses the next stage by an [URL=‘http://en.wikipedia.org/wiki/LBA48’]LBA48[/URL] address (the 1024 cylinder boundary of GRUB legacy is omitted); at installation time it is configured to load the first sector of core.img.
[][B]Stage 1.5[/B]: core.img is by default written to the sectors between the MBR and the first partition, when these sectors are free and available. For legacy reasons, the first partition of a hard drive does not begin at sector 1 (counting begins with 0) but at sector 63, leaving a gap of 63 sectors of empty space. That space is not part of any partition or file system, and therefore not prone to any problems related with it. Once executed, core.img will load its configuration file and any other modules needed, particularly [URL=‘http://en.wikipedia.org/wiki/File_system’]file system[/URL] drivers; at installation time, it is generated from diskboot.img and configured to load the [I]stage 2[/I] by its [URL=‘http://en.wikipedia.org/wiki/Path_(computing)’]file path[/URL].
[/LIST]
so copying only the MBR is not correct! we must copy also all data before sda1 starts

[quote=“Tom Elliott, post: 21762, member: 7271”]Partimage does not work with ext4 partitions at all. This is why you were seeing an issue. It does, however, work with ext3 partitions which was common place for a long time. It wouldn’t surprise me if what you’re referring to was ext3. The differences between partclone and partimage are great. The Pros far outweigh the cons to switch to Partclone, but one of the drawbacks is you have to specify the file system architecture in the partclone binary. This is why I was interested in what the output of blkid was.

I can use a grep command with awk to get each partitions type so that I can set the fstype for the partclone binary. Right now I haven’t the time as it will also require rebuilding the init.gz. I will try to get to this today, but I’ve got to mount a few WAPs thoughout my school district.[/quote]

also I work in a school.
how i can mount/rebuild the init from server ?
I want to help develop, if i fix the fog script is sufficient to add to init.gz?

fog script uses bash environment varabiles to configure itself and know what do do when a upload is started on the client?

the question is: if i modify the fog to upload correctly all partitions listed in disk, i need to store also some data into the db? or via web gui? what exactly?

tomorrow i try to develop something.

[quote=“Tom Elliott, post: 21753, member: 7271”]@rado,

@fabritreno,
I haven’t added the “fixes” as you’ve recommended yet. Yesterday I was more focused on getting the multicastSessions working. They do work now, however if you update, you may have to perform a service FOGMulticastManager restart.

I don’t know what your many php statements are looking like.

now i rolled back to 0.32. but some users say that don’t work with ext4… but on another installation i used fog 0.32 to clone pc with 3 partitions and worked for me…

so now i upgrade to 0.33b, then wait till you can work on patch with blkid and fdisk -l patch.

if you can do this today, then i can test, you are my president ;P[/quote]

i have 2 computer labs, every one of 20 pc and separated fog servers.

on the first i upload a image of disk:

sda1 (ntfs)
sda2 (ext4)
sda3 (linux-swap)

and worked, creating 3 image files in /images

the other lab don’t work

sda1 (ntfs) OK
sda2 (ext4) zero size (copies only first blocks… 19189bytes gunzipped)
sda3 (linux-swap) zero size (d1p3.img file not found)

i cannot understand why… what can be the cause?

i run now a debug image upload.

[quote=“fabritrento, post: 21744, member: 21607”]the imaging of a pc with single disk multiple partition of:

sda1 ntfs(winxp)
sda2 ext4 (linux)
sda3 swap (linux)

should work with r1128? i can test it?[/quote]

…
What is the IP address to be used by this FOG Server? [inet:192.168.0.3] (esthetic bug remains during install)
…
The multiple partition cloning bug is not solved.

also after a multicast task started, i get this error when i click on tasks page:

FOG DEBUG: Host: Database Load Failed: ID: 0, Error: Operation field not set: ID
FOG DEBUG: Host: Database Load Failed: ID: 0, Error: Operation field not set: ID

so now i’m locked. please help me, i must image these units until 13:00PM, otherwise i bust uninstall the 0.33B and switch back to 0.32…

i partially fixed this error doing:

mysql> select * from tasks;
±-------±-----------------------------±--------------------±--------------------±-----------±------------±-------------±----------±-----------------------±-----------±-----------±---------±----------------±------------------±---------------±----------------±--------------±---------------±----------------±----------------±-----------------+
| taskID | taskName | taskCreateTime | taskCheckIn | taskHostID | taskStateID | taskCreateBy | taskForce | taskScheduledStartTime | taskTypeID | taskPCT | taskBPM | taskTimeElapsed | taskTimeRemaining | taskDataCopied | taskPercentText | taskDataTotal | taskNFSGroupID | taskNFSMemberID | taskNFSFailures | taskLastMemberID |
±-------±-----------------------------±--------------------±--------------------±-----------±------------±-------------±----------±-----------------------±-----------±-----------±---------±----------------±------------------±---------------±----------------±--------------±---------------±----------------±----------------±-----------------+
| 1 | | 2014-01-20 12:50:17 | 2014-01-20 12:50:57 | 1 | 4 | fog | 0 | 0000-00-00 00:00:00 | 2 | 0000000100 | 136.45MB | 01:29:40 | 00:00:02 | 17.74 GB | 99.95 | 29.29 GB | 1 | 1 | | 0 |
| 3 | | 2014-01-21 07:52:05 | 2014-01-21 07:52:49 | 1 | 4 | fog | 0 | 0000-00-00 00:00:00 | 2 | 0000000100 | 437.79MB | 00:27:52 | 00:00:05 | 17.70 GB | 99.66 | 29.29 GB | 1 | 1 | | 0 |
| 4 | | 2014-01-21 08:31:08 | 2014-01-21 08:35:13 | 1 | 4 | fog | 0 | 0000-00-00 00:00:00 | 2 | 0000000100 | 656.81MB | 00:18:36 | 00:00:02 | 17.72 GB | 99.80 | 29.29 GB | 1 | 1 | | 0 |
| 5 | | 2014-01-21 09:05:11 | 2014-01-21 10:20:20 | 1 | 4 | fog | 0 | 0000-00-00 00:00:00 | 16 | 0000000100 | 801.04MB | 00:15:16 | 00:00:00 | 17.73 GB | 99.90 | 29.29 GB | 1 | 1 | | 0 |
| 7 | | 2014-01-21 15:55:47 | 2014-01-21 15:56:59 | 1 | 4 | fog | 0 | 0000-00-00 00:00:00 | 2 | 0000000000 | | | | | | | 1 | 1 | | 0 |
| 8 | | 2014-01-22 08:44:29 | 2014-01-22 08:48:35 | 1 | 4 | fog | 0 | 0000-00-00 00:00:00 | 2 | 0000000100 | 709.88MB | 00:19:25 | 00:00:02 | 17.63 GB | 99.79 | 29.29 GB | 1 | 1 | | 0 |
| 9 | | 2014-01-22 09:19:33 | 2014-01-22 09:20:11 | 1 | 4 | fog | 0 | 0000-00-00 00:00:00 | 2 | 0000000100 | 650.98MB | 00:21:13 | 00:00:00 | 17.67 GB | 99.99 | 29.29 GB | 1 | 1 | | 0 |
| 10 | labinfo | 2014-01-22 09:51:02 | 0000-00-00 00:00:00 | 0 | 5 | fog | 0 | 0000-00-00 00:00:00 | 8 | 0000000000 | | | | | | | 1 | 1 | | 0 |
| 11 | labinfo | 2014-01-22 09:51:03 | 0000-00-00 00:00:00 | 2 | 5 | fog | 0 | 0000-00-00 00:00:00 | 8 | 0000000000 | | | | | | | 1 | 1 | | 0 |
| 12 | labinfo | 2014-01-22 09:51:05 | 0000-00-00 00:00:00 | 3 | 5 | fog | 0 | 0000-00-00 00:00:00 | 8 | 0000000000 | | | | | | | 1 | 1 | | 0 |
| 13 | labinfo | 2014-01-22 09:51:06 | 0000-00-00 00:00:00 | 4 | 5 | fog | 0 | 0000-00-00 00:00:00 | 8 | 0000000000 | | | | | | | 1 | 1 | | 0 |
| 14 | labinfo | 2014-01-22 09:51:07 | 0000-00-00 00:00:00 | 5 | 5 | fog | 0 | 0000-00-00 00:00:00 | 8 | 0000000000 | | | | | | | 1 | 1 | | 0 |
| 15 | labinfo | 2014-01-22 09:51:08 | 0000-00-00 00:00:00 | 6 | 5 | fog | 0 | 0000-00-00 00:00:00 | 8 | 0000000000 | | | | | | | 1 | 1 | | 0 |
| 27 | Multicast Group Quick Deploy | 2014-01-22 10:23:43 | 0000-00-00 00:00:00 | 0 | 1 | fog | 0 | 0000-00-00 00:00:00 | 8 | 0000000000 | | | | | | | 1 | 1 | | 0 |
±-------±-----------------------------±--------------------±--------------------±-----------±------------±-------------±----------±-----------------------±-----------±-----------±---------±----------------±------------------±---------------±----------------±--------------±---------------±----------------±----------------±-----------------+
14 rows in set (0.00 sec)

mysql> delete from tasks where taskID=27;
Query OK, 1 row affected (0.00 sec)

mysql> commit;
Query OK, 0 rows affected (0.00 sec)

so there is a problem, scheduling a multicast deploy results that the tasklist webpage is no mere accessible.

also doing a normal clone don’t work.

this is very buggly… i revert to 0.32, i need to image

on the fog server i have tons of these script:

root 643 640 0 Jan21 ? 00:00:00 /bin/sh -c [ -x /usr/lib/php5/maxlifetime ] && [ -d /var/lib/php5 ] && find /var/lib/php5/ -depth -mindepth 1 -maxdepth 1 -type f -cmin +$(/usr/lib/php5/maxlifetime) ! -execdir fuser -s {} 2>/dev/null ; -delete
root 681 643 0 Jan21 ? 00:00:24 find /var/lib/php5/ -depth -mindepth 1 -maxdepth 1 -type f -cmin +24 ! -execdir fuser -s {} ; -delete

someone has idea what is??