This is like my problem, except I’m trying to download not upload.
What happens if you set the “Host Primary Disk” for that client in the fog web gui to “/dev/nvme0n1” ?
That should get it past the cannot find HDD on system, but for me it wasn’t entering partclone for a download, who knows maybe it would work for upload.
Thanks,
-JJ
@Tom-Elliott
Sorry that it took me so long, I kept getting distracted by some other stuff.
It’s Alive!
It Works!
Amazing!
You’re the best!
I did a debug deploy so I can also confirm that all the variables are now correct…
Shall I test a resizable and a not so unresizable upload?
I’m guessing that you did a uefi image since it wants to use windows boot manager, which I believe is window’s uefi method.
Was secure boot enabled on the computer that you uploaded from, could that cause a problem? I haven’t actually done any successful uefi imaging and haven’t really tried that hard because I’m personally yet to see why it’s worth it when mbr/bios/legacy works so well and I don’t have any 3+TB drives in my windows workstations at work.
I have had success imaging windows 10 with legacy mode, just for a reference, I’m on the latest trunk, but I would bet 1.2 works with it.
Granted I don’t use sysprep, I find that it likes to kill off my default profile. So I just manually uninstall devices in the device manager before imaging. It’s trickier, and involves more work, but it’s done sooner than it takes sysprep to run. But I’m getting off topic.
Have you tried repairing the install with a win 10 disk. Auto repair. What ever the gpt/uefi equivalent of
bootrec /rebuildbcd
bootrec /fixboot
bootrec /fixmbr
is. (Fun fact shift+F10 gets you straight to a command line on a windows install disk instead of waiting to click through the menus)
Or try the windows automatic repair that works like 10% of the time.
You can also use diskpart to make sure the volume/disk/partition that got imaged is active.
disk part
select disk 0
list partition
select partition 1
detail partition
something like that, and then you can set it to active. That was a problem I used to have when I used the altiris imaging system, I’ve never had the problem with FOG.
Granted you shouldn’t have to repair the install after imaging, especially if you run sysprep all proper, but if you can make it work then that might narrow down some possibilities.
Can you disable secure boot in the bios settings on the computer not booting?
Can you make sure secure boot was disabled on the computer you uploaded from, or if it was disabled try imaging with it enabled?
I’m just guessing on the secure boot thing, might not even be a thing, but it seems like it could be relevant.
I hate to suggest starting over on an image, but I would recommend making sure that you’re using bios/legacy/mbr boot mode. Unfortunately there is no way (that I have ever found anyway) to switch a computer between the two without reinstalling the OS because they use different partitioning types MBR and GPT. Also, when installing the OS in mbr mode, the easiest way I’ve found to ensure it’s a single disk (This hasn’t worked for uefi/gpt mode when I’ve tried) is to hit shift+f10 at the partition screen then do the following in the command line to clear the partitions and make only 1 full size partition
diskpart
list disk
# select your disk, usually disk 0 unless you have more
select disk 0
clean
create partition primary
exit
exit
Hit refresh on the partition selection screen and viola. I got that from a forum post on here or related to fog somewhere many moons ago and have been using it forever.
I seem to be rambling again.
To sum up
@Toby777 Awesome! That’s good to know. Hopefully they’ll be able to fix it so that nvme works without using raw but the fact that it works at all is awesome! How fast is it uploading? RAW is typically much slower but those pci based drives are supposed to be crazy fast, just curious how fast.
@Tom-Elliott
Ok I will test every which way just for funzies and report back by editing this post
I won’t test the multiple disk images because I only have one disk in there right now. But I can add in a drive that would get recognized as /dev/sda and make sure it can image that combination if you want.
Download
Single Partition/Resizable - Working!
Multiple Partition/Single Disk - Working!
Multiple Partition/Multiple Disk - Working!
Upload
Single Partition/Resizable - Working! - a few error messages that don’t stop anything
Multiple Partition/Single Disk - Working!
Multiple Partition/Multiple Disk - Working!
So I finally figured this out.
In windows 10, Instead of using the copy to method in user profiles you gotta be a little trickier.
Customize the profile you want then login to a different admin account.
Now copy the only the appdata folders you need such as
roaming/mozilla for firefox customizations
local/Google for chrome customizations
local/Microsoft/Windows/Default Layouts
and
local/Microsoft/Tile Data Layer
for start menu pins
roaming/microsoft/internet explorer for task bar pins
And then once that’s all done, leaving the default profile as it was otherwise there’s one other thing to do to get the task bar settings and desktop background type settings to work. Which is all in the NTuser.dat type files. Just run this command in an administrator cmd
XCOPY C:\Users\CustomUser\ntuser* C:\Users\Default /H
It will ask if you want to overwrite, you do.
And then it works, a completely customized default profile without breaking any of the windows 10 metro apps.
@sebastian-roth I need to get back into those docs. Things have been just so crazy lately. When you have something working let me know and we’ll get it documented.
Assuming that your original is still up and running, you could try doing a manual database dump and import. This is essentially what the gui is doing so that you don’t have to worry about the command line aspects, but it doesn’t
In the command line on the original server, assuming you went with the default blank password…
mysqldump -u root fog > /home/fog/fog.sql
Then open up winscp, filezilla, cyberduck, or whatever ftp client you prefer (or just use scp in command line to copy straight to the vm) and download the fog.sql file you created.
Then in the new vm server put the fog.sql file in /home/fog and then run this command
mysql -u root fog < /home/fog/fog.sql
And that should take care of it.
Alternatively, especially if it looks like the gui export is working, you can just use the downloaded file from the gui for the second part there.
Hope that helps
@Tom-Elliott said:
32 bit Init: https://mastacontrola.com/init_32.xz
64 bit Init: https://mastacontrola.com/init.xz
Just in case someone else is reading this and having the same problem and is new to fog and ipxe and what not…
To test out this fix do this…
cd /var/www/fog/service/ipxe
sudo mv init.xz init.bck
sudo mv init_32.xz init_32.bck
wget https://mastacontrola.com/init.xz --no-check-certificate && wget https://mastacontrola.com/init_32.xz --no-check-certificate
sudo chmod -R 775 ./
I made a script for this new windows 10 default profile business.
Windows 7 and 8 are slightly different and I will post script that work for them with this new method once I make them.
Copy paste this into your favorite text editor and save as a .bat file
or just download it here…
0_1452880295325_Create Default Profile Win 10.bat
You need to make one change
change the cUser (customized User) variable on line 29 to the name of the user you customized
Note - Run this script from a different admin account, like the built in administrator, if you try to run it from the customized profile it will likely throw errors of files being in use
Note - REM is a comment in a batch script, it doesn’t seem to turn comment colored in the forum, it does in sublime text though.
@ECHO OFF
REM @ECHO off to not output the commands being run to the console
REM This script copies a Customized windows 10 profile to the default profile so that
REM all new profiles are created with the same settings
call :main
exit
:main
REM main Function that just calls the other Functions
call :funcHead "Welcome to the Windows 10 Default Profile Creator Script!"
call :setVars
call :funcHead "Copying Customized Profile From %custom% to %default% ..."
call :AppData
call :CustomSettings
call :funcHead "Done creating custom default profile! & echo.Goodbye"
EXIT /B
:setVars
REM Function to set script variables
REM c stands for Custom, d stands for default. cUser should be the name of the user you Customized
REM These variables just point to the user folders and the local and roaming appdata folders that
REM store all the settings for a user profile
call :funcHead "Setting directory variables..."
set cUser=adl
set custom="C:\Users\%cUser%"
set default="C:\Users\Default"
set cLocal="C:\Users\%cUser%\AppData\Local"
set dLocal="C:\Users\Default\AppData\Local"
set cRoam="C:\Users\%cUser%\AppData\Roaming"
set dRoam="C:\Users\Default\AppData\Roaming"
call :dots
EXIT /B
:copyDir
REM Function inputs - 1 = display of what is copying 2 = source folder 3 = destination folder
REM This Function simply displays what you're copying and copies it. Did a Function to have less
REM copy paste of command line options and have cleaner code.
REM Note that when calling the Function all passed parameters should be encased in double quotes
REM otherwise ROBOCOPY won't read the directories as seperate
REM ROBOCOPY or robust copy, is a tool for copying directories or files in windows command line
REM The syntax is ROBOCOPY sourceFolder DestFolder options
REM the options used make it so a mirrored version of the source and its subdirectories are copied
REM to the destination with 64 threads (64 files at once) overwriting existin files retrying any failed files
REM only once after 1 second of waiting and all without any verbose output
REM /S - subdirectories /MIR - mirror /MT:64 - multithreaded copy with 64 threads, i.e. 64 files at a time instead of 1.
REM /LOG - output to logfile instead of console, ROBOCOPY /? says this provides better performance in multithreaded mode
REM /IS - include same files i.e. overwrite existing /R:1 retry on error once (default is 1 million)
REM W:1 - wait one second between retry on error (default is 30 seconds)
REM the /N* are all to decrease output for automation. Since they go to a log file you can take them out if you want
REM /NP - no progress /NS - don't log file sizes /NC - don't log file classes /NFL - don't log file names /NDL - don't log directory names
REM /NJH - no job header /NJS - no job summary
echo. Copying %~1...
ROBOCOPY "%~2" "%~3" /S /MIR /MT:64 /LOG:C:\defaultProfile.txt /IS /R:1 /W:1 /NP /NJH /NJS /NS /NC /NFL /NDL
echo. Done Copying %~1
EXIT /B
:AppData
REM Function to copy all Customizations settings that are stored in files in the AppData folder
call :funcHead "Copying Customizations From AppData..."
REM directories used in all versions of windows
call :copyDir "Firefox Customizations" "%cRoam%\Mozilla" "%dRoam%\Mozilla"
call :copyDir "Google Chrome Customizations" "%cLocal%\Google" "%dLocal%\Google"
call :copyDir "Task Bar Pin Shortcuts" "%cRoam%\Microsoft\Internet Explorer" "%dRoam%\Microsoft\Internet Explorer"
REM The remaining dirs are specific to Windows 10
REM Note: A starup script will be required on first login to copy the favorites for Microsoft edge to the Packages directory in the newly created User
REM That logon script would only need to be one line like so...
REM ROBOCOPY "%localAppData%\MicrosoftEdge\User" "%localAppData%\Packages\Microsoft.MicrosoftEdge_8wekyb3d8bbwe\AC\MicrosoftEdge\User" /S /MIR /MT:64 /LOG:C:\logs\edgeBookmarks.txt /IS /R:1 /W:1
call :copyDir "Microsoft Edge Customizations" "%cLocal%\Packages\Microsoft.MicrosoftEdge_8wekyb3d8bbwe\AC\MicrosoftEdge\User" "%dLocal%\MicrosoftEdge\User"
call :copyDir "Start Menu Tiles Part 1 of 3" "%cLocal%\TileDataLayer" "%dLocal%\TileDataLayer"
call :copyDir "Start Menu Tiles Part 2 of 3" "%cRoam%\Microsoft\Windows\Start Menu" "%dRoam%\Microsoft\Windows\Start Menu"
call :copyDir "Start Menu Tiles Part 3 of 3" "%cLocal%\Microsoft\Windows\Shell" "%dLocal%\Microsoft\Windows\Shell"
echo. Done Copying AppData Folders...
call :dots
EXIT /B
:CustomSettings
REM This Function copies the ntuser.dat and related system files that store things like task bar pin order,
REM mapped network drives, taskbar toolbars, explorer settings, desktop background settings, etc.
REM It uses xcopy to copy all files that start with ntuser via * wildcard and uses the options...
REM \H - copy hidden system files /Y - overwrite existsing files without prompt
call :funcHead "Copying custom settings (i.e. task bar pins and toolbars, desktop background, etc.) from ntuser .dat system files..."
XCOPY %custom%\ntuser* %default%\ /H /Y
echo. Done Copying Custom Settings
call :dots
EXIT /B
:dots
REM just echoing dots in a Function instead of copy pasting them so that it's consistent
echo ......................................................................
EXIT /B
:funcHead
REM A simple function for displaying a consistent header at the start of functions
call :dots
echo. %~1
call :dots
EXIT /B
Have you tried a proxy dhcp using dnsmasq like they’re talking about?
I do realize that you are using a redhat not a debian, so unless you switch to a debian flavor of linux like ubuntu server or what have you, the commands would be slightly different, but I’m pretty sure that there should be equivalents for this all in redhat if you don’t want to switch distros again, and I wouldn’t blame you at all.
I only know how to set it up on debian based linux with apt-get, but I imagine the yum RHEL package is probably the same name.
From what I recall to set it up…
sudo apt-get update
sudo apt-get install dnsmasq
sudo nano /etc/dnsmasq.d/ltsp.conf
In the ltsp.conf file put this…
port=0
log-dhcp
tftp-root=/tftpboot
dhcp-boot=undionly.kpxe,fog-server,10.1.8.1
dhcp-no-override
pxe-service=X86PC, "Boot from network", undionly
dhcp-range=10.1.8.1,proxy
You may need to make symlinks for dnsmasq to see the undionly file, and I’ve had some luck putting copies of the bootfile in the ipxe folder too, that very well may do nothing, but I think it fixed something once so I just kinda still do it to be safe since it doesn’t hurt anything.
sudo cp /tftpboot/undionly.kpxe /tftpboot/undionly.0
sudo cp /tftpboot/undionly.kpxe /var/www/fog/service/ipxe/undionly.kpxe
sudo cp /tftpboot/undionly.kpxe /var/www/fog/service/ipxe/undionly.0
Then restart the dnsmasq service (also do this whenever you make changes to this file)
sudo service dnsmasq restart
You can play with the dhcp-range value a bunch to try to get it to work. This is the method I used when I didn’t have access to the DHCP server.
You can try setting the range to just your FOG server’s ip. You can set it to the router gateway, you can set it to the dhcp server too. And you can try interchanging I’ve had some
In the event that enabling dnsmasq kills your resolvconf dns configuration (which it often does…) the easiest solution is to add your dns servers in /etc/resolvconf/resolv.conf.d/base
You would also want to edit /etc/resolvconf/interface-order to have your main network interface at the top. It defaults to local host first and makes it so 127.0.0.1 becomes your dns server and breaks the internet. At least it’s done that every time I’ve installed it on ubunutu.
so like this…
sudo nano /etc/resolvconf/resolv.conf.d/base
Then lets say you use google’s dns servers and google.com was your domain for a simple syntax example, you would do this…
nameserver 8.8.8.8
nameserver 8.8.4.4
search google.com
Then restart the resolvconf service
sudo service resolvconf restart
If that doesn’t take care of it and it is a problem, check out this forum post for more info
https://forums.fogproject.org/topic/2799/dnsmasq-kills-dns-lookup-on-fog-server/6
A basic rundown of my understanding of dnsmasq is this
More information on dnsmasq and fog here https://wiki.fogproject.org/wiki/index.php/Using_FOG_with_an_unmodifiable_DHCP_server/Using_FOG_with_no_DHCP_server
and here https://wiki.fogproject.org/wiki/index.php/ProxyDHCP/dnsmasq-_DRAFT
Another option, albeit an extremely advanced and difficult option, is to set up fog as a tertiary dhcp server. You would have to look into configuring a linux dhcp server, not something I have personally done at that in depth of a level. Because you would have to figure out how to make it act as a separate vlan or something like that, or maybe just have a separate network for imaging rather than having it on your whole organization. Something like a switch and a workbench in your office. But those are just a couple fall back ideas.
Also a side note, @george1421 and @Wayne-Workman Wayne is right here. I’ve actually gotten dnsmasq to work on multiple subnets and buildings. Granted it was a complicated university environment, and I had to do some tricksy stuff. But don’t underestimate the power of dnsmasq.
I have returned from holiday and just tested out the latest inits.
All seems to be working perfectly.
Thanks for all the help!
@Wayne-Workman Oh my goodness I didn’t put any comments. I have all my scripts in a git repo so most the comments are in commits. I will indeed edit the post and add some comments. And I also realized that it would need to be slightly different for windows 7 and 8 and I have use for at least the windows 8 one, so I’ll make that script and post it here too.
what dhcp package are you trying to install with yum?
And, since you’re new to the install, are you sure you want DHCP on the FOG server? Do you not already have a dhcp server on your network?
@george1421 It is a HP Prodesk 400 Mini G3 MFR part# 2RN27UT#ABA
The nvme was manually added, not something that comes with it.
But the Intel Optane setting was new to me, and this wasn’t my first prodesk 400 mini g3. But they did just change the mfr part # for this configuration and stop sending out the old one, so it’s probably related to this.
From what I read briefly about the intel optane feature, it’s a part of the 7th gen intel core cpus chipset or requires it or something like that.
@Wayne-Workman There ya go, detailed comments galore. Also thank you for your script.
You could probably just change the variables for the default profile locations in my script to the network drive and utilize your same system.
I also back up my default profile folder to a network drive after I run this script.
@Tom-Elliott @ManofValor
I’ve had this problem on a few of the trunks in the last week. So I’ve just put those commands into a bandaid fix type script and it works everytime it happens, like this morning for example. Said script is just the same commands with some echo’s and -y for automation, looks like this…
#!/bin/bash
echo "running autoremove to clean up apt..."
sudo apt-get autoremove --purge -y
echo "removing php files..."
sudo rm -rf /etc/php5
echo "removing ondrej sources from apt..."
sudo rm -rf /etc/apt-get/sources.d/*ondrej*
echo "uninstalling php5..."
sudo apt-get purge php5* -y
echo "cleaning up apt..."
sudo apt-get autoremove --purge -y
exit
Do we have any idea what is causing this or should I just add those commands to my update script reinstall php over and over and just not worry about it? Granted it doesn’t happen with every trunk, maybe 3 of them in the last week.
I wonder if it’s specific to a linux distro? I am running Ubuntu Server 14.04
@templink What version of Ubuntu are you running?
@ManofValor Assuming you’re having this problem too, what linux distro are you running?
@Sebastian-Roth said in >FOG vs UEFI:
@jeremyvdv Maybe this is going to help you: https://wiki.fogproject.org/wiki/index.php/Windows_DHCP_Server
This is also on the new docs page https://docs.fogproject.org/en/latest/installation/network-setup/dhcp-server-settings/
@george1421 said in >FOG vs UEFI:
@jeremyvdv If you have a windows dhcp server AND you need to pxe boot both bios and uefi based computers you might want to review this wiki page to setup dhcp profiles so your dhcp server sends the proper boot file name based on the target computer: https://wiki.fogproject.org/wiki/index.php/BIOS_and_UEFI_Co-Existence#Using_Windows_Server_2012_.28R1_and_later.29_DHCP_Policy
This is also on the new docs page
https://docs.fogproject.org/en/latest/kb/how-tos/bios-and-uefi-co-existence/
@anthonyglamis 6038 is the latest version. That’s the git/svn revision number. It won’t say 1.3.0 until that version is officially released, so don’t worry about that.
For the image store corrupt error, did that go away after upgrading from 6032→6038?
If not check that image folder on the fog server with
ls /images/imageName
and make sure there’s a d1.mbr or something of that sort.
Also make sure the permissions are correct on the image store
sudo chmod -R 775 /images
also what does /etc/exports say?
cat /etc/exports