@Tom-Elliott a real pita?

I am trying to upload an image from an esxi vm, something I did successfully just yesterday. This image is based off that one even but I keep getting the following error.

I tried running fixpart /dev/sda in the debug prompt, but it didn’t help as it did for someone else on another forum post I found from many months back.

everything looks as it should in the debug prompt as far as I can tell.
Did something change in the upload script recently?

I mount my /images from an attached array straight into the /images folder and it works without issue. But I’m using ubunutu 14.04 and the drive is formatted as ext4. But regardless I imagine it would still work.

What does your /etc/exports look like?

cat /etc/exports

what does your /etc/fstab say? That’s where the options for mounting it in the os would be

cat /etc/fstab

what are the permissions currently on /images?

ls -l /images

Are you on the latest trunk of FOG 1.2? I think FOG 1.2 had a fogstorage user that needed permissions to the storage nodes and its password needs to be set correctly in the gui storage node settings.

Does the graph of the space usage display on the fog gui homepage?

Are you able to mount the nfs drive elsewhere?
for example if you happen to have an enterprise version of windows install the
“client for NFS” in the “turn windows features on and off” found in the “add or remove programs” control panel.

If that client is installed you can mount an NFS share in windows by either
running this command in a run prompt…

\fog-server\images

or
In command line

mount \\fog-server\images Z:
cd /d Z:
Z:\>dir
images directory listing pops up

Granted @Wayne-Workman is probably right saying you should add it as a separate storage node since its hosted on a different machine and a different OS and all. But some of this might help troubleshoot this if getting it to work is possible through your current configuration

@Wayne-Workman There ya go, detailed comments galore. Also thank you for your script.
You could probably just change the variables for the default profile locations in my script to the network drive and utilize your same system.
I also back up my default profile folder to a network drive after I run this script.

@Wayne-Workman Oh my goodness I didn’t put any comments. I have all my scripts in a git repo so most the comments are in commits. I will indeed edit the post and add some comments. And I also realized that it would need to be slightly different for windows 7 and 8 and I have use for at least the windows 8 one, so I’ll make that script and post it here too.

@Toby777 Are you on the latest trunk?
Download and upload of all image formats is working for me on nvme on the latest.

I made a script for this new windows 10 default profile business.
Windows 7 and 8 are slightly different and I will post script that work for them with this new method once I make them.

Copy paste this into your favorite text editor and save as a .bat file
or just download it here…
0_1452880295325_Create Default Profile Win 10.bat

You need to make one change
change the cUser (customized User) variable on line 29 to the name of the user you customized

Note - Run this script from a different admin account, like the built in administrator, if you try to run it from the customized profile it will likely throw errors of files being in use

Note - REM is a comment in a batch script, it doesn’t seem to turn comment colored in the forum, it does in sublime text though.

@ECHO OFF
	REM @ECHO off to not output the commands being run to the console
	REM This script copies a Customized windows 10 profile to the default profile so that
	REM all new profiles are created with the same settings

call :main
exit

:main
	REM main Function that just calls the other Functions

	call :funcHead "Welcome to the Windows 10 Default Profile Creator Script!"
	call :setVars
	call :funcHead "Copying Customized Profile From %custom% to %default% ..."
	call :AppData
	call :CustomSettings
	call :funcHead "Done creating custom default profile! & echo.Goodbye"	
	EXIT /B

:setVars
	REM Function to set script variables

	REM c stands for Custom, d stands for default. cUser should be the name of the user you Customized
	REM These variables just point to the user folders and the local and roaming appdata folders that 
	REM store all the settings for a user profile

	call :funcHead "Setting directory variables..."
	
	set cUser=adl
	set custom="C:\Users\%cUser%"
	set default="C:\Users\Default"
	set cLocal="C:\Users\%cUser%\AppData\Local"
	set dLocal="C:\Users\Default\AppData\Local"
	set cRoam="C:\Users\%cUser%\AppData\Roaming"
	set dRoam="C:\Users\Default\AppData\Roaming"
	
	call :dots
	EXIT /B

:copyDir
	REM Function inputs - 1 = display of what is copying 2 = source folder 3 = destination folder 
	
	REM This Function simply displays what you're copying and copies it. Did a Function to have less
	REM copy paste of command line options and have cleaner code.
	REM Note that when calling the Function all passed parameters should be encased in double quotes
	REM otherwise ROBOCOPY won't read the directories as seperate
	
	REM ROBOCOPY or robust copy, is a tool for copying directories or files in windows command line
	REM The syntax is ROBOCOPY sourceFolder DestFolder options
	REM the options used make it so a mirrored version of the source and its subdirectories are copied
	REM to the destination with 64 threads (64 files at once) overwriting existin files retrying any failed files 
	REM only once after 1 second of waiting and all without any verbose output
	
	REM /S - subdirectories /MIR - mirror /MT:64 - multithreaded copy with 64 threads, i.e. 64 files at a time instead of 1. 
	REM /LOG - output to logfile instead of console, ROBOCOPY /? says this provides better performance in multithreaded mode
	REM /IS - include same files i.e. overwrite existing /R:1 retry on error once (default is 1 million) 
	REM W:1 - wait one second between retry on error (default is 30 seconds) 
	REM the /N* are all to decrease output for automation. Since they go to a log file you can take them out if you want
	REM /NP - no progress /NS - don't log file sizes /NC - don't log file classes /NFL - don't log file names /NDL - don't log directory names
	REM /NJH - no job header /NJS - no job summary

	echo. Copying %~1...
	ROBOCOPY "%~2" "%~3" /S /MIR /MT:64 /LOG:C:\defaultProfile.txt /IS /R:1 /W:1 /NP /NJH /NJS /NS /NC /NFL /NDL
	echo. Done Copying %~1
	EXIT /B

:AppData
	REM Function to copy all Customizations settings that are stored in files in the AppData folder
	
	call :funcHead "Copying Customizations From AppData..."
	
	REM directories used in all versions of windows
	call :copyDir "Firefox Customizations" "%cRoam%\Mozilla" "%dRoam%\Mozilla"
	call :copyDir "Google Chrome Customizations" "%cLocal%\Google" "%dLocal%\Google"
	call :copyDir "Task Bar Pin Shortcuts" "%cRoam%\Microsoft\Internet Explorer" "%dRoam%\Microsoft\Internet Explorer"
	
	REM The remaining dirs are specific to Windows 10 
	REM Note: A starup script will be required on first login to copy the favorites for Microsoft edge to the Packages directory in the newly created User
	REM That logon script would only need to be one line like so...
	REM ROBOCOPY "%localAppData%\MicrosoftEdge\User" "%localAppData%\Packages\Microsoft.MicrosoftEdge_8wekyb3d8bbwe\AC\MicrosoftEdge\User" /S /MIR /MT:64 /LOG:C:\logs\edgeBookmarks.txt /IS /R:1 /W:1 
	
	call :copyDir "Microsoft Edge Customizations" "%cLocal%\Packages\Microsoft.MicrosoftEdge_8wekyb3d8bbwe\AC\MicrosoftEdge\User" "%dLocal%\MicrosoftEdge\User"
	call :copyDir "Start Menu Tiles Part 1 of 3" "%cLocal%\TileDataLayer" "%dLocal%\TileDataLayer"
	call :copyDir "Start Menu Tiles Part 2 of 3" "%cRoam%\Microsoft\Windows\Start Menu" "%dRoam%\Microsoft\Windows\Start Menu"
	call :copyDir "Start Menu Tiles Part 3 of 3" "%cLocal%\Microsoft\Windows\Shell" "%dLocal%\Microsoft\Windows\Shell"
	
	echo. Done Copying AppData Folders...
	call :dots
	EXIT /B

:CustomSettings
	REM This Function copies the ntuser.dat and related system files that store things like task bar pin order, 
	REM mapped network drives, taskbar toolbars, explorer settings, desktop background settings, etc.
	REM It uses xcopy to copy all files that start with ntuser via * wildcard and uses the options...
	REM \H - copy hidden system files /Y - overwrite existsing files without prompt 

	call :funcHead "Copying custom settings (i.e. task bar pins and toolbars, desktop background, etc.) from ntuser .dat system files..."
	
	XCOPY %custom%\ntuser* %default%\ /H /Y

	echo. Done Copying Custom Settings
	call :dots
	EXIT /B

:dots
	REM just echoing dots in a Function instead of copy pasting them so that it's consistent
	echo ......................................................................
	EXIT /B

:funcHead
	REM A simple function for displaying a consistent header at the start of functions
	call :dots
	echo. %~1
	call :dots
	EXIT /B

So I finally figured this out.
In windows 10, Instead of using the copy to method in user profiles you gotta be a little trickier.

Customize the profile you want then login to a different admin account.
Now copy the only the appdata folders you need such as
roaming/mozilla for firefox customizations
local/Google for chrome customizations
local/Microsoft/Windows/Default Layouts
and
local/Microsoft/Tile Data Layer
for start menu pins
roaming/microsoft/internet explorer for task bar pins

And then once that’s all done, leaving the default profile as it was otherwise there’s one other thing to do to get the task bar settings and desktop background type settings to work. Which is all in the NTuser.dat type files. Just run this command in an administrator cmd

XCOPY C:\Users\CustomUser\ntuser* C:\Users\Default /H

It will ask if you want to overwrite, you do.

And then it works, a completely customized default profile without breaking any of the windows 10 metro apps.

@Wayne-Workman That would work, but I feel like it’s kind of a bandaid to the issue rather than a real fix. We didn’t have to reinstall php for every fog update before, why do we suddenly need to do it now? Granted I do like the idea of contributing something to the official fog code, even if it does get taken out later…

@Tom-Elliott said:

@Arrowhead-IT if you can would you be willing to test upload and download again for the resize and multipartition image types?

I will edit this post like before as I test each scenario.
If there is a scenario I’m missing here let me know and I’ll test that too.
I will try to be thorough as I can.

Download of existing image created from vm

Resizable (Windows 8.1) - Success! No Issues!

Resizable (Windows 10) - Success! No issues!

Multi-partition (Linux CentOS Ext4 and LVM) - Failed - New Error

I think this indicates a problem with the image file itself not the imaging process. I’ll reupload this one and test a different mps image in the meantime.
Edit Reuploaded the image, this is centOS vm that has no mbr apparently. So this is a different problem entirely related linux lvm images. normal mps images work fine

Multi-partition (Windows 7) - Success! Edit No Issues!
before
Note: Changing hostname said failed after imaging in debug mode.

Upload from nvme

Resizable (Windows 10 ) - retesting

Multi-partition -

Download of newly uploaded image from nvme

Resizable (Windows 8.1 ) - Failed - Could not find hard disk on system - getHardDisk function

Multi-partition

@Tom-Elliott It shall be done.

@Tom-Elliott @ManofValor
I’ve had this problem on a few of the trunks in the last week. So I’ve just put those commands into a bandaid fix type script and it works everytime it happens, like this morning for example. Said script is just the same commands with some echo’s and -y for automation, looks like this…

#!/bin/bash
echo "running autoremove to clean up apt..."
sudo apt-get autoremove --purge -y
echo "removing php files..."
sudo rm -rf /etc/php5
echo "removing ondrej sources from apt..."
sudo rm -rf /etc/apt-get/sources.d/*ondrej*
echo "uninstalling php5..."
sudo apt-get purge php5* -y
echo "cleaning up apt..."
sudo apt-get autoremove --purge -y
exit

Do we have any idea what is causing this or should I just add those commands to my update script reinstall php over and over and just not worry about it? Granted it doesn’t happen with every trunk, maybe 3 of them in the last week.

I wonder if it’s specific to a linux distro? I am running Ubuntu Server 14.04
@templink What version of Ubuntu are you running?
@ManofValor Assuming you’re having this problem too, what linux distro are you running?

I just finished working with @Tom-Elliott we got it working. It was a simple fix.
It’s in the latest fog update now. So nvme drives work with fog 100% now right out of the box. Awesome like a possum!

Everything is working for me now! hooray for the new inits!

@Tom-Elliott How might I test this hunch?

Sadly the resizable download doesn’t work on nvme drives. mps and mpa do work though.

@Arrowhead-IT ummmm, I just did another test to be more thorough and discovered a problem.
After mps successfully downloaded I tried downloading a resizable image and it failed to recreate the partition table.
Sorry for the false hope

I have returned from holiday and just tested out the latest inits.
All seems to be working perfectly.
Thanks for all the help!

@Wayne-Workman
Well it’s not technically a fog issue, but it is an imaging issue and I figured that my fellow image making peers might have some thoughts. I would love to see your documentation on that process

So I am working on a new windows 10 image and I’m making my default profile.
My method involves making a new profile with a name like “loading” (Because the name of the copied profile pops up briefly while a new user logs in the first time) and then customizing a profile to my heart’s content. Customizing things like desktop background, taskbar pins, adding a start menu toolbar with an organized programs menu. Making a customized start menu pin layout and various other things like bookmarks in browsers and such.

Once customized I go to regedit and navigate to hklm/software/microsoft/windowsNT/currentVersion/ProfileList
Then I edit the value of the default profile path to the path of the customized user.
Then I sign out and sign into an administrator account
Then I go to win+x then Y to get to the system properties and click the advanced settings button on the left.
I go to user profiles and select the default profile and hit “copy to”
I make sure “everyone” is permitted to use and then copy it to the C:\Users\Default.
Then I put the registry value of default profile path back to its default.
Then I copy a careful selection of files from the appdata/local folder of the customized profile to C:\Users\Default\AppData\Local
I haven’t fully documented what does and doesn’t break things in there, but it takes great care. But if I don’t do that I lose things like win+x or right clicking the start menu.

This method is actually easier than it sounds and I have had more success with it than with sysprep. Plus you can just copy your working default profile folder to a network drive to fix things later. This has worked for windows 7 and 8 and almost for 10.

Here’s the problem now.
On the original profile I copy from the cortana/start menu search is all configured and works as it should. But any new profile I make the search button/cortana button just does nothing. If you start typing with the start menu up, nothing. It is still possible to search if you open the search application from the shortcut here “C:\ProgramData\Microsoft\Windows\Start Menu\Programs” but nothing else brings up the search in the easy way that it should.

I’m still trying a few things and I’m sorry if that is more information than you needed. But I figured there was a chance to someone else out there is having this problem or maybe has been successful with a different method of making default profiles.

Please and thank you