Upload never gets moved out of the /images/dev/#### folder

[mobile_bob]

My setup:
Ubuntu 14.04 LTS
I have an external USB drive plugged in and mounted to /media/external with the entry in fstab
I have deleted the default storage node and added one called usb with the localhost ip address and the path /media/external
The fog user account on Linux was changed to a new password and that password was updated in both the storage entry and the TFTP setting. I also for good measure set the same password to the fog webpage account.

I finally got things working to a point, but when I do an image upload it goes to the /images/dev/{DeviceID} folder and stays there. The job seems complete and there are no errors. I have read many articles and have made sure that the folder is owned by fog and that chmod is 777. I have tested FTP with the fog user and it comes up just fine… Not sure where to go from here…

Also I don’t think related, I have to start dhcpd after each reboot and RESTART tftp each reboot for them both to work. (I assume it’s a separate issue and can open a different thread for them).

[Tom Elliott]

So often I have to ask, I think I know but I could be wrong. What version of fog?

https://wiki.fogproject.org/wiki/index.php?title=Troubleshoot_FTP
https://github.com/fogproject/fogproject/issues/1

[Sebastian Roth]

@mobile_bob I could be wrong but from what you describe I reckon that FTP is timing out when trying to delete the last image in /media/external/<imagename>. Is your external storage ext3 formated? How long does it take if you delete an image from the console time rm -rf /media/external/<imagename> (make sure you don’t delete an important image!)
As a quick test please make sure there is no current image in /media/external/<imagename> or /media/external/dev/<mac> for this particular host (either delete or rename folders). Then upload an image. Is it being moved? If yes, try another upload and I guess this time it won’t be moved, right?

[mobile_bob]

@Tom-Elliott Sorry, should have said, i’m using 1.2.0 The

[mobile_bob]

@Sebastian-Roth It was set to NTFS, I think that was my problem… I’m not great in Linux and I had set ownership to FOG, but it wasn’t taking and I hadn’t realized it. After following the FTP troubleshooting doc I formatted the USB drive to ext4 and successful set the ownership. I’m testing now.

[Sebastian Roth]

Great to hear! Thanks for reporting back.

[mobile_bob]

@Tom-Elliott Still testing the imaging problem, but the TFTP and DHCPD not starting is fixed thanks to the suggestions on the issue you referenced.

[mobile_bob]

For anyone that wants to know, my issue wasn’t quite fixed with formatting and changing the owner to fog. After I did all that I had to delete the storage node and recreate it.

[TThax]

I believe I have tried all of those troubleshooting steps as well. Mine still won’t move the images out of the dev folder. On a couple, I have just manually created the correct image folder and moved the image to that folder. But doing it that way, the fog server doesn’t think it has been uploaded, so the only way to deploy it is to do it through task manager > list all hosts > download. If you try to deploy it any other way, it says no image has been uploaded.

[Wayne Workman]

@TThax It’s an FTP issue - 95% of the time it’s because credentials are wrong. Look here for fixing it: https://wiki.fogproject.org/wiki/index.php?title=Troubleshoot_FTP

[TThax]

@Wayne-Workman I have tried that. FTP appears to be working. when I do ftp://[ip] it shows up fine. The credentials all seem to match. I have looked at the vsftpd.conf file and it looks correct. The firewall is disabled. I have done the chmod and chown steps. sda1 is ext4. Any other suggestions?

[Wayne Workman]

@TThax make sure you have /images/.mntcheck

Did you FTP from another computer?

[TThax]

@Wayne-Workman Ok, I don’t see that. How would I get that?

[Wayne Workman]

@TThax It’s a hidden file. Use CLI and issue the command ls -la /images to see hidden files there.

You will most likely have it, so I’ll go back to my other question - Did you try FTP from a computer besides the FOG server?

[TThax]

@Wayne-Workman Yes, I used chrome on this machine (windows 7) and did ftp://[ip] and it showed the Index of /. Attached is what my ls -laR images produces for the parent /images folder.

(/uploads/files/1452697396953-ls-lar.png)

[Wayne Workman]

@TThax Can you try to use windows CLI to log in via FTP ? There is an example here: https://wiki.fogproject.org/wiki/index.php?title=Troubleshoot_FTP#Try_to_get_a_file_with_Windows:

[TThax]

@Wayne-Workman The get and put commands both worked exactly as in the example.

[Wayne Workman]

@TThax I don’t want to leave any stone unturned here - did you FTP into the server using the credentials inside of Storage Management -> [node name] -> Username and Password?

Can you do a df -h to check how much free space you have on your server’s partitions? If you have enough, we will need to do a debug upload.

You can select a debug upload from the confirmation page. Then just boot up the host that’s going to do the upload.

Hit enter at the informational bits until you get to a Shell.

Type in the fog command. this will start the upload. Press [enter] at each part. At the very end of the upload, after the partclone screens, it should say something about “Moving image”.

At that point, hit Ctrl+C to end the script. We are working manually from here. at the shell, try to FTP into the server and move the folder yourself - using the credentials in FOG Storage -> [node name] -> Username and Password.

There are linux examples here, but not specific to what you’re doing: https://wiki.fogproject.org/wiki/index.php?title=Troubleshoot_FTP#Try_to_get_a_file_with_Linux:

You’ll look into the /images/dev folder. You will see a folder in there, it’s name will be the MAC address of the uploading computer. You’ll just issue the FTP command to move that folder to /images/YourImageName

See if the command succeeds or not. If not, don’t give up, it might be a syntax issue. Check for typos in your command.

[TThax]

@Wayne-Workman Sorry, hectic day here today. I won’t have another opportunity to do some of that until Monday (my next time to be at this location). Just to let you know I haven’t forgotten or ignored you.

[TThax]

@Wayne-Workman
Edited to say: Just for clarification, I am running Fog 1.2 on Ubuntu 14.04.

Ok, I checked, and the main partition has like 1.6TB available on it.

I tried to do the debug upload and here is what it does:

/bzImage... ok
/init.xz... ok
Starting logging: OK
Populating /dev using udev: udevd[2177]: error creating epoll fd: Function not implemented
done
Initializing random number generator... done.
Starting network...
ip: RTNETLINK answers: File exists
[root@10 /]#

It is there I typed in "fog" and hit enter. Then it does this:

##################################
#   An error has been detected!  #
##################################

Fatal Error: Unknown request type :: Null

##################################
#Computer will reboot in 1 minute #
##################################