How to create subfolders in a storage node

[sdm42doc]

Has anyone had any luck with directories under /images.

I mounted another volume (for more storage) under /images to try to force it and no luck.

I thought you could have multiple storage nodes on the same server with additional hard drives at one point. I have been a “fog user” since the beginning, and thought for sure i had this setup before.

I am on Ubuntu 16.04.02 with current version of FOG 1.4.0.

[george1421]

@sdm42doc No joy for you, subfolders are still not supported.

Now you do have some options.

1. If your server uses LVM, just add the additional space to the LVM volume where the /images are.
2. Temp mount the new volume over another directory, move the contents of /images to the new volume via the mount point, disconnect the mount point and mount it over /images

There are some other ways to extend it but it then gets a bit messy.

[george1421]

Just circling back on this after I talked with the developers. That sub directory functionality WAS added to FOG 1.4.0. I was wrong before. You can create subfolders in the /images directory something (as seen below). Once you set your image name you can alter the image path field. Understand there is ONE caveat here, as in my example the /images/myfolder directory MUST exist before you create this image definition. If not your capture will fail.

In your case the /images/myfolder (or what ever you call it) will be a mount point for your new disk volume.

[sdm42doc]

@george1421 Thank you. I actually got the subfolders to work. I had to manually create the folder, set rights, and it works inside /images. However, my latest thoughts, I want to add hard drive space outside of LVM to /images. So I set a mount point with the proper rights to /images/vol1, vol1 being the new mount point of a hard drive. The image looks like it goes up no issues, until the end, the system won’t copy the images from /dev over to /vol1. I tried creating this as a storage group /images/vol1, and a fake directory if you will concept and I have no luck. In the past, couldn’t you have more HD in the server for storage nodes, or am I dreaming about this. I have spent two days, trying to figure this out, its now a challenge to see if it works. Take care, thank you for the response.

[george1421]

@sdm42doc Just for clarity what I posted below didn’t work for your setup?

If not can you provide the output of these commands

1. df -h
2. showmount -e 127.0.0.1

I talked with the developers for quite a while and they were positive it would work as I outlined.

If you setup a storage node route, you need to duplicate the /images base structure below on the new volume. I won’t probably have time tonight to test this in my dev environment but I will get to it tomorrow night.

[sdm42doc]

@george1421 attached is the screen shot from the fog box.

I also replicated all of the interiors of the files as outlined, copying the /dev/ files to the vol1/ ect.

On upload, it looks like all is well, the image is going to /images/dev/(mac address of machine) then on the final write, it fails, as attached.

I am going to try to recreate this issue in my home lab tonight.

[george1421]

@sdm42doc This looks like you might have a storage node configuration still in place. If you look at your last image its using the /image as the root, but the error messages in the next from the bottom its trying to move the file from /images/vol1/dev (but the image is in /images/dev).

The first picture shows that you have the right shares in place for the secondary nodes.

[Wayne Workman]

I didn’t read the whole thread, just the title. Another guy tried doing this but it ended up not working, I told him to undo it.

[sdm42doc]

So I tried it on my home lab, and have no good results. I don’t think it is going to work.

The uploads go up to /images/dev then only move the image name with 0MB to the /images/vol1/ folder, the other files stay in /images/dev/0050569fb7e7 d1p1.img, ect. but it looks like the image completed with no errors.

[george1421]

@sdm42doc

So I tried it on my home lab, and have no good results. I don’t think it is going to work.

If we can trap the error we can get it fixed, so don’t give up hope on this.

Just for clarity you created the vol1 in images before you imaged the computer? (this is was a sticking point during my discussion with the devs). I’ve got 1.4.0 setup in my home lab, let me see if I can duplicate your results.

[george1421]

@george1421 Well I have sad news, it worked for me.

All I did was create a directory under /images (called vol1). The path was /images/vol1 I did change the owner to fog.root Then I setup a new image and set the path to vol1/WIn7Test and then assigned that image to a virtual box VM I have. It captured the image correctly and moved it to the /images/vol1/Win7Test directory correctly.

[sdm42doc]

@george1421 is your vol1 a directory in the /images or a separate hard drive. Mine is a separate hard drive /dev/sdb mounted to /images/vol1 when i made a directory, your right it did work fine. just not a directory mounted

[george1421]

@sdm42doc Yes it was a directory, but that should work the same as the mount point for a hard drive.

Are the permissions set correctly on that mount point after its mounted?

[george1421]

@sdm42doc We can test without imaging easy

Mount up that new drive to the vol1 mount point under /images

Then from an external computer ftp to the fog server using the user ID and password that is defined in the /opt/fog/.fogsettings file.

Navigate to the /images/vol1 directory and make a directory using the ftp client (like from a ms windows box). If you can make the directory then imaging should work. That is what the FOS engine does. It captures the image to /images/dev/<mac_address> then when done it moves the files using FTP to /images/<image_name>

[sdm42doc]

@george1421 I believe I have the rights correct, as attached, maybe you will see something I missed. I appreciate all your help!

[george1421]

@sdm42doc you have them correct. Did you try with the external ftp client yet?

I’d like to duplicate this with my home lab, but my esxi server is down with a failed power supply (one is on its way from amazon). All I have right now is my FOG-Pi server so I can’t really add a second drive to that to duplicate what you are seeing.

[sdm42doc]

@george1421 I can walk around and upload files from my desktop, create directories, ect all through that HD marked vol1 logged in as fog through ftp.

[george1421]

@sdm42doc (thinking out loud) Yet imaging fails with the error screens you posted…

FTP works, can navigate to, can create directories
permissions are set correctly
captured images going to /images/dev/<mac_name> but not being moved to /images/vol1/<image_name>
Using Ubuntu 16.04.02 with current version of FOG 1.4.0
Works with /images/vol1 as a directory not as mounted volume
== should be working
…

[sdm42doc]

@george1421 this is one of those weeks, my testing was as follows

1> physical hardware rack fog server with raid controller mirror raid with volumes / and /vol1 ubuntu 16.04.02 fog 1.4.0
2> esxi hosted fog server with two volumes / and /vol1 ubuntu 16.04.02 fog 1.4.0

tomorrow, I am going to do a fresh install on esxi, and test it accordingly and try to triplicate it and I will report back.

[george1421]

@sdm42doc Are you getting the same error as in this post with your home kit where you didn’t try to setup the storage node bits?
https://forums.fogproject.org/topic/9456/how-to-create-subfolders-in-a-storage-node/19

I can/will also duplicate with our dev lab at the office tomorrow. I can more closely emulate what you have with that environment.