• Recent
    • Unsolved
    • Tags
    • Popular
    • Users
    • Groups
    • Search
    • Register
    • Login

    Upload never gets moved out of the /images/dev/#### folder

    Scheduled Pinned Locked Moved Solved
    FOG Problems
    5
    44
    22.1k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • M
      mobile_bob
      last edited by

      My setup:
      Ubuntu 14.04 LTS
      I have an external USB drive plugged in and mounted to /media/external with the entry in fstab
      I have deleted the default storage node and added one called usb with the localhost ip address and the path /media/external
      The fog user account on Linux was changed to a new password and that password was updated in both the storage entry and the TFTP setting. I also for good measure set the same password to the fog webpage account.

      I finally got things working to a point, but when I do an image upload it goes to the /images/dev/{DeviceID} folder and stays there. The job seems complete and there are no errors. I have read many articles and have made sure that the folder is owned by fog and that chmod is 777. I have tested FTP with the fog user and it comes up just fine… Not sure where to go from here…

      Also I don’t think related, I have to start dhcpd after each reboot and RESTART tftp each reboot for them both to work. (I assume it’s a separate issue and can open a different thread for them).

      1 Reply Last reply Reply Quote 0
      • Tom ElliottT
        Tom Elliott
        last edited by Tom Elliott

        So often I have to ask, I think I know but I could be wrong. What version of fog?

        https://wiki.fogproject.org/wiki/index.php?title=Troubleshoot_FTP
        https://github.com/fogproject/fogproject/issues/1

        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

        Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

        Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

        M 1 Reply Last reply Reply Quote 1
        • S
          Sebastian Roth Moderator
          last edited by Sebastian Roth

          @mobile_bob I could be wrong but from what you describe I reckon that FTP is timing out when trying to delete the last image in /media/external/<imagename>. Is your external storage ext3 formated? How long does it take if you delete an image from the console time rm -rf /media/external/<imagename> (make sure you don’t delete an important image!)
          As a quick test please make sure there is no current image in /media/external/<imagename> or /media/external/dev/<mac> for this particular host (either delete or rename folders). Then upload an image. Is it being moved? If yes, try another upload and I guess this time it won’t be moved, right?

          Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

          Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

          M 2 Replies Last reply Reply Quote 0
          • M
            mobile_bob @Sebastian Roth
            last edited by

            @Tom-Elliott Sorry, should have said, i’m using 1.2.0 The

            1 Reply Last reply Reply Quote 0
            • M
              mobile_bob @Sebastian Roth
              last edited by

              @Sebastian-Roth It was set to NTFS, I think that was my problem… I’m not great in Linux and I had set ownership to FOG, but it wasn’t taking and I hadn’t realized it. After following the FTP troubleshooting doc I formatted the USB drive to ext4 and successful set the ownership. I’m testing now.

              1 Reply Last reply Reply Quote 0
              • S
                Sebastian Roth Moderator
                last edited by

                Great to hear! Thanks for reporting back.

                Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                1 Reply Last reply Reply Quote 0
                • M
                  mobile_bob @Tom Elliott
                  last edited by

                  @Tom-Elliott Still testing the imaging problem, but the TFTP and DHCPD not starting is fixed thanks to the suggestions on the issue you referenced.

                  1 Reply Last reply Reply Quote 0
                  • M
                    mobile_bob
                    last edited by

                    For anyone that wants to know, my issue wasn’t quite fixed with formatting and changing the owner to fog. After I did all that I had to delete the storage node and recreate it.

                    1 Reply Last reply Reply Quote 0
                    • T
                      TThax
                      last edited by

                      I believe I have tried all of those troubleshooting steps as well. Mine still won’t move the images out of the dev folder. On a couple, I have just manually created the correct image folder and moved the image to that folder. But doing it that way, the fog server doesn’t think it has been uploaded, so the only way to deploy it is to do it through task manager > list all hosts > download. If you try to deploy it any other way, it says no image has been uploaded.

                      Wayne WorkmanW 1 Reply Last reply Reply Quote 0
                      • Wayne WorkmanW
                        Wayne Workman @TThax
                        last edited by

                        @TThax It’s an FTP issue - 95% of the time it’s because credentials are wrong. Look here for fixing it: https://wiki.fogproject.org/wiki/index.php?title=Troubleshoot_FTP

                        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                        Daily Clean Installation Results:
                        https://fogtesting.fogproject.us/
                        FOG Reporting:
                        https://fog-external-reporting-results.fogproject.us/

                        T 1 Reply Last reply Reply Quote 0
                        • T
                          TThax @Wayne Workman
                          last edited by

                          @Wayne-Workman I have tried that. FTP appears to be working. when I do ftp://[ip] it shows up fine. The credentials all seem to match. I have looked at the vsftpd.conf file and it looks correct. The firewall is disabled. I have done the chmod and chown steps. sda1 is ext4. Any other suggestions?

                          Wayne WorkmanW 1 Reply Last reply Reply Quote 0
                          • Wayne WorkmanW
                            Wayne Workman @TThax
                            last edited by

                            @TThax make sure you have /images/.mntcheck

                            Did you FTP from another computer?

                            Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                            Daily Clean Installation Results:
                            https://fogtesting.fogproject.us/
                            FOG Reporting:
                            https://fog-external-reporting-results.fogproject.us/

                            T 1 Reply Last reply Reply Quote 0
                            • T
                              TThax @Wayne Workman
                              last edited by

                              @Wayne-Workman Ok, I don’t see that. How would I get that?

                              Wayne WorkmanW 1 Reply Last reply Reply Quote 0
                              • Wayne WorkmanW
                                Wayne Workman @TThax
                                last edited by

                                @TThax It’s a hidden file. Use CLI and issue the command ls -la /images to see hidden files there.

                                You will most likely have it, so I’ll go back to my other question - Did you try FTP from a computer besides the FOG server?

                                Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                                Daily Clean Installation Results:
                                https://fogtesting.fogproject.us/
                                FOG Reporting:
                                https://fog-external-reporting-results.fogproject.us/

                                T 1 Reply Last reply Reply Quote 0
                                • T
                                  TThax @Wayne Workman
                                  last edited by

                                  @Wayne-Workman Yes, I used chrome on this machine (windows 7) and did ftp://[ip] and it showed the Index of /. Attached is what my ls -laR images produces for the parent /images folder.

                                  (/uploads/files/1452697396953-ls-lar.png)

                                  Wayne WorkmanW 1 Reply Last reply Reply Quote 0
                                  • Wayne WorkmanW
                                    Wayne Workman @TThax
                                    last edited by

                                    @TThax Can you try to use windows CLI to log in via FTP ? There is an example here: https://wiki.fogproject.org/wiki/index.php?title=Troubleshoot_FTP#Try_to_get_a_file_with_Windows:

                                    Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                                    Daily Clean Installation Results:
                                    https://fogtesting.fogproject.us/
                                    FOG Reporting:
                                    https://fog-external-reporting-results.fogproject.us/

                                    T 1 Reply Last reply Reply Quote 0
                                    • T
                                      TThax @Wayne Workman
                                      last edited by

                                      @Wayne-Workman The get and put commands both worked exactly as in the example.

                                      Wayne WorkmanW 1 Reply Last reply Reply Quote 0
                                      • Wayne WorkmanW
                                        Wayne Workman @TThax
                                        last edited by

                                        @TThax I don’t want to leave any stone unturned here - did you FTP into the server using the credentials inside of Storage Management -> [node name] -> Username and Password?

                                        Can you do a df -h to check how much free space you have on your server’s partitions? If you have enough, we will need to do a debug upload.

                                        You can select a debug upload from the confirmation page. Then just boot up the host that’s going to do the upload.

                                        Hit enter at the informational bits until you get to a Shell.

                                        Type in the fog command. this will start the upload. Press [enter] at each part. At the very end of the upload, after the partclone screens, it should say something about “Moving image”.

                                        At that point, hit Ctrl+C to end the script. We are working manually from here. at the shell, try to FTP into the server and move the folder yourself - using the credentials in FOG Storage -> [node name] -> Username and Password.

                                        There are linux examples here, but not specific to what you’re doing: https://wiki.fogproject.org/wiki/index.php?title=Troubleshoot_FTP#Try_to_get_a_file_with_Linux:

                                        You’ll look into the /images/dev folder. You will see a folder in there, it’s name will be the MAC address of the uploading computer. You’ll just issue the FTP command to move that folder to /images/YourImageName

                                        See if the command succeeds or not. If not, don’t give up, it might be a syntax issue. Check for typos in your command.

                                        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                                        Daily Clean Installation Results:
                                        https://fogtesting.fogproject.us/
                                        FOG Reporting:
                                        https://fog-external-reporting-results.fogproject.us/

                                        T 2 Replies Last reply Reply Quote 0
                                        • T
                                          TThax @Wayne Workman
                                          last edited by

                                          @Wayne-Workman Sorry, hectic day here today. I won’t have another opportunity to do some of that until Monday (my next time to be at this location). Just to let you know I haven’t forgotten or ignored you.

                                          1 Reply Last reply Reply Quote 0
                                          • T
                                            TThax @Wayne Workman
                                            last edited by TThax

                                            @Wayne-Workman
                                            Edited to say: Just for clarification, I am running Fog 1.2 on Ubuntu 14.04.

                                            Ok, I checked, and the main partition has like 1.6TB available on it.

                                            I tried to do the debug upload and here is what it does:

                                            /bzImage... ok
                                            /init.xz... ok
                                            Starting logging: OK
                                            Populating /dev using udev: udevd[2177]: error creating epoll fd: Function not implemented
                                            done
                                            Initializing random number generator... done.
                                            Starting network...
                                            ip: RTNETLINK answers: File exists
                                            [root@10 /]#
                                            
                                            It is there I typed in "fog" and hit enter. Then it does this:
                                            
                                            ##################################
                                            #   An error has been detected!  #
                                            ##################################
                                            
                                            Fatal Error: Unknown request type :: Null
                                            
                                            ##################################
                                            #Computer will reboot in 1 minute #
                                            ##################################
                                            
                                            Tom ElliottT 1 Reply Last reply Reply Quote 0
                                            • 1
                                            • 2
                                            • 3
                                            • 1 / 3
                                            • First post
                                              Last post

                                            204

                                            Online

                                            12.0k

                                            Users

                                            17.3k

                                            Topics

                                            155.2k

                                            Posts
                                            Copyright © 2012-2024 FOG Project