Upload only works in DD mode. Please Help!



  • Hello world,

    I built a fog server for work and I am only able to get images to upload when the image is set to dd mode via the debug upload. Obviously this is taking a life time.

    All other image options loop at various points.

    Attempting to auto-register/quick upload/ any menu options from clients just loops.

    fog server:
    Ubuntu 14.* server
    fog version 1.2

    client:
    hp probook 450

    This thread [url]http://fogproject.org/forum/threads/deploy-problem-unable-to-locate-image-store.11941/[/url] is roughly what I see when attempting to upload an image with any other options.

    Any thoughts?

    Basics: Please provide:
    FOG Version (e.g. FOG 0.32, FOG 0.33, FOG 0.01) 1.2
    OS Version (e.g. CentOS 6.5, Ubuntu 12.04, Redhat 6.5) Ubuntu 14.04.1

    Can you provide your installation details?
    This is now included as a long file in 1.1.0 in location /var/log/foginstall.log

    Here are the settings FOG will use:
    Base Linux: Debian
    Detected Linux Distribution: Ubuntu
    Installation Type: Normal Server
    Server IP Address: 172.17.1.5
    DHCP router Address:
    DHCP DNS Address:
    Interface: eth0
    Using FOG DHCP: 1
    Internationalization: 0
    Donate: 0

    Have you checked your apache error logs? Can you provide information from these logs?
    [Wed Nov 26 08:31:03.925437 2014] [:error] [pid 13094] [client 172.17.1.10:48256] PHP Fatal error: Uncaught exception ‘Exception’ with message ‘Image is not valid’ in /var/www/fog/lib/fog/Host.class.php:968\nStack trace:\n#0 /var/www/fog/lib/fog/BootMenu.class.php(371): Host->createImagePackage(1, ‘AutoRegTask’, false, false, true, false, ‘mcoers’)\n#1 /var/www/fog/lib/fog/BootMenu.class.php(343): BootMenu->setTasking()\n#2 /var/www/fog/lib/fog/BootMenu.class.php(146): BootMenu->verifyCreds()\n#3 /var/www/fog/service/ipxe/boot.php(14): BootMenu->__construct(Object(Host))\n#4 {main}\n thrown in /var/www/fog/lib/fog/Host.class.php on line 968
    [Wed Nov 26 08:31:09.412399 2014] [:error] [pid 13097] [client 172.17.1.10:51325] PHP Fatal error: Uncaught exception ‘Exception’ with message ‘Image is not valid’ in /var/www/fog/lib/fog/Host.class.php:968\nStack trace:\n#0 /var/www/fog/lib/fog/BootMenu.class.php(371): Host->createImagePackage(1, ‘AutoRegTask’, false, false, true, false, ‘mcoers’)\n#1 /var/www/fog/lib/fog/BootMenu.class.php(343): BootMenu->setTasking()\n#2 /var/www/fog/lib/fog/BootMenu.class.php(146): BootMenu->verifyCreds()\n#3 /var/www/fog/service/ipxe/boot.php(14): BootMenu->__construct(Object(Host))\n#4 {main}\n thrown in /var/www/fog/lib/fog/Host.class.php on line 968
    [Wed Nov 26 08:36:02.925270 2014] [:error] [pid 1648] [client 172.17.1.10:5767] PHP Fatal error: Uncaught exception ‘Exception’ with message ‘Image is not valid’ in /var/www/fog/lib/fog/Host.class.php:968\nStack trace:\n#0 /var/www/fog/lib/fog/BootMenu.class.php(371): Host->createImagePackage(1, ‘AutoRegTask’, false, false, true, false, ‘mcoers’)\n#1 /var/www/fog/lib/fog/BootMenu.class.php(343): BootMenu->setTasking()\n#2 /var/www/fog/lib/fog/BootMenu.class.php(146): BootMenu->verifyCreds()\n#3 /var/www/fog/service/ipxe/boot.php(14): BootMenu->__construct(Object(Host))\n#4 {main}\n thrown in /var/www/fog/lib/fog/Host.class.php on line 968
    [Wed Nov 26 08:40:27.935848 2014] [:error] [pid 13093] [client 172.17.1.10:49542] PHP Fatal error: Uncaught exception ‘Exception’ with message ‘Image is not valid’ in /var/www/fog/lib/fog/Host.class.php:968\nStack trace:\n#0 /var/www/fog/lib/fog/BootMenu.class.php(371): Host->createImagePackage(1, ‘AutoRegTask’, false, false, true, false, ‘mcoers’)\n#1 /var/www/fog/lib/fog/BootMenu.class.php(343): BootMenu->setTasking()\n#2 /var/www/fog/lib/fog/BootMenu.class.php(146): BootMenu->verifyCreds()\n#3 /var/www/fog/service/ipxe/boot.php(14): BootMenu->__construct(Object(Host))\n#4 {main}\n thrown in /var/www/fog/lib/fog/Host.class.php on line 968
    [Wed Nov 26 08:51:44.037493 2014] [:error] [pid 1648] [client 172.17.1.10:57677] PHP Fatal error: Uncaught exception ‘Exception’ with message ‘Image is not valid’ in /var/www/fog/lib/fog/Host.class.php:968\nStack trace:\n#0 /var/www/fog/lib/fog/BootMenu.class.php(371): Host->createImagePackage(1, ‘AutoRegTask’, false, false, true, false, ‘mcoers’)\n#1 /var/www/fog/lib/fog/BootMenu.class.php(343): BootMenu->setTasking()\n#2 /var/www/fog/lib/fog/BootMenu.class.php(146): BootMenu->verifyCreds()\n#3 /var/www/fog/service/ipxe/boot.php(14): BootMenu->__construct(Object(Host))\n#4 {main}\n thrown in /var/www/fog/lib/fog/Host.class.php on line 968
    [Wed Nov 26 08:54:15.695129 2014] [:error] [pid 14650] [client 172.18.1.2:53239] PHP Warning: array_filter() expects parameter 1 to be array, null given in /var/www/fog/lib/pages/GroupManagementPage.class.php on line 252, referer: [url]http://172.17.1.5/fog/management/index.php?node=group&sub=add[/url]
    [Wed Nov 26 08:55:00.168791 2014] [:error] [pid 1582] [client 172.18.1.2:53241] PHP Warning: array_filter() expects parameter 1 to be array, null given in /var/www/fog/lib/pages/GroupManagementPage.class.php on line 252, referer: [url]http://172.17.1.5/fog/management/index.php?node=group&sub=edit&id=1[/url]
    Debian based Location (normally)
    /var/log/apache2/error.log
    Redhat based Location (normally)
    /var/log/httpd/error_log

    Have you searched the forums for your issue yet? Yes

    Have you checked the [URL=‘http://fogproject.org/wiki’]wiki[/URL] yet? Just found it reading now.

    Kernel Issues: [url]http://fogproject.org/wiki/index.php/FAQ[/url]

    Ey3



  • Update. Client will now boot successfully after running the startup repair utility from the windows 7 install disk.

    o_O

    Ey3



  • I did not attempt an update to the SVN version. I can if you think that will work better.

    I was thinking about trying to use a rescue disk to write the MBR. Any thoughts?

    Ey3


  • Developer

    are you still running the same version of fog, or did you upgrade to the SVN version?
    if you installed an SVN version, please report exactly what one. it will be in the cloud on the fog web gui in place of the version number.



  • Results of fixparts /dev/sda:

    loading MBR data from /dev/sda

    unable to read MBR data from ‘/dev/sda’! exiting!

    This was on an image download task (On the client I just imaged from the dd image taken in the OP)

    Ey3



  • So I attempted to download the image I took last week and the system is now saying:

    BootDevice not found

    please install an operating system on your hard disk.

    hard disk -(3f0)

    f2 system diagnostics

    for more information, please visit: [url=“http://www.hp.com\go\techcenter\startup”]www.hp.com\go\techcenter\startup[/url]

    Running the diagnostics the hard drive is seen by the bios.

    Configuration for download:
    host management --> list all hosts --> click on down arrow --> select “[COLOR=#333333][FONT=Trebuchet MS][/FONT][/COLOR][FONT=Ubuntu][COLOR=#555555]Schedule [U]Instant Deployment”[/U] --> reboot box[/COLOR][/FONT]

    client comes up and goes through PXE then pulls down the linux image and runs the imaging.

    client reboots and complains that it cannot see an OS on the hard drive

    I am pulling down a linux image right now to take a look at the disk and make sure that something was actually written. Any ideas would be greatly helpful.

    Ey3


  • Developer

    [url]http://fogproject.org/wiki/index.php/SVN[/url]
    this is the developer’s work in progress. it is pre-release. it might be buggy. it is not recommended for a production environment.
    use at your own risk. you have been warned.
    if you choose to use it, please report any problems, and thank you for beta-testing.



  • [quote=“Tom Elliott, post: 39408, member: 7271”]I have another step for you to try.

    Put the image type back to how you want it: (resizable, multipart, whatever)

    Recreate your tasking, but make it a debug task. In the Basic Tasks Options click Advanced Options. Look for Upload - Debug.

    When the system boots, it will get you to a terminal. Run the command fixparts /dev/sda

    It should ask you a few questions. My suspicion is it’s trying to create a “legacy - mbr” file, but there’s still GPT structures on the disk. So it can’t structure the partition prepared for this.

    This is just my guess, I really don’t know at this point. If nothing else, would you be willing to try imaging using SVN?[/quote]

    That sounds like a very likely cause given the behavior I have seen.

    I will test after the holidays and include the results with the other tests you requested.

    I’d be down for testing with SVN, do you have any instructions?

    Ey3


  • Senior Developer

    I have another step for you to try.

    Put the image type back to how you want it: (resizable, multipart, whatever)

    Recreate your tasking, but make it a debug task. In the Basic Tasks Options click Advanced Options. Look for Upload - Debug.

    When the system boots, it will get you to a terminal. Run the command fixparts /dev/sda

    It should ask you a few questions. My suspicion is it’s trying to create a “legacy - mbr” file, but there’s still GPT structures on the disk. So it can’t structure the partition prepared for this.

    This is just my guess, I really don’t know at this point. If nothing else, would you be willing to try imaging using SVN?



  • Sure, I will take a video of all the failure scenarios after the holidays. I have it uploading now, and need to get an image up and show some progress.

    Ey3


  • Senior Developer

    Can you get us videos of the “other imaging types” that are failing?



  • Below are the only config options that actually do anything.

    Ey3

    [url="/_imported_xf_attachments/1/1521_Screen Shot 2014-11-26 at 11.33.02 AM.png?:"]Screen Shot 2014-11-26 at 11.33.02 AM.png[/url][url="/_imported_xf_attachments/1/1522_Screen Shot 2014-11-26 at 11.33.24 AM.png?:"]Screen Shot 2014-11-26 at 11.33.24 AM.png[/url][url="/_imported_xf_attachments/1/1523_Screen Shot 2014-11-26 at 11.33.56 AM.png?:"]Screen Shot 2014-11-26 at 11.33.56 AM.png[/url]



  • Indeed, I can assign a blank image. That is how I am specifying the dd copy method.

    If I assign it to simply upload (with any method) after the pxe boot to the menu the system will loop back to the menu regardless of option chosen. If I do debug upload, the task management works, and it will report to the server that it ran the task then loop back to the shell. If I do debug upload with the dd method selected for the image it will actually do something. It starts uploading.

    This is the first image I am uploading.

    Some more info on configuration:
    Client and server are on a dedicated switch behind a firewall. Communication between client and server goes straight through the switch, management traffic goes across the firewall.

    Thank you in advance for the help.

    Ey3


  • Senior Developer

    Can you assign an image to the host you’re having this issue with?



  • OP modified to call it out better.

    Ey3


  • Senior Developer

    What version of FOG? Not your Server, but what actual version of fog? From the cloud icon.


Log in to reply
 

535
Online

39007
Users

10720
Topics

101798
Posts

Looks like your connection to FOG Project was lost, please wait while we try to reconnect.