• Recent
    • Unsolved
    • Tags
    • Popular
    • Users
    • Groups
    • Search
    • Register
    • Login

    Capone and Multicasting not possible?

    Scheduled Pinned Locked Moved
    FOG Problems
    5
    44
    15.0k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • G
      guscrown
      last edited by

      I think Capone and a decent Gigabit switch should be OK. I will limit my imaging to 8 hosts at a time. Thanks, Tom. I’ll make sure to get you a six pack of beer.

      1 Reply Last reply Reply Quote 0
      • Tom ElliottT
        Tom Elliott
        last edited by

        I’m looking up frisbee software to see if I can use any of their source code to help you out, but don’t expect any miracles.

        Capone is quite capable of doing what you need, even if it doesn’t support multicast.

        I really don’t want to try playing with multicast on the capone side as it’s one of my (personally) most hated features (multicast that is)

        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

        Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

        Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

        1 Reply Last reply Reply Quote 0
        • G
          guscrown
          last edited by

          I will also talk to the Software guys about their server and how it actually performs that function that I explained (ie. starting from the current multicast stage, and then finishing up on the second loop). It’s a nice little feature to have.

          Say you have 30 hosts to image, and initially 5 come on simultaneously.

          Image multicast Loop #1: Image Host 1, 2, 3, 4 , 5
          Half way through, hosts 6-14 join, and they only have 50% of the image (the second half).
          Image multicast Loop #2: Image Host 6,14
          Half way through this loop, the rest of the hosts join
          Image multicast loop #3: Image the remaining hosts.

          Now, this is assuming they all join simultaneously. Which might not happen. With the wait of 1 minute, you might get as many as you can at the same time.

          The problem now is that if a host joined after the multicast session it will remain there idling indefinitely.

          1 Reply Last reply Reply Quote 0
          • Tom ElliottT
            Tom Elliott
            last edited by

            I understand, but let me try explaining what happens in our system which could lead to potential troubleshooting ideas.

            FOG Is an imaging solution designed to take an image from a system and put that image back onto other systems. (We all know this but I think it’s good to re-clarify sometimes.) This is all wrapped together by a Web based GUI to control the process(s).

            The way it works, from a very basic level.

            Take an image from a (registered) system.

            Register a new system.

            Register that system.

            Assign that new system an image.

            Perform imaging task as needed.

            In the case of “bypass” or “capone”

            It works as such:

            Take an image from a (registered) system.)

            (in capone methods)
            get the dmi valued item and test against database, if they match, get the image associated for that match (or present option incase multiple images match the value needed.)
            (in bypass methods)
            image the system using the selected image association information.

            You’ll notice in both of those methods, the downloading system doesn’t have registering.

            In the new case of multicast session joining (registered or not) this is not in play at all.

            Basically, you create the session. There’s no knowledge of the system. As PHP/HTML is limited in what it can access and start, we create what’s known as subshells. These subshells call the system and invoke the start of the required broadcasts on a loop system (which is also a php script).

            It’s because of this that you’re seeing the hanging.

            Basically, when it starts the multicast broadcast, the server starts the program udp-sender, but it’s in what I call a “chained” command system.

            So on the server after the session has started, you might see a command running in the likes of:

            udp-sender max-clients blah filename.img blah port blah;udp-sender max-clients blah filename2.img blah port blah; more blah possibly here

            All in one line.

            What these chained commands do is:
            run the first command, once that’s all done (regardless of failure or success), run the second command, once all done (regardless of failure or success) run this command, and so on until all the commands are complete.

            Using this model works, and works well, but there’s no real way under the processes of udp to know what client is where and when it received a specific subset of data. The closest we have is the progress of the tasking (registered hosts only) which only tell us how far partclone is in the process not which udp packet it’s receiving.

            Hopefully this helps understanding of what’s going on and why things might hang.

            Probably would be helpful to explain how the client get’s the data also, to understand why the hanging is more than likely occurring.

            When the client boots, it’s given a series of kernel arguments some of which we can call on in our scripts as variables to know what’s going on and what needs to run. The variables these clients get are things like the image, format, type, partition, if multicast is to be used, and the port mc is needing.

            The client then boots, runs through partition layout setup, and after partitions are done, it sets up the udp-receiver to get the data. It has no clue what’s happening and isn’t the reason for the failure…directly. All it does is make the connection to the udp-sender on the server. Once it connects it waits until the sender is sending the command. partclone may be in a “waiting state” because of this because the sender potentially hasn’t started the tasking yet.

            Where the problem lies, is partclone is just waiting. If the previous command has run, the client has no clue, so it’s potentially possible for /dev/sda1 to try receiving the data of /dev/sda2.

            However, what’s hanging is partclone can’t actually do anything with the data as it’s waiting for the data to populate for the particular partition. This is kind of a good thing, though a PITA I’ll admit.

            Now hopefully it helps explain things a little bit?

            Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

            Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

            Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

            1 Reply Last reply Reply Quote 0
            • G
              guscrown
              last edited by

              Thanks for the explanation, Tom. Makes much more sense now. So yes, implementing that functionality from Frisbee would be a complicated mod.

              1 Reply Last reply Reply Quote 0
              • T
                TheKoR
                last edited by

                We use capone all day long, and we can image 20/30 computers at the same time with 10Go images, in 3 min !!!

                (always sorry for bad sentences) ^^

                Ubuntu 13.10 - Fog 1.3.0
                XEON E5630 - 16 Go - 6To raid 5
                Best download : 22Go in 23 sec
                Avg rate : 4.5G/min on 20 unicasts at same time

                1 Reply Last reply Reply Quote 0
                • G
                  guscrown
                  last edited by

                  [quote=“TheKoR, post: 39052, member: 24285”]We use capone all day long, and we can image 20/30 computers at the same time with 10Go images, in 3 min !!!

                  (always sorry for bad sentences) ^^[/quote]

                  Can I ask about your setup? Are the images stored on the same location as your Fog Server? What switches are you using?

                  1 Reply Last reply Reply Quote 0
                  • T
                    TheKoR
                    last edited by

                    server : Lenovo S20 Thinkstation, 8GB, dual GB ethernet card (loadbalancing) Ubuntu 12.04 - Fog 1.2.0
                    one raid1 160 GB velociraptor Fog system
                    second raid1 3TB 7200tr/min Storage

                    Switch : All 4806W + 2 AT-GS924GB all connected with fiber link

                    Ubuntu 13.10 - Fog 1.3.0
                    XEON E5630 - 16 Go - 6To raid 5
                    Best download : 22Go in 23 sec
                    Avg rate : 4.5G/min on 20 unicasts at same time

                    1 Reply Last reply Reply Quote 0
                    • S
                      serpele
                      last edited by

                      [quote=“Tom Elliott, post: 38999, member: 7271”]I’m afraid you’re stuck being afraid for now?

                      I’m not trying to sound rude or crude, but some of these things are set in such a manner for some semblance of security. You could play with the source code to have it work for you.

                      First you’d needed to edit the FOGConfigurationPage ‘disabled’ part on pxe setting function. You’d make line 278 of the file /var/www/fog/lib/pages/FOGConfigurationPage.class.php from:
                      [php]‘disabled’ => $menuid ? ‘readonly=“true”’ : ‘’,[/php]
                      TO:
                      [php]‘disaabled’ => ‘’,[/php]

                      Then you’d edit BootMenu.class.php to move the $_REQUEST[‘sessionJoin’] settings on lines: 572 and 573 to right under line 159.

                      Then you edit on the GUI side (fog.multijoin) and remove the lines stating:
                      [code]login[/code]
                      [code]param username ${username}[/code]
                      [code]param password ${password}[/code]

                      That should remove authentication from the mix. That said, I’d highly recommend against it.[/quote]

                      [LEFT]I am newbie[/LEFT]

                      Help Please To be changed so that the multicast launch a task not ask password and session
                      [LEFT]
                      [/LEFT]

                      1 Reply Last reply Reply Quote 0
                      • Tom ElliottT
                        Tom Elliott
                        last edited by

                        What do you mean? There’s already descriptions in the forums on how to do this.

                        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

                        Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                        Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                        1 Reply Last reply Reply Quote 0
                        • S
                          serpele
                          last edited by

                          [LEFT]This Is What I 'm wearing m But Not Working of the file /var/www/fog/lib/pages/FOGConfigurationPage.class.php

                          ‘field’ => $field,
                          ‘input’ => $input,
                          ‘menu_id’ => $Menu->get(‘id’),
                          ‘id’ => $Menu->get(‘id’),
                          ‘menu_item’ => $Menu->get(‘name’),
                          ‘menu_description’ => $Menu->get(‘description’),
                          ‘menu_params’ => $Menu->get(‘params’),
                          ‘menu_default’ => ($Menu->get(‘default’) ? ‘checked’ : ‘’),
                          ‘menu_regmenu’ => $this->getClass(‘PXEMenuOptionsManager’)->regSelect($Menu->get(‘regMenu’)),
                          ‘menu_options’ => $Menu->get(‘args’),
                          ‘disabled’ => ‘’,
                          But it does not work for me[/LEFT]

                          1 Reply Last reply Reply Quote 0
                          • Tom ElliottT
                            Tom Elliott
                            last edited by

                            What is not working?

                            Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

                            Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                            Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                            1 Reply Last reply Reply Quote 0
                            • S
                              serpele
                              last edited by

                              After editing on the part of GUI ( fog.multijoin ) and remove the lines you say to start the multijoin returnd to boot menu
                              [LEFT]It seems that no session[/LEFT]
                              [LEFT]Apologize for if I do not fully understand my English is not very good[/LEFT]

                              1 Reply Last reply Reply Quote 0
                              • 1
                              • 2
                              • 3
                              • 3 / 3
                              • First post
                                Last post

                              160

                              Online

                              12.0k

                              Users

                              17.3k

                              Topics

                              155.2k

                              Posts
                              Copyright © 2012-2024 FOG Project