• Recent
    • Unsolved
    • Tags
    • Popular
    • Users
    • Groups
    • Search
    • Register
    • Login

    Help with Mass Hard drive cloning station

    Scheduled Pinned Locked Moved
    General
    7
    26
    9.2k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • george1421G
      george1421 Moderator
      last edited by george1421

      FOG isn’t a good solution for this situation. If you had 40 PCs connected to those 40 hard drives I would say yes its a strong solution.

      I would even say for your task Clonezilla wouldn’t be a good solution. If you had a single local drive attached to a usb dock then Clonezilla would be a good fit. You will have a hard time finding a computer as well as a program that had enough bandwidth (cpu and backplane) to push data to all 40 drives all at once.

      Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

      1 Reply Last reply Reply Quote 0
      • Z
        zionda
        last edited by

        Thank you for the replay

        Is there a image to multiple local hdds option?

        I mean if the qty were lower , for example 1 to 10 would that be suitable ?

        george1421G 3 Replies Last reply Reply Quote 0
        • george1421G
          george1421 Moderator @zionda
          last edited by

          @zionda No there isn’t. FOG is setup for 1 computer 1 image. You really want a disk duplicator not an imaging solution.

          Something like this: https://www.startech.com/HDD/Duplicators/SATA-Hard-Drive-HDD-Duplicator-Dock-eSATA-USB~SATDOCK22RE but on a larger scale.

          Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

          Z 1 Reply Last reply Reply Quote 0
          • george1421G
            george1421 Moderator @zionda
            last edited by

            @zionda Maybe something more on this magnitude
            http://www.produplicator.com/products/easy-loading-hdd-ssd-duplicator?variant=39289378703&gclid=CKGL8ZyB-NMCFY66wAodH8oAXw

            I’m trying to think if you could do something manually with linux and something like dd to move the image from the host linux server to each drive. But again I’m not sure if you could get a computer big enough to move that much data.

            How large of an image are you trying to clone?

            If you had 1 hard drive per computer you could use fog and a multicast image to deploy a single image to 50 computers at the same time.

            Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

            1 Reply Last reply Reply Quote 0
            • george1421G
              george1421 Moderator @zionda
              last edited by

              @zionda Hmmm… a raspberry pi cluster/supercomputer and FOG might do it.

              Thinking about it you might find that 2 groups of 20 may image faster than 1 group of 40 just because of the data bandwidth you are talking about.

              Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

              1 Reply Last reply Reply Quote 0
              • Z
                zionda @george1421
                last edited by

                @george1421

                Well actually maybe you guys have a diffrent idea

                We are installing each time different images to diffrerent schools in our region

                We sometimes needs to install 500-800 pcs all exact same pc model and specs and all of them with the exact same image

                We use pxe boot to image each pc but i cant find an effective way to so it in mass installation since we have limited space and few technicians and im trying to make the imaging process more effective

                Would love to know if you have any suggestions on how to handle mass installations (i tought making a duplicator and just mass install the hdds and assemble onto the pcs will be faster, specially when sometimes there is an Hdd upgrade than we already have the hdds outside the pc)

                Any best practice will be helpful

                george1421G Wayne WorkmanW 3 Replies Last reply Reply Quote 0
                • george1421G
                  george1421 Moderator @zionda
                  last edited by george1421

                  @zionda What is your time span to install the 500 to 800 systems? (minutes, days, weeks?)

                  Fog can do a multicast deployment where it send out a single image and the devices configured to receive it will do so. If your network is built properly you can do this in place without touching the computers at all (understand there are a few assumptions in that statement). I would probably limit the deployment size to 50 or so just because your overall deployment speed is dependent on your slowest computer being installed. Fog will do this today.

                  Now if you have a routed network (i.e. subnets, vlans) you will need to setup a multicast router so that the multicast traffic gets routed properly without swamping your network. Having managed switches that support igmp snooping also helps to keep the multicast traffic to switch ports where there are multicast subscribers.

                  Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                  1 Reply Last reply Reply Quote 0
                  • george1421G
                    george1421 Moderator @zionda
                    last edited by

                    @zionda Hopefullt @Wayne-Workman will be along soon. He worked at a pretty big school district and has first hand experience with imaging on a large scale.

                    Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                    1 Reply Last reply Reply Quote 1
                    • Wayne WorkmanW
                      Wayne Workman @zionda
                      last edited by

                      @zionda said in Help with Mass Hard drive cloning station:

                      @george1421

                      Well actually maybe you guys have a diffrent idea

                      We are installing each time different images to diffrerent schools in our region

                      We sometimes needs to install 500-800 pcs all exact same pc model and specs and all of them with the exact same image

                      We use pxe boot to image each pc but i cant find an effective way to so it in mass installation since we have limited space and few technicians and im trying to make the imaging process more effective

                      Would love to know if you have any suggestions on how to handle mass installations (i tought making a duplicator and just mass install the hdds and assemble onto the pcs will be faster, specially when sometimes there is an Hdd upgrade than we already have the hdds outside the pc)

                      Any best practice will be helpful

                      FOG can do this job natively, as @george1421 already said. FOG uses PXE, that’s just one aspect of how it works. Now, before you think that FOG is anything like GHOST, stop. Because GHOST vs FOG is not even a competition. FOG vs WDS is not a competition. Comparing these would be like comparing a lame horse to a new motorcycle. These other solutions don’t come close to FOG’s speed nor it’s functionality, or support for that matter.

                      The way you are wanting to do this (in your OP) is a bad idea and we aren’t going to help with it, it’s also not best practice and would be super labor intensive and lack all the great features that you don’t know about yet which FOG offers as standard, supported features.

                      If you want to setup a P.O.C. for FOG, we can assist - you can see how it works, we can go from there. This is what I would suggest. Instead of getting caught up with a billion questions here in a thread without actually trying it out. With our help, and this being your first experience, you can probably have a P.O.C. setup and functional in a couple hours. We have plenty of guides for you to work from, also. I recommend this one: https://wiki.fogproject.org/wiki/index.php?title=CentOS_7 You will need to modify your DHCP server during setup, notes on that are here: https://wiki.fogproject.org/wiki/index.php?title=Modifying_existing_DHCP_server_to_work_with_FOG

                      Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                      Daily Clean Installation Results:
                      https://fogtesting.fogproject.us/
                      FOG Reporting:
                      https://fog-external-reporting-results.fogproject.us/

                      1 Reply Last reply Reply Quote 1
                      • JunkhackerJ
                        Junkhacker Developer
                        last edited by

                        i have to recommend that you give FOG a shot as it is supposed to be configured. with as fast as FOG images systems, you’ll have them all imaged in the time it would take you to remove all their hard drives for your original intended method. does anyone have a demo video from after we added zstd compression?

                        signature:
                        Junkhacker
                        We are here to help you. If you are unresponsive to our questions, don't expect us to be responsive to yours.

                        Tom ElliottT Wayne WorkmanW 2 Replies Last reply Reply Quote 1
                        • Tom ElliottT
                          Tom Elliott @Junkhacker
                          last edited by

                          @Junkhacker I don’t :(. I’ll admit, I don’t record any videos. Not that I couldn’t but I’m usually tweaking so many things at once, that my videos wouldn’t make sense comparitively.

                          Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

                          Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                          Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                          1 Reply Last reply Reply Quote 0
                          • Wayne WorkmanW
                            Wayne Workman @Junkhacker
                            last edited by Wayne Workman

                            I can do a screen capture of it, but my equipment is old as dirt and my setup is far from optimal. I’m working at home with a 100Mbps network, and a test windows 10 image. Worse, the test server and test box are virtualized so that further worsens my performance. So I’m only getting about 6 minute imaging times.

                            Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                            Daily Clean Installation Results:
                            https://fogtesting.fogproject.us/
                            FOG Reporting:
                            https://fog-external-reporting-results.fogproject.us/

                            JunkhackerJ 1 Reply Last reply Reply Quote 0
                            • JunkhackerJ
                              Junkhacker Developer @Wayne Workman
                              last edited by Junkhacker

                              @Wayne-Workman i’ve created a demo video in the past for a conference i spoke at
                              https://youtu.be/gHNPTmlrccM
                              i just don’t have the time to edit the video for a new one

                              signature:
                              Junkhacker
                              We are here to help you. If you are unresponsive to our questions, don't expect us to be responsive to yours.

                              Wayne WorkmanW 1 Reply Last reply Reply Quote 1
                              • Wayne WorkmanW
                                Wayne Workman @Junkhacker
                                last edited by

                                @Junkhacker Must be private? I can’t see it.

                                Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                                Daily Clean Installation Results:
                                https://fogtesting.fogproject.us/
                                FOG Reporting:
                                https://fog-external-reporting-results.fogproject.us/

                                JunkhackerJ 1 Reply Last reply Reply Quote 0
                                • JunkhackerJ
                                  Junkhacker Developer @Wayne Workman
                                  last edited by Junkhacker

                                  @Wayne-Workman fixed
                                  of course, this is super slow compared to our current imaging speed. i image in almost half that time now.

                                  signature:
                                  Junkhacker
                                  We are here to help you. If you are unresponsive to our questions, don't expect us to be responsive to yours.

                                  1 Reply Last reply Reply Quote 0
                                  • AvaryanA
                                    Avaryan @zionda
                                    last edited by Avaryan

                                    @zionda said in Help with Mass Hard drive cloning station:

                                    Hi Guys,
                                    I’m trying to build a cloning station and i was wondering if FOG is suitable for what i am after

                                    I have a i7 PC that has multiple USB 3.0 ports
                                    Each usb port has a Orico 4xBay SATA HDD connected

                                    The PC see’s 40 hard drives connected

                                    Question is , is FOG capable loading a source image and deploy it on the HDDs connected simultaneously?

                                    If so, is it also able to format the 40 HDDs?

                                    Thank you !

                                    Zion

                                    In regards to the original question, it may be possible to assign each HDD to a virtual machine and deploy to each one. Can’t say I’d recommend doing that though.

                                    x23piracyX 1 Reply Last reply Reply Quote 0
                                    • x23piracyX
                                      x23piracy @Avaryan
                                      last edited by x23piracy

                                      @Avaryan @zionda thats really uncomfortable and kind of tinkering. Just forget FOG for this case, just use a cloning solution on that local computer were you have all the drives connected via usb3.

                                      I’ve seen something different in the past at atos origin, they used IBM Tivoli but they connected the whole computers not just the harddrives, but just using a harddrive was also possible with that.

                                      Regards X23

                                      ║▌║█║▌│║▌║▌█

                                      JunkhackerJ 1 Reply Last reply Reply Quote 0
                                      • JunkhackerJ
                                        Junkhacker Developer @x23piracy
                                        last edited by

                                        @x23piracy yeah, if he wants to clone to the drives in the way he originally describes clonezilla is probably the best choice.

                                        signature:
                                        Junkhacker
                                        We are here to help you. If you are unresponsive to our questions, don't expect us to be responsive to yours.

                                        1 Reply Last reply Reply Quote 0
                                        • Z
                                          zionda
                                          last edited by

                                          Thank you for the replies and discussion guys !

                                          So i understand that i might be doing some workaround and it’s not the way to go.

                                          what we are experiencing currently is that we have a limited of PC’s we can install at once from PXE (we can do approx 10-15 at a time)

                                          sometimes the PC’s for the schools supposed to have their HDD’s replaced with SSD’s or bigger SATA ones and than i need to remove the old one and install the new ones, so i figured for this situations i rather put them back after i cloned the new drives with the images.

                                          the FOG as i read is an Amazing solution but my question is do you think the right way is to connected each PC individually ? will it be faster (and less logistic) than doing it bulk directly to the drives ?

                                          george1421G Wayne WorkmanW x23piracyX 3 Replies Last reply Reply Quote 0
                                          • george1421G
                                            george1421 Moderator @zionda
                                            last edited by

                                            @zionda First you know my answer will be a bit biased toward FOG 😉

                                            From a logic standpoint, wouldn’t you want to use the same tool to initially deploy your images as you would for ongoing imaging? This is where I think FOG is a perfect solution. The same tool used to originally image the machines will be also used if the target computer is damaged and must be repaired and reimaged some time in the future.

                                            The scope of your question has changed a bit now. In your OP I had envisioned that you would been to image 100s of PCs at the same time (mass deployment). FOG works great for this with its multicasting ability (sending 1 image to many computers). With your latest post your work flow seems to be a bit different. You will have to manually touch each computer to replace its hard drive. You could use a disk duplicator here or you can use FOG and unicast a single image to the target computer. In my company, with our fat image ~25GB it takes about 4 minutes to push the image to the target computer. If you think about your cycle time that image is faster than you can replace the hard drive in the next computer.

                                            Regardless of the approach you take, you need to consider how much after the imaging is complete you have to / need to touch the computer. Will you have to name the computer? Will you have to connect it to the domain? Assign it to a certain OU? Install additional applications? Install any local hardware peripheral drivers? Make any other post imaging customizations? How frequent will these systems be reimaged (daily, monthly, yearly)? All of these steps may need to be taken into consideration when determining your imaging solution.

                                            The image push is only the first step in the imaging process. You have quite a few others to consider when going from bare metal to finished product.

                                            Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                                            1 Reply Last reply Reply Quote 1
                                            • 1
                                            • 2
                                            • 1 / 2
                                            • First post
                                              Last post

                                            174

                                            Online

                                            12.1k

                                            Users

                                            17.3k

                                            Topics

                                            155.3k

                                            Posts
                                            Copyright © 2012-2024 FOG Project