Downloading and uploading images stops every 5%

[Woeler]

Hello all,

When downloading and uploading my windows 7 images to my Bananapi and back to my desktop everything is extremely slow. Every 5% or so progress completely stops and fog does basically nothing for sometimes 20 seconds, sometimes for 5 to 10 minutes. Uploading a 30gb images to my bananapi over a gigabit connection took me 1 and a half hour!

The problem is the pause between each transfer. The 5% at a time it transfers takes only a few seconds, and then it stalls again for minutes.

I have no idea what is causing this. Any help?

The bananapi writes the images over usb2 to a 2.5inch HDD. I’m using a class4 SD card for my bananapi OS, but that will be swapped to a class10 card tomorrow(maybe that could be the problem?)

[Wayne Workman]

@Woeler

Also,

You will get FAR better performance if you install a Linux SERVER distro into your banana pie, and use FOG Trunk instead of 1.2.0.

I recommend Fedora 22 Server and this method of getting FOG Trunk: https://wiki.fogproject.org/wiki/index.php/SVN

[Wayne Workman]

Wow just realized that I edited your post instead of replying… long day…

[Wayne Workman]

For 1.2.0 The compression settings for images is located here:

FOG Configuration -> FOG Settings -> FOG Boot Settings -> FOG_PIGZ_COMP

[Woeler]

Thanks, but where do I find this particular setting?

[Woeler]

Could the problem be that I’m making an image of a 30gb SSD that is almost full? And with almost full I mean with like a gig left?

30 gig is not a large image. Free space shouldn’t be an issue, either. Did you choose “resizeable” ?

If you don’t like how long it’s taking, you could turn down the compression… Default for 1.2.0 is set to 9… and that’s the max… and it’s really slow. I’d recommend 6.

[Wayne Workman]

@Woeler said:

Hey thanks for your input. The weird thing is however, that a friend of mine is running on exactly the same hardware, not running on SVN and it runs just fine.

Compression happens on the client, not the server…

If your friend has a faster client, it’d perform better.

[Woeler]

Hey thanks for your input. The weird thing is however, that a friend of mine is running on exactly the same hardware, not running on SVN and it runs just fine.

I will try it tomorrow and let you know if it helped!

Thanks in advance!

[Wayne Workman]

When I’m uploading using a 32-Core 28 GB RAM Server with 2Gbps network connection, it does the same for me.

This is normal.

If you want faster upload speeds, upgrade to Trunk.

I recommend using this method to upgrade to FOG Trunk:
https://wiki.fogproject.org/wiki/index.php/SVN

Just like Tom said:

@Tom-Elliott said:

What may be of interest is maybe trying to run on SVN. There is a significant increase in speed between the init’s for upload and download. By significant, I think anybody on the forums running the current “trunk” version of fog can vouch for it.

[Tom Elliott]

The kernel I refer to is the one on your fog server, (the one the clients boot to).

My guess, based on 1.2.0 is you haven’t downloaded any custom kernels. Most likely, you’re using 3.14.2.

My guess as to the problem you’re seeing is in part due to the Hardware your fog server is running on.

While it will “work” the speed for upload may be noticable during the “gaps” where the client has to compress the image, to when it passes the now compressed data back up to the server.

What may be of interest is maybe trying to run on SVN. There is a significant increase in speed between the init’s for upload and download. By significant, I think anybody on the forums running the current “trunk” version of fog can vouch for it.

[Woeler]

Hey,

I’m using fog 1.2.0
Kernel: 3.4.90

I’m pretty new to this, so if you need more info, please do ask

[Tom Elliott]

Details, details, details…

What version of FOG? (Specifically from the Cloud Logo on your system)

What kernel are you using?

I’ve seen these symptoms before, but I’ve not seen them for a long time.