Database Connection Issues - Mysql.service won't start
-
Hello all,
Someone previously setup our Fog Server on Ubuntu 18.04 (command-line interface only). Everything was running great until a couple of weeks ago when one of our techs was trying to upload some images and now we are getting a Database connection unavailable error trying to connect to our web interface manager. I have looked up some of your articles and found them very helpful in the way to help me around the Linux command line. I think the issue is we are low on space and it’s preventing the mysql.service from starting. It is showing that we are using 95.7% of 491.15GB on the drive.
I have tried articles on clearing up space getting rid of patch files etc and then starting the service. I keep getting the same message. See below.
I also tried running the help steps in the post, Ubuntu is Fogs Enemy: [https://forums.fogproject.org/topic/10006/ubuntu-is-fog-s-enemy]
FOG is on a virtual machine and I can increase the hard drive size of it if we need to, but on my windows servers, I have to go in and expand the volume after I increase it within VSphere. Would this be the same for Ubuntu? I am not as familiar with the Linux environments as I am with Windows. Our previous guy LOVED everything Linux.
I appreciate any commands or fixes you can toss at me. We really do like using FOG.
-
What does
df -hgive you? One reason why mysql would fail to start is being out of disk space to boot mysql.Edit: well heck if I would have read your entire text of your first post you already suggested being out of disk space. The df program will tell us.
-
-
@Naline Yep you are sitting at 100% on your root partition (think
drive being 100% full). -
@Naline ok lets see if we can free up some bits. Look in /images/dev for any directories that look like mac addresses.
ls -la /images/devIf there are any directories in there with a mac looking file name, those are botched uploads you can delete the entire directory without fear. Lets see the output before I give you the command.
-
-
@Naline ok understand with great power comes great responsibility. These commands used unwisely can cause a great mess. Key these in exactly.
sudo rm -rf /images/dev/54ee75f0ca05
sudo rm -rf /images/dev/98fa9b33a1fc
sudo ls -la /images/devedit: crud I forgot you have ubuntu you need to sudo those commands. Fixed above.
-
@george1421 Done. I do not want the Linux power.
-
@george1421 Looking better! Let me see if it will start now.
-
This post is deleted! -
@Naline ok now that you have a little headroom rebooting the fog server will give you, the mysql should startup and be happy. Before you do that lets get the output of
lsblk. Then we can figure out the next steps to give you a bit more disk space. -
@george1421 Sorry I got excited and restarted it. It is up again. Here is the output of lsblk after I restarted.
-
@Naline OK your root partition is the last partition on the disk (a good thing). Your vmdk is 500GB in size. Go ahead and expand the vmdk file. The next bit is you will need to expand the partition and then the file system. I had a really swell step by step instructions I found a while ago I’m looking for that. While I look for those instructions go ahead and expand the vmdk disk.
-
I have to step away from the computer for a few minutes. I can’t seem to find the instructions at the moment, but if you google for it you don’t want the instructions that mention LVM. You have just a flat standard disk partitions. The commands are easy like 2 or 3 of them to expand the partition then expand the file system. I just can’t find them at the moment. Back in a bit.
-
@george1421 No problem. I have increased it from 500GB to 800GB. We aren’t needing this at the moment. I’ll wait for you if you have the time later today or tomorrow (even later this week). You have been amazing and you have no idea how much I appreciate your help. I have some other things to work on.
-
@Naline The first answer here will get you going: https://askubuntu.com/questions/24027/how-can-i-resize-an-ext-root-partition-at-runtime
The reason why I’m hesitating is that it uses the process where you are going to delete partition 2 on the disk and then recreate it right away in the bigger size without loosing any data. As long as its done in one shot it will be OK. But its still kind of anxious time. Once you get the disk partition expanded then just use the expand fs command in the thread.
Just make sure you have a good backup of the fog server VM before you do this. If you had a gui loaded on that computer you could use gparted utility to extend the partition and file system. Since you don’t you will have to do command line. But you are after /dev/sda2 (or the second primary partition on the disk)
-
@george1421 Thanks. I have the backup ready to run tonight and I’ll see about working on it tomorrow or Monday when I’m back in the office. I also used your article and looked up the commands on YouTube. This video was helpful for me to see how each command laid out as it was typed step by step.
My first line would be sudu fdisk /dev/sda2 correct?
Here is the video if you or anyone else is interested.
https://www.youtube.com/watch?v=a-MeH95ei1g
Is there a way to add a GUI to an already established Ubuntu server? Asking for a friend. (j/k It’s for me. I do feel like I’ve gotten a lot of Linux command line practice in the last two days trying to work on this.)
-
@Naline said in Database Connection Issues - Mysql.service won't start:
My first line would be sudu fdisk /dev/sda2 correct?
Just for clarity /dev/sda is your first disk in your computer. /dev/sda2 means the 2nd partition on your first disk. When working with fdisk you connect with the disk or /dev/sda only.
-
Hey George. I’m back working on this today. I followed the instructions on the link you sent while referencing the YouTube video I found but ran into a problem with it only recreating the disk using the size 500G instead of 800G. I found out after doing some more searching that I needed to run sudo lshw -c disk for Ubuntu to rescan the file systems to recognize the 800G drive from vmWare. So I got this fixed and Ubuntu now sees the 800G drive.
But I am running into the problem of the following GPT PMBR size mismatch coming up in red (see below) while going into the sudo fdisk /dev/sda.
I also had the issue of it not resizing to 800G but staying at 500G. I reviewed the YouTube video some more and they talked about the sectors needing to match. For Disk /dev/sda: 800GiB is showing 1677721600 sectors. When my disk is being re-created it is wanting to stay at the original sector numbers that were set for 500G. I tried to change the sector number but continued to get the message that the value was out of range.
I also continued through the commands to finish, but when trying to save (write) it comes back to the GPT PMBR size mismatch and that fdisk: failed to write disklabel: invalid argument.
-
@Naline I’m wonder if you can restore the disk to the last backup where you have a partition table smaller than the disk then run gparted to expand that last partition.
Look here in the section: “5. Resize Linux Disk Partition” resizepart command
https://www.tecmint.com/parted-command-to-create-resize-rescue-linux-disk-partitions/
I’m wondering if the fdisk command did bad things to that GPT structured disk.
