Multi-Task Problem

[Fernando Gietz]

The problem is that the multicastSession is not created ( I am very clever boy XD) but we dont know the reason of this behaviour.

Any errors in the php log?

[Joe Gill]

@Fernando-Gietz

Which files would you like me to pull for you?

[Fernando Gietz]

• /var/log/httpd/ssl_error_log
• /var/log/httpd/error_log

Try to see if when tou create a multicast tasks appears any error.

[Joe Gill]

@Fernando-Gietz

Will do. I’ll tail those files and see what happens when I create a new task. I’ll report back! Thanks!

[Joe Gill]

@Fernando-Gietz

OK. So now it’s saying:

“Invalid MultiCast Session” on the hosts. Nothing new in the log. I have the /etc/httpd/logs/error_log pulled tail -f and nothing new is showing up there.

[Sebastian Roth]

@Joe-Gill Unfortunately don’t have enough time to do another debug session with you. But maybe I can give you enough hints so you can dig it up yourself.

Remember that I enabled mysql query logging yesterday?! First you login to the web UI, clear all the old tasks there and select the group you want to schedule a multicast task for. Prepare this as far as possible but don’t hit the button to create it yet but enable database query logging (and clear the log we created yesterday):

shell> echo -n "" >/var/log/mariadb/query.log
shell> mysql -u root -p
Password:
...
mysql> SET GLOBAL general_log_file='/var/log/mariadb/query.log';
...
mysql> SET GLOBAL general_log=1;

Now click create multicast task and then stop query logging again:

mysql> SET GLOBAL general_log=0;

Now take a look at the query.log file. What you are looking for is probably something like INSERT INTO multicastSessions .... Just use search function of the text editor to find that part. Now when you find this you just copy the whole SQL command and try to execute that in the mysql shell manually. Most probably you’ll get an error from that and we might find out why.

[Joe Gill]

@Sebastian-Roth

Awesome! That gives me a place to start. Thanks! I’ll do some digging. I’ll be tied up here in a couple hours for the rest of the day. I’ll post what I find out before I head out though. Thanks again!

[Joe Gill]

@Sebastian-Roth
@Fernando-Gietz

Here’s an error!

MariaDB [fog]> INSERT INTO `multicastSessions` (`msName`,`msBasePort`,`msLogPath`,`msImage`,`msClients`,`msSessClients`,`msInterface`,`msStartDateTime`,`msPercent`,`msState`,`msCompleteDateTime`,`msIsDD`,`msNFSGroupID`,`msAnon3`,`msAnon4`,`msAnon5`) VALUES ('Multi-Cast Task - Elem-Lab','62250','WIN10Base_SSD','40','','','eth0','2019-06-12 15:05:26','0','0','','1','3','','','') ON DUPLICATE KEY UPDATE `msName`=VALUES(`msName`),`msBasePort`=VALUES(`msBasePort`),`msLogPath`=VALUES(`msLogPath`),`msImage`=VALUES(`msImage`),`msClients`=VALUES(`msClients`),`msSessClients`=VALUES(`msSessClients`),`msInterface`=VALUES(`msInterface`),`msStartDateTime`=VALUES(`msStartDateTime`),`msPercent`=VALUES(`msPercent`),`msState`=VALUES(`msState`),`msCompleteDateTime`=VALUES(`msCompleteDateTime`),`msIsDD`=VALUES(`msIsDD`),`msNFSGroupID`=VALUES(`msNFSGroupID`),`msAnon3`=VALUES(`msAnon3`),`msAnon4`=VALUES(`msAnon4`),`msAnon5`=VALUES(`msAnon5`);
ERROR 1054 (42S22): Unknown column 'msAnon3' in 'field list'
MariaDB [fog]> 

Any ideas? I’ll be around all day today if you guys want to take a look at it.

Thanks!

[Fernando Gietz]

Hi @Joe-Gill
And the msAnon3 column, does exist in the database?

#desc multicastSessions;

[Sebastian Roth]

@Joe-Gill Sounds like your DB has more issues that what we have fixed last time. But this one sounds really strange! Please run DESC multicastSessions in the mysql command line and post output here.

[Joe Gill]

@Fernando-Gietz

MariaDB [fog]> desc multicastSessions;
+--------------------+---------------+------+-----+---------+----------------+
| Field              | Type          | Null | Key | Default | Extra          |
+--------------------+---------------+------+-----+---------+----------------+
| msID               | int(11)       | NO   | PRI | NULL    | auto_increment |
| msName             | varchar(250)  | NO   |     | NULL    |                |
| msBasePort         | int(11)       | NO   |     | NULL    |                |
| msLogPath          | longtext      | NO   |     | NULL    |                |
| msImage            | longtext      | NO   |     | NULL    |                |
| msClients          | int(11)       | NO   |     | NULL    |                |
| msSessClients      | int(11)       | NO   |     | NULL    |                |
| msInterface        | varchar(250)  | NO   |     | NULL    |                |
| msStartDateTime    | datetime      | NO   |     | NULL    |                |
| msPercent          | int(11)       | NO   |     | NULL    |                |
| msState            | int(11)       | NO   |     | NULL    |                |
| msCompleteDateTime | datetime      | NO   |     | NULL    |                |
| msIsDD             | int(11)       | NO   |     | NULL    |                |
| msNFSGroupID       | int(11)       | NO   | MUL | NULL    |                |
| msShutdown         | enum('0','1') | NO   |     | 0       |                |
| msMaxwait          | int(11)       | NO   |     | NULL    |                |
| msAnon5            | varchar(250)  | NO   |     | NULL    |                |
+--------------------+---------------+------+-----+---------+----------------+
17 rows in set (0.01 sec)

MariaDB [fog]> 

[Fernando Gietz]

Your database is … strange!!! XD

MariaDB [fog]> desc multicastSessions;
+--------------------+--------------+------+-----+---------+----------------+
| Field              | Type         | Null | Key | Default | Extra          |
+--------------------+--------------+------+-----+---------+----------------+
| msID               | int(11)      | NO   | PRI | NULL    | auto_increment |
| msName             | varchar(250) | NO   |     | NULL    |                |
| msBasePort         | int(11)      | NO   |     | NULL    |                |
| msLogPath          | longtext     | NO   |     | NULL    |                |
| msImage            | longtext     | NO   |     | NULL    |                |
| msClients          | int(11)      | NO   |     | NULL    |                |
| msSessClients      | int(11)      | NO   |     | NULL    |                |
| msInterface        | varchar(250) | NO   |     | NULL    |                |
| msStartDateTime    | datetime     | NO   |     | NULL    |                |
| msPercent          | int(11)      | NO   |     | NULL    |                |
| msState            | int(11)      | NO   |     | NULL    |                |
| msCompleteDateTime | datetime     | NO   |     | NULL    |                |
| msIsDD             | int(11)      | NO   |     | NULL    |                |
| msNFSGroupID       | int(11)      | NO   | MUL | NULL    |                |
| msAnon3            | varchar(250) | NO   |     | NULL    |                |
| msAnon4            | varchar(250) | NO   |     | NULL    |                |
| msAnon5            | varchar(250) | NO   |     | NULL    |                |
+--------------------+--------------+------+-----+---------+----------------+
17 rows in set (0.012 sec)

[Joe Gill]

@Fernando-Gietz

I blame @Tom-Elliott ! Ha! He helped me with it last year and the past few years.

[Sebastian Roth]

@Joe-Gill You can manually add the coloumns to match the schema Fernando posted.

[Joe Gill]

@Sebastian-Roth

I’d need a bit of guidance there as I have little experience working in the DB. But I’m willing to try anything. I have a backup. Ha!

[Sebastian Roth]

@Joe-Gill Ahhhhhhh, I just figured what’s wrong with your DB. Seems like you have used Tom’s working-1.6 branch at some point in time.

Take a look here: https://github.com/FOGProject/fogproject/blob/working-1.6/packages/web/commons/schema.php#L3746

Guess you need to manually reverse the last few schema changes you see in the above link. Not sure how far back you need to go. Probably as far as 264.

@Tom-Elliott We really need to get the schema change numbers sorted when I get back from my travels.

[Joe Gill]

@Sebastian-Roth
@Tom-Elliott

Yes, I have used Tom’s working-1.6 branch. I’ll check out the link you posted from github and see if I can’t figure things out.

Thanks for looking at it!

Enjoy your travels!

[Joe Gill]

@Sebastian-Roth
@Fernando-Gietz

Any advice on how to manually reverse the last few schema changes?

Thanks!

[Fernando Gietz]

I will not drop the msShutdown and msMaxwait columns (I don´t know if in this version are neccesary), I will only add the new columns. Try with this:

ALTER TABLE multicastSessions
ADD COLUMN msAnon3 VARCHAR(250) AFTER msNFSGroupID;

ALTER TABLE multicastSessions
ADD COLUMN msAnon4 VARCHAR(250) AFTER msAnon3;

[Joe Gill]

@Fernando-Gietz
@Sebastian-Roth

Fernando’s fix takes it! That worked!

The first statement didn’t produce any results. But the second one did and after I restarted Multicasting, things are working again! Woo Whoo!

Thanks guys! I owe you both a beer!

Cheers!

For the record, if anyone else has this issue…

This was the fix…

ALTER TABLE multicastSessions
ADD COLUMN msAnon4 VARCHAR(250) AFTER msAnon3;