• Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login
  • Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login

Multi-Task Problem

Scheduled Pinned Locked Moved Solved
FOG Problems
3
34
4.9k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • J
    Joe Gill
    last edited by Jun 6, 2019, 5:29 PM

    FOG Version – 1.5.6.3
    FOG Server OS – Debian 9.9

    Hi all,

    I ran into a problem Multi-Casting machines. I get the following message on my HOST.

    IMG_20190606_095056_1.jpg

    Here is /opt/fog/log/multicast.log

    [06-06-19 11:11:14 am]
    ==================================
    ===        ====    =====      ====
    ===  =========  ==  ===   ==   ===
    ===  ========  ====  ==  ====  ===
    ===  ========  ====  ==  =========
    ===      ====  ====  ==  =========
    ===  ========  ====  ==  ===   ===
    ===  ========  ====  ==  ====  ===
    ===  =========  ==  ===   ==   ===
    ===  ==========    =====      ====
    ==================================
    ===== Free Opensource Ghost ======
    ==================================
    ============ Credits =============
    = https://fogproject.org/Credits =
    ==================================
    == Released under GPL Version 3 ==
    ==================================
    
    
    [06-06-19 11:11:14 am] Interface Ready with IP Address: 127.0.0.1
    [06-06-19 11:11:14 am] Interface Ready with IP Address: 127.0.1.1
    [06-06-19 11:11:14 am] Interface Ready with IP Address: 172.16.1.17
    [06-06-19 11:11:14 am] Interface Ready with IP Address: fogserver
    [06-06-19 11:11:14 am]  * Starting MulticastManager Service
    [06-06-19 11:11:14 am]  * Checking for new items every 10 seconds
    [06-06-19 11:11:14 am]  * Starting service loop
    [06-06-19 11:11:14 am]  * No new tasks found
    [06-06-19 11:11:24 am]  * No new tasks found
    [06-06-19 11:11:34 am]  * No new tasks found
    [06-06-19 11:11:44 am]  * No new tasks found
    [06-06-19 11:11:54 am]  * No new tasks found
    

    I also tested Multicast in debug mode on a particular machine I was having issues getting FOG to start multicasting to and the test worked just fine. It appears that FOG doesn’t recognize that an event has started. I have tried killing all multitask sessions, killing the multicast session PID, stopping and restarting multicast, restarting the server, running an update on the FOG server, clearing any flags in the SQL database, nothing has worked.

    Any help is greatly appreciated!

    Thanks!

    Cheers,

    Joe

    1 Reply Last reply Reply Quote 0
    • J
      Joe Gill
      last edited by Jun 6, 2019, 5:45 PM

      @Sebastian-Roth Any ideas here?

      1 Reply Last reply Reply Quote 0
      • S
        Sebastian Roth Moderator
        last edited by Jun 6, 2019, 9:48 PM

        @Joe-Gill Do you actually see the multicast task in the web UI? How do you schedule the multicast task? Please tell us the exact steps you do scheduling the task so we might be able to understand and reproduce your issue.

        Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

        Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

        J 1 Reply Last reply Jun 6, 2019, 9:49 PM Reply Quote 0
        • J
          Joe Gill @Sebastian Roth
          last edited by Jun 6, 2019, 9:49 PM

          @Sebastian-Roth

          Yes. It shows up there like normal. Just nothing in the log.

          1 Reply Last reply Reply Quote 0
          • F
            Fernando Gietz Developer
            last edited by Jun 7, 2019, 11:02 AM

            And the log of the multicast tasks?
            /opt/fog/log/multicast.log.udpcastxxxx
            Where xxxx is the ID of the multicast tasks.

            J 1 Reply Last reply Jun 10, 2019, 10:37 PM Reply Quote 0
            • J
              Joe Gill @Fernando Gietz
              last edited by Jun 10, 2019, 10:37 PM

              @Fernando-Gietz

              What shows up in the UDP log is from over a year ago when I messed with multi-cast last. I am working on building a new server.

              Thanks!

              1 Reply Last reply Reply Quote 0
              • J
                Joe Gill
                last edited by Jun 11, 2019, 11:30 PM

                @Fernando-Gietz
                @Sebastian-Roth

                Well the problem persists on the new server… Multicast.log shows no new tasks and zero multicast.log.udpcstxxxx files in the /opt/fog/log directory. I’m betting the database issues persist on. I’ll be in first thing tomorrow morning. (7AM MST)

                Cheers!

                J 1 Reply Last reply Jun 12, 2019, 3:35 PM Reply Quote 0
                • J
                  Joe Gill @Joe Gill
                  last edited by Jun 12, 2019, 3:35 PM

                  @Sebastian-Roth
                  @Fernando-Gietz

                  Here is the latest…

                  [jgill@fogserver log]$ ls -lar
                  total 80
                  -rw-r--r--. 1 root root  4056 Jun 12 09:22 servicemaster.log
                  -rw-r--r--. 1 root root  1433 Jun 12 09:31 pinghost.log
                  -rw-r--r--. 1 root root  3471 Jun 12 09:31 multicast.log
                  -rw-r--r--. 1 root root 28408 Jun 12 09:22 groupmanager.log
                  -rw-r--r--. 1 root root  7770 Jun 12 09:22 fogsnapinrep.log
                  -rw-r--r--. 1 root root  4559 Jun 12 09:22 fogsnapinhash.log
                  -rw-r--r--. 1 root root  1812 Jun 12 09:30 fogscheduler.log
                  -rw-r--r--. 1 root root  8714 Jun 12 09:22 fogreplicator.log
                  -rw-r--r--. 1 root root  4462 Jun 12 09:22 fogimagesize.log
                  drwxr-xr-x. 5 root root    67 Jun 12 09:23 ..
                  drwxr-xr-x. 2 root root   218 Jun 12 09:22 .
                  [jgill@fogserver log]$ 
                  
                  06-12-19 9:22:41 am]
                  ==================================
                  ===        ====    =====      ====
                  ===  =========  ==  ===   ==   ===
                  ===  ========  ====  ==  ====  ===
                  ===  ========  ====  ==  =========
                  ===	 ====  ====  ==  =========
                  ===  ========  ====  ==  ===   ===
                  ===  ========  ====  ==  ====  ===
                  ===  =========  ==  ===   ==   ===
                  ===  ==========    =====      ====
                  ==================================
                  ===== Free Opensource Ghost ======
                  ==================================
                  ============ Credits =============
                  = https://fogproject.org/Credits =
                  ==================================
                  == Released under GPL Version 3 ==
                  ==================================
                  
                  
                  [06-12-19 9:22:41 am] Interface Ready with IP Address: 127.0.0.1
                  [06-12-19 9:22:41 am] Interface Ready with IP Address: 127.0.1.1
                  [06-12-19 9:22:41 am] Interface Ready with IP Address: 172.16.1.19
                  [06-12-19 9:22:41 am] Interface Ready with IP Address: fogserver.bhs.tn
                  [06-12-19 9:22:41 am]  * Starting MulticastManager Service
                  [06-12-19 9:22:41 am]  * Checking for new items every 10 seconds
                  [06-12-19 9:22:41 am]  * Starting service loop
                  [06-12-19 9:22:41 am]  * No new tasks found
                  [06-12-19 9:22:51 am]  * No new tasks found
                  [06-12-19 9:23:01 am]  * No new tasks found
                  [06-12-19 9:23:11 am]  * No new tasks found
                  [06-12-19 9:23:21 am]  * No new tasks found
                  [06-12-19 9:23:31 am]  * No new tasks found
                  [06-12-19 9:23:41 am]  * No new tasks found
                  [06-12-19 9:23:51 am]  * No new tasks found
                  [06-12-19 9:24:01 am]  * No new tasks found
                  [06-12-19 9:24:11 am]  * No new tasks found
                  [06-12-19 9:24:21 am]  * No new tasks found
                  [06-12-19 9:24:31 am]  * No new tasks found
                  [06-12-19 9:24:42 am]  * No new tasks found
                  [06-12-19 9:24:52 am]  * No new tasks found
                  [06-12-19 9:25:02 am]  * No new tasks found
                  [06-12-19 9:25:12 am]  * No new tasks found
                  [06-12-19 9:25:22 am]  * No new tasks found
                  
                  

                  Nothing is showing up in the logs at all.

                  And from the web interface…

                  Screenshot from 2019-06-12 09-34-06.png

                  1 Reply Last reply Reply Quote 0
                  • F
                    Fernando Gietz Developer
                    last edited by Jun 12, 2019, 3:49 PM

                    And in the database appears?
                    See the multicastSessions and MulticastSessionAssoc

                    If you go to the Active Tasks page, the multicast tasks appears?

                    J 1 Reply Last reply Jun 12, 2019, 4:51 PM Reply Quote 0
                    • J
                      Joe Gill @Fernando Gietz
                      last edited by Jun 12, 2019, 4:51 PM

                      @Fernando-Gietz

                      MariaDB [fog]> SELECT * FROM multicastSessions;
                      Empty set (0.00 sec)
                      
                      MariaDB [fog]> SELECT * FROM multicastAssoc;
                      ERROR 1146 (42S02): Table 'fog.multicastAssoc' doesn't exist
                      MariaDB [fog]> 
                      
                      
                      J 1 Reply Last reply Jun 12, 2019, 4:52 PM Reply Quote 0
                      • J
                        Joe Gill @Joe Gill
                        last edited by Jun 12, 2019, 4:52 PM

                        @Fernando-Gietz

                        Screenshot from 2019-06-12 10-51-45.png

                        1 Reply Last reply Reply Quote 0
                        • S
                          Sebastian Roth Moderator
                          last edited by Jun 12, 2019, 4:53 PM

                          @Joe-Gill First make sure the multicast service is actually running: systemctl status FOGMulticastManager

                          You are on the right track here. Try this: SELECT * FROM multicastSessionsAssoc;

                          Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                          Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                          J 1 Reply Last reply Jun 12, 2019, 4:54 PM Reply Quote 0
                          • J
                            Joe Gill @Sebastian Roth
                            last edited by Jun 12, 2019, 4:54 PM

                            @Sebastian-Roth

                            [jgill@fogserver log]$ systemctl status FOGMulticastManager
                            ● FOGMulticastManager.service - FOGMulticastManager
                               Loaded: loaded (/usr/lib/systemd/system/FOGMulticastManager.service; enabled; vendor preset: disabled)
                               Active: active (running) since Wed 2019-06-12 09:22:41 MDT; 1h 31min ago
                             Main PID: 5610 (FOGMulticastMan)
                               CGroup: /system.slice/FOGMulticastManager.service
                                       ├─5610 /usr/bin/php -q /opt/fog/service/FOGMulticastManager/FOGMulticastManager &
                                       └─5613 /usr/bin/php -q /opt/fog/service/FOGMulticastManager/FOGMulticastManager &
                            
                            Jun 12 09:22:41 fogserver.bhs.tn systemd[1]: Started FOGMulticastManager.
                            [jgill@fogserver log]$ 
                            
                            1 Reply Last reply Reply Quote 0
                            • J
                              Joe Gill
                              last edited by Jun 12, 2019, 4:55 PM

                              @Sebastian-Roth

                              MariaDB [fog]> SELECT * FROM multicastSessionsAssoc;
                              +-------+------+-----+
                              | msaID | msID | tID |
                              +-------+------+-----+
                              |    57 |    0 |  87 |
                              |    56 |    0 |  86 |
                              |    55 |    0 |  85 |
                              |    54 |    0 |  84 |
                              |    53 |    0 |  83 |
                              |    52 |    0 |  82 |
                              |    51 |    0 |  81 |
                              |    50 |    0 |  80 |
                              |    49 |    0 |  79 |
                              |    48 |    0 |  78 |
                              |    47 |    0 |  77 |
                              |    46 |    0 |  76 |
                              |    45 |    0 |  75 |
                              |    44 |    0 |  74 |
                              |    43 |    0 |  73 |
                              |    42 |    0 |  72 |
                              |    41 |    0 |  71 |
                              |    40 |    0 |  70 |
                              |    39 |    0 |  69 |
                              |    38 |    0 |  68 |
                              |    37 |    0 |  67 |
                              |    36 |    0 |  66 |
                              |    35 |    0 |  65 |
                              |    34 |    0 |  64 |
                              |    33 |    0 |  63 |
                              |    32 |    0 |  62 |
                              |    31 |    0 |  61 |
                              |    30 |    0 |  60 |
                              +-------+------+-----+
                              28 rows in set (0.00 sec)
                              
                              MariaDB [fog]> 
                              
                              1 Reply Last reply Reply Quote 0
                              • F
                                Fernando Gietz Developer
                                last edited by Jun 12, 2019, 4:57 PM

                                The problem is that the multicastSession is not created ( I am very clever boy XD) but we dont know the reason of this behaviour.

                                Any errors in the php log?

                                J 1 Reply Last reply Jun 12, 2019, 4:58 PM Reply Quote 0
                                • J
                                  Joe Gill @Fernando Gietz
                                  last edited by Jun 12, 2019, 4:58 PM

                                  @Fernando-Gietz

                                  Which files would you like me to pull for you?

                                  1 Reply Last reply Reply Quote 0
                                  • F
                                    Fernando Gietz Developer
                                    last edited by Jun 12, 2019, 5:00 PM

                                    • /var/log/httpd/ssl_error_log
                                    • /var/log/httpd/error_log

                                    Try to see if when tou create a multicast tasks appears any error.

                                    J 1 Reply Last reply Jun 12, 2019, 5:01 PM Reply Quote 0
                                    • J
                                      Joe Gill @Fernando Gietz
                                      last edited by Jun 12, 2019, 5:01 PM

                                      @Fernando-Gietz

                                      Will do. I’ll tail those files and see what happens when I create a new task. I’ll report back! Thanks!

                                      J 1 Reply Last reply Jun 12, 2019, 5:06 PM Reply Quote 0
                                      • J
                                        Joe Gill @Joe Gill
                                        last edited by Jun 12, 2019, 5:06 PM

                                        @Fernando-Gietz

                                        OK. So now it’s saying:

                                        “Invalid MultiCast Session” on the hosts. Nothing new in the log. I have the /etc/httpd/logs/error_log pulled tail -f and nothing new is showing up there.

                                        1 Reply Last reply Reply Quote 0
                                        • S
                                          Sebastian Roth Moderator
                                          last edited by Jun 12, 2019, 8:38 PM

                                          @Joe-Gill Unfortunately don’t have enough time to do another debug session with you. But maybe I can give you enough hints so you can dig it up yourself.

                                          Remember that I enabled mysql query logging yesterday?! First you login to the web UI, clear all the old tasks there and select the group you want to schedule a multicast task for. Prepare this as far as possible but don’t hit the button to create it yet but enable database query logging (and clear the log we created yesterday):

                                          shell> echo -n "" >/var/log/mariadb/query.log
                                          shell> mysql -u root -p
                                          Password:
                                          ...
                                          mysql> SET GLOBAL general_log_file='/var/log/mariadb/query.log';
                                          ...
                                          mysql> SET GLOBAL general_log=1;
                                          

                                          Now click create multicast task and then stop query logging again:

                                          mysql> SET GLOBAL general_log=0;
                                          

                                          Now take a look at the query.log file. What you are looking for is probably something like INSERT INTO multicastSessions .... Just use search function of the text editor to find that part. Now when you find this you just copy the whole SQL command and try to execute that in the mysql shell manually. Most probably you’ll get an error from that and we might find out why.

                                          Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                                          Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                                          J 1 Reply Last reply Jun 12, 2019, 8:42 PM Reply Quote 0
                                          • 1
                                          • 2
                                          • 1 / 2
                                          1 / 2
                                          • First post
                                            7/34
                                            Last post

                                          199

                                          Online

                                          12.0k

                                          Users

                                          17.3k

                                          Topics

                                          155.2k

                                          Posts
                                          Copyright © 2012-2024 FOG Project