• Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login
  • Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login

Popularity Contest

Scheduled Pinned Locked Moved
Feature Request
5
50
8.6k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • W
    Wayne Workman
    last edited by Sep 27, 2020, 8:04 PM

    Got a bit more done on this today.

    The comparison between my work and the dev-branch can be seen here.

    This is what the settings look like:
    fog_analytics_settings.png

    This is what the cron job looks like - this is dynamically generated when the installer runs:
    fog_analytics_cron_job.png

    This is what the logging on your local FOG Server will look like:
    fog_analytics_logging.png

    I’ll be using the daily installation tests against my own fogproject fork to test against all the major OSs here shortly. I’ll validate the cron jobs get created correctly on each and then I’ll manually change all of the cron jobs to run every minute. This is so I can test immediately rather than waiting a week.

    Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
    Daily Clean Installation Results:
    https://fogtesting.fogproject.us/
    FOG Reporting:
    https://fog-external-reporting-results.fogproject.us/

    1 Reply Last reply Reply Quote 1
    • S
      Sebastian Roth Moderator
      last edited by Sep 27, 2020, 9:22 PM

      @Wayne-Workman Well done! Haven’t had a chance to test but looks fine on first sight.

      May I ask you to rename it all. The word “analytics” has just so much background to it - we don’t do real analytics here…

      Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

      Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

      1 Reply Last reply Reply Quote 0
      • W
        Wayne Workman
        last edited by Sep 27, 2020, 10:02 PM

        What do you want it to be called?

        Tom had used the “analytics” term in his suggestions which is why I named everything like that, as later on it might be expanded to do more than simply collecting versions. Originally I named everything “popularity”

        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
        Daily Clean Installation Results:
        https://fogtesting.fogproject.us/
        FOG Reporting:
        https://fog-external-reporting-results.fogproject.us/

        T 1 Reply Last reply Sep 27, 2020, 10:50 PM Reply Quote 0
        • T
          Tom Elliott @Wayne Workman
          last edited by Sep 27, 2020, 10:50 PM

          @Wayne-Workman, @Sebastian-Roth

          I think analytics is the appropriate term, even if the information we’re using is minimal.

          I’ve added similar code, slightly revised.

          Please take a look and let me know:

          https://github.com/FOGProject/fogproject/commit/1435d1b1852e452295359fb045f3bb38f01ba18f
          This introduces the information - but I had a typo which is where the “second” link comes in.

          AND

          https://github.com/FOGProject/fogproject/commit/acfc6445d3b8f9497bf2b63e69e3faec0c51ee51

          Thank you,

          Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

          Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

          Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

          W 1 Reply Last reply Sep 27, 2020, 11:17 PM Reply Quote 0
          • W
            Wayne Workman @Tom Elliott
            last edited by Sep 27, 2020, 11:17 PM

            @Tom-Elliott Looks fine to me. Should I submit a pull request to the dev-branch since you’ve already added this to the 1.6 branch?

            Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
            Daily Clean Installation Results:
            https://fogtesting.fogproject.us/
            FOG Reporting:
            https://fog-external-reporting-results.fogproject.us/

            T 1 Reply Last reply Sep 28, 2020, 12:14 AM Reply Quote 0
            • T
              Tom Elliott @Wayne Workman
              last edited by Sep 28, 2020, 12:14 AM

              @Wayne-Workman I think that’d work best, yes.

              Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

              Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

              Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

              1 Reply Last reply Reply Quote 0
              • W
                Wayne Workman
                last edited by Sep 28, 2020, 2:02 AM

                I’ve validated the installation code as I’ve written it does work against all the major distributions - and I’ve also discovered my daily test for Ubuntu 20 was really Ubuntu 18 🤦 (fixed now).

                Below is what the data looks like in my test environment. It’s interesting to note that RedHat changes it’s distribution name from major release to major release. It’s of no consequence for our use, but I think that’s interesting.

                versions_out_there.png

                The server-side’s code is in this PR:
                https://github.com/FOGProject/fog-community-scripts/pull/62

                The FOG Server’s code is in this PR:
                https://github.com/FOGProject/fogproject/pull/405

                Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                Daily Clean Installation Results:
                https://fogtesting.fogproject.us/
                FOG Reporting:
                https://fog-external-reporting-results.fogproject.us/

                1 Reply Last reply Reply Quote 0
                • S
                  Sebastian Roth Moderator
                  last edited by Sep 28, 2020, 1:17 PM

                  @Tom-Elliott said in Popularity Contest:

                  I think analytics is the appropriate term, even if the information we’re using is minimal.

                  I don’t agree! The term “analytics” implies way more than we do and it might turn down people who use FOG and don’t like analytic stuff that is going on all over the web.

                  Why should we name it something we don’t want to do - and I am absolutely sure I never add real analytics stuff to FOG myself.

                  Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                  Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                  1 Reply Last reply Reply Quote 0
                  • W
                    Wayne Workman
                    last edited by Sep 28, 2020, 1:51 PM

                    Maybe we call it “Rainman”?

                    alt text

                    Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                    Daily Clean Installation Results:
                    https://fogtesting.fogproject.us/
                    FOG Reporting:
                    https://fog-external-reporting-results.fogproject.us/

                    JunkhackerJ 1 Reply Last reply Sep 28, 2020, 1:52 PM Reply Quote 1
                    • JunkhackerJ
                      Junkhacker Developer @Wayne Workman
                      last edited by Sep 28, 2020, 1:52 PM

                      @Wayne-Workman how about “install survey”

                      signature:
                      Junkhacker
                      We are here to help you. If you are unresponsive to our questions, don't expect us to be responsive to yours.

                      1 Reply Last reply Reply Quote 1
                      • T
                        Tom Elliott
                        last edited by Tom Elliott Sep 28, 2020, 8:14 AM Sep 28, 2020, 2:13 PM

                        Analytics:

                        information resulting from the systematic analysis of data or statistics.
                        

                        What are we gathering,
                        OS Name/Type, OS Version, FOG Version

                        What are we doing?
                        Analyzing how many of a type of OS and version, along with the number of “versions” run out in the wild.

                        While the data we’re gathering is, right now, only very basic, I think analytics is still the true term.

                        If we decide analytics is not the term to use, I still think it’s important to add (and I’m working on doing that) a way for the admins to disable if they don’t want their information being reported. We’re not doing much or collecting any metrics of the data in the sense of IPs or how we can best improve our code base. We are, after all, collecting and sending data to another source.

                        This information we are gathering is still a form of data we can use to gather what Operating Systems and versions, along with the general FOG version being used in the wild.

                        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

                        Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                        Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                        1 Reply Last reply Reply Quote 0
                        • T
                          Tom Elliott
                          last edited by Tom Elliott Sep 28, 2020, 9:42 AM Sep 28, 2020, 3:18 PM

                          Added ability to turn on/off this “feature”.

                            FOG would like to collect some data:
                                We would like to collect the following information:
                                  1. OS Name (CentOS, RedHat, Debian, etc....)
                                  2. OS Version (8.0.2004, 7.2.1409, 9, etc....)
                                  3. FOG Version (1.5.9, 1.6, etc....)
                          
                            What is this information used for?
                                We would like to simply track the common types of OS
                                being used, along with the OS Version, and the various
                                versions of FOG being used.
                          
                            Are you ok with sending this information? [Y/n]
                          

                          When Selected either yes or no, the screen will tell status as well:

                           * Here are the settings FOG will use:
                           * Base Linux: Redhat
                           * Detected Linux Distribution: CentOS Linux
                           * Server IP Address: ....
                           * Server Subnet Mask: ....
                           * Hostname: fogserver
                           * Installation Type: Normal Server
                           * Internationalization: 0
                           * Image Storage Location: /images
                           * Using FOG DHCP: Yes
                           * DHCP router Address: ...
                           * Send OS Name, OS Version, and FOG Version: Yes
                          

                          Or:

                           * Here are the settings FOG will use:
                           * Base Linux: Redhat
                           * Detected Linux Distribution: CentOS Linux
                           * Server IP Address: ....
                           * Server Subnet Mask: ....
                           * Hostname: fogserver
                           * Installation Type: Normal Server
                           * Internationalization: 0
                           * Image Storage Location: /images
                           * Using FOG DHCP: Yes
                           * DHCP router Address: ...
                           * Send OS Name, OS Version, and FOG Version: No
                          

                          Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

                          Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                          Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                          JunkhackerJ 1 Reply Last reply Sep 28, 2020, 3:31 PM Reply Quote 0
                          • JunkhackerJ
                            Junkhacker Developer @Tom Elliott
                            last edited by Sep 28, 2020, 3:31 PM

                            @Tom-Elliott i think we should default to Y/n instead of y/N

                            most people don’t care one way or the other and will just click through, let the people who care chose not to send it

                            signature:
                            Junkhacker
                            We are here to help you. If you are unresponsive to our questions, don't expect us to be responsive to yours.

                            T 1 Reply Last reply Sep 28, 2020, 3:38 PM Reply Quote 1
                            • T
                              Tom Elliott @Junkhacker
                              last edited by Tom Elliott Sep 28, 2020, 9:41 AM Sep 28, 2020, 3:38 PM

                              @Junkhacker working-1.6 has been updated with this.

                              I agree that most will not mind.

                              I just didn’t want people to get into this unknowningly.

                              I don’t know how many people use the -y switch, so that was why I wanted to “err” on keeping things as they are.

                              Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

                              Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                              Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                              1 Reply Last reply Reply Quote 0
                              • T
                                Tom Elliott
                                last edited by Sep 28, 2020, 4:06 PM

                                Instead of Analytics, or Rainman (though I love this movie), or “Install survey”

                                Something that’s more explicit to what it’s doing:

                                FOG External Reporting

                                Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

                                Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                                Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                                1 Reply Last reply Reply Quote 2
                                • W
                                  Wayne Workman
                                  last edited by Wayne Workman Sep 28, 2020, 12:24 PM Sep 28, 2020, 6:23 PM

                                  FOG External Reporting sounds good to me. I’ll get the endpoint name changed sometime tonight and submit a PR for that.

                                  I’m still needing to put together the last pieces of this, the presentation layer. This will be coming over the next couple weeks. Plans are to render some basic bar graphs showing the information gathered from the last 7 days, and to make available the database dump. Probably a cron-job to refresh those things every hour.

                                  Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                                  Daily Clean Installation Results:
                                  https://fogtesting.fogproject.us/
                                  FOG Reporting:
                                  https://fog-external-reporting-results.fogproject.us/

                                  1 Reply Last reply Reply Quote 1
                                  • W
                                    Wayne Workman
                                    last edited by Oct 6, 2020, 5:44 PM

                                    How exciting, entries! A whole lot of Ubuntu, one of them is Ubuntu 16!
                                    entries.png

                                    Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                                    Daily Clean Installation Results:
                                    https://fogtesting.fogproject.us/
                                    FOG Reporting:
                                    https://fog-external-reporting-results.fogproject.us/

                                    1 Reply Last reply Reply Quote 1
                                    • W
                                      Wayne Workman
                                      last edited by Wayne Workman Oct 10, 2020, 12:26 AM Oct 10, 2020, 6:20 AM

                                      Here is my first pass at the presentation layer: http://fog-external-reporting-results.theworkmans.us

                                      The graphs/files/stats automatically are updated every hour. I think the graphs could use color adjustments, but overall I’m pretty satisfied. What do you all think? BTW, the data in here is real!

                                      The next phase of this is abuse detection for the data reported. I need to scan for profanity, insults, etc; to keep the graphs clean. Python has tools for all of that.

                                      Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                                      Daily Clean Installation Results:
                                      https://fogtesting.fogproject.us/
                                      FOG Reporting:
                                      https://fog-external-reporting-results.fogproject.us/

                                      1 Reply Last reply Reply Quote 0
                                      • S
                                        Sebastian Roth Moderator
                                        last edited by Oct 10, 2020, 9:03 AM

                                        @Wayne-Workman Sounds awesome but right now I get a “Bad Gateway” message instead.

                                        Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                                        Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                                        1 Reply Last reply Reply Quote 0
                                        • W
                                          Wayne Workman
                                          last edited by Oct 10, 2020, 2:03 PM

                                          Fixed: http://fog-external-reporting-results.theworkmans.us/

                                          Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                                          Daily Clean Installation Results:
                                          https://fogtesting.fogproject.us/
                                          FOG Reporting:
                                          https://fog-external-reporting-results.fogproject.us/

                                          1 Reply Last reply Reply Quote 0
                                          • 1
                                          • 2
                                          • 3
                                          • 2 / 3
                                          • First post
                                            Last post

                                          189

                                          Online

                                          12.0k

                                          Users

                                          17.3k

                                          Topics

                                          155.2k

                                          Posts
                                          Copyright © 2012-2024 FOG Project