• Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login
  • Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login

virtualbox client can't netboot pxe-e74 Bad or missing PXE menu and/or prompt information

Scheduled Pinned Locked Moved Unsolved
FOG Problems
6
21
6.6k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • M
    MarcB
    last edited by Dec 1, 2016, 7:31 PM

    Server
    • FOG Version: 1.2.0, not serving dhcp, but using dnsmasq. Works fine with non-virtual client machines.
    • OS: ubuntu 14.04.5
    Client

    Virtualbox

    Description

    Virtualbox starts, gets a dhcp address from the cisco switch, but doesn’t seem to get more info fog server. Error is: pxe-e74 Bad or missing PXE menu and/or prompt information

    1 Reply Last reply Reply Quote 0
    • G
      george1421 Moderator
      last edited by george1421 Dec 1, 2016, 1:39 PM Dec 1, 2016, 7:38 PM

      is the FOG server, dhcp server and target computer (vm) on the same subnet (broadcast domain)?

      <edit> Wait, I see it works correctly with non-virtual (vbox) machines. The question is what is the virtual box vm doing that is different?

      Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

      T 1 Reply Last reply Dec 1, 2016, 7:41 PM Reply Quote 0
      • T
        Tom Elliott @george1421
        last edited by Dec 1, 2016, 7:41 PM

        @george1421 maybe natted net when it should be bridged?

        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

        Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

        Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

        G 1 Reply Last reply Dec 1, 2016, 7:43 PM Reply Quote 2
        • G
          george1421 Moderator @Tom Elliott
          last edited by Dec 1, 2016, 7:43 PM

          @Tom-Elliott said in virtualbox client can't netboot pxe-e74 Bad or missing PXE menu and/or prompt information:

          @george1421 maybe natted net when it should be bridged?

          I guess I need to mess around with virtual box for a bit, I only work with VMWare any more.

          Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

          1 Reply Last reply Reply Quote 0
          • S
            sudburr
            last edited by sudburr Dec 1, 2016, 3:12 PM Dec 1, 2016, 9:10 PM

            To add PXE boot capabilities to an Oracle VirtualBox machine you must add a version-matching ExtensionPack (.vbox-extpack)).

            For Oracle VirtualBox 5.1.10, download from Index of /virtualbox/5.1.10 then add it to your Oracle VirtualBox via menu Preferences > Extensions

            [ Standing in between extinction in the cold and explosive radiating growth ]

            1 Reply Last reply Reply Quote 2
            • X
              x23piracy
              last edited by x23piracy Dec 2, 2016, 5:24 AM Dec 2, 2016, 11:15 AM

              Hi,

              i have a working UEFI PXE Boot with any normal Computer but howto get Network booting enabled after enabling EFI in Virtualbox?
              When i set a VM EFI enabled and Boot device to Network it always just boots into a PXE Shell.

              alt text

              alt text

              When i Press F12 while booting to get into the boot menu i cannot see a network device to boot from:

              alt text

              When trying to add that boot option i just get an empty windows:

              alt text

              alt text

              Howto tell the machine to boot from network?

              Regards X23

              ║▌║█║▌│║▌║▌█

              1 Reply Last reply Reply Quote 0
              • M
                MarcB
                last edited by Dec 2, 2016, 8:31 PM

                The VM is definitely bridged, and is getting an address on the appropriate network. The Oracle VM VirtualBox Extension Pack shows up in Preferences as “Active” and is the same version as the Virtualbox Software app.

                As I said earlier, non-virtual machines get an address from our dhcp server, and are directed to the FOG server by dnsmasq. Here’s the logging that takes place as the VM tries to boot (I’m hitting “F12” when the machine boots).

                Dec 2 13:28:05 FogServer dnsmasq-dhcp[1061]: 708220777 available DHCP subnet: 10.105.0.45/255.255.0.0
                Dec 2 13:28:05 FogServer dnsmasq-dhcp[1061]: 708220777 vendor class: PXEClient:Arch:00000:UNDI:002001
                Dec 2 13:28:05 FogServer dnsmasq-dhcp[1061]: 708220777 PXE(eth0) 08:00:27:36:97:69 proxy
                Dec 2 13:28:05 FogServer dnsmasq-dhcp[1061]: 708220777 tags: eth0
                Dec 2 13:28:05 FogServer dnsmasq-dhcp[1061]: 708220777 bootfile name: undionly.kpxe
                Dec 2 13:28:05 FogServer dnsmasq-dhcp[1061]: 708220777 next server: 10.105.0.45
                Dec 2 13:28:05 FogServer dnsmasq-dhcp[1061]: 708220777 broadcast response
                Dec 2 13:28:05 FogServer dnsmasq-dhcp[1061]: 708220777 sent size: 1 option: 53 message-type 2
                Dec 2 13:28:05 FogServer dnsmasq-dhcp[1061]: 708220777 sent size: 4 option: 54 server-identifier 10.105.0.45
                Dec 2 13:28:05 FogServer dnsmasq-dhcp[1061]: 708220777 sent size: 9 option: 60 vendor-class 50:58:45:43:6c:69:65:6e:74
                Dec 2 13:28:05 FogServer dnsmasq-dhcp[1061]: 708220777 sent size: 17 option: 97 client-machine-id 00:48:15:92:73:ec:12:42:36:a8:2b:f0:4b:de…
                Dec 2 13:28:05 FogServer dnsmasq-dhcp[1061]: 708220777 sent size: 88 option: 43 vendor-encap 06:01:03:08:07:80:00:01:0a:69:00:2d:09:30…
                Dec 2 13:28:13 FogServer dnsmasq-dhcp[1061]: 708220777 available DHCP subnet: 10.105.0.45/255.255.0.0
                Dec 2 13:28:13 FogServer dnsmasq-dhcp[1061]: 708220777 vendor class: PXEClient:Arch:00000:UNDI:002001

                1 Reply Last reply Reply Quote 0
                • M
                  MarcB
                  last edited by Dec 2, 2016, 8:40 PM

                  Oh, and for the record our fog server is a physical box (non-vm). The only VM in question is the one I’m trying to boot from the fog server.

                  G 1 Reply Last reply Dec 2, 2016, 9:08 PM Reply Quote 0
                  • G
                    george1421 Moderator @MarcB
                    last edited by Dec 2, 2016, 9:08 PM

                    @MarcB Is your target machine, dnsmasq server, and dhcp server on the same subnet (broadcast domain). If so then we should probably get a pcap file of of this pxe boot to error message.

                    1. install tcpdump on your fog server
                    2. start tcpdump with this command line at the fog console prompt tcpdump -w output.pcap port 67 or port 68 or port 69 or port 4011
                    3. then pxe boot the target computer (vm) to error
                    4. once at the pxe error press ctrl-c to stop tcpdump
                    5. post it here for review.

                    This will tell us what your dhcp server/dnsmasq server/ and what your client is asking of the tftp server.

                    Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                    M 1 Reply Last reply Dec 3, 2016, 6:32 PM Reply Quote 0
                    • M
                      MarcB @george1421
                      last edited by Dec 3, 2016, 6:32 PM

                      @george1421 said in virtualbox client can't netboot pxe-e74 Bad or missing PXE menu and/or prompt information:

                      @MarcB Is your target machine, dnsmasq server, and dhcp server on the same subnet (broadcast domain). If so then we should probably get a pcap file of of this pxe boot to error message.

                      1. install tcpdump on your fog server
                      2. start tcpdump with this command line at the fog console prompt tcpdump -w output.pcap port 67 or port 68 or port 69 or port 4011
                      3. then pxe boot the target computer (vm) to error
                      4. once at the pxe error press ctrl-c to stop tcpdump
                      5. post it here for review.

                      This will tell us what your dhcp server/dnsmasq server/ and what your client is asking of the tftp server.

                      Thanks again for your help with this issue.

                      I thought I should add that, with the exception of bridged networking, all other settings for virtualbox client are the default settings for an ubuntu 64-bit install.

                      Here’s the output file of the tcpdump command (run as sudo):

                        1 0.000000       0.0.0.0               255.255.255.255       DHCP     590    DHCP Discover - Transaction ID 0x2a7d818f
                      

                      Frame 1: 590 bytes on wire (4720 bits), 590 bytes captured (4720 bits)
                      Encapsulation type: Ethernet (1)
                      Arrival Time: Dec 3, 2016 10:37:25.359036000 MST
                      [Time shift for this packet: 0.000000000 seconds]
                      Epoch Time: 1480786645.359036000 seconds
                      [Time delta from previous captured frame: 0.000000000 seconds]
                      [Time delta from previous displayed frame: 0.000000000 seconds]
                      [Time since reference or first frame: 0.000000000 seconds]
                      Frame Number: 1
                      Frame Length: 590 bytes (4720 bits)
                      Capture Length: 590 bytes (4720 bits)
                      [Frame is marked: False]
                      [Frame is ignored: False]
                      [Protocols in frame: eth:ethertype:ip:udp:bootp]
                      [Coloring Rule Name: UDP]
                      [Coloring Rule String: udp]
                      Ethernet II, Src: CadmusCo_7d:81:8f (08:00:27:7d:81:8f), Dst: Broadcast (ff:ff:ff:ff:ff:ff)
                      Destination: Broadcast (ff:ff:ff:ff:ff:ff)
                      Address: Broadcast (ff:ff:ff:ff:ff:ff)
                      … …1. … … … … = LG bit: Locally administered address (this is NOT the factory default)
                      … …1 … … … … = IG bit: Group address (multicast/broadcast)
                      Source: CadmusCo_7d:81:8f (08:00:27:7d:81:8f)
                      Address: CadmusCo_7d:81:8f (08:00:27:7d:81:8f)
                      … …0. … … … … = LG bit: Globally unique address (factory default)
                      … …0 … … … … = IG bit: Individual address (unicast)
                      Type: IP (0x0800)
                      Internet Protocol Version 4, Src: 0.0.0.0 (0.0.0.0), Dst: 255.255.255.255 (255.255.255.255)
                      0100 … = Version: 4
                      … 0101 = Header Length: 20 bytes
                      Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN 0x00: Not-ECT (Not ECN-Capable Transport))
                      0000 00… = Differentiated Services Codepoint: Default (0x00)
                      … …00 = Explicit Congestion Notification: Not-ECT (Not ECN-Capable Transport) (0x00)
                      Total Length: 576
                      Identification: 0x0002 (2)
                      Flags: 0x00
                      0… … = Reserved bit: Not set
                      .0… … = Don’t fragment: Not set
                      …0. … = More fragments: Not set
                      Fragment offset: 0
                      Time to live: 20
                      Protocol: UDP (17)
                      Header checksum: 0xa4ac [validation disabled]
                      [Good: False]
                      [Bad: False]
                      Source: 0.0.0.0 (0.0.0.0)
                      Destination: 255.255.255.255 (255.255.255.255)
                      [Source GeoIP: Unknown]
                      [Destination GeoIP: Unknown]
                      User Datagram Protocol, Src Port: 68 (68), Dst Port: 67 (67)
                      Source Port: 68 (68)
                      Destination Port: 67 (67)
                      Length: 556
                      Checksum: 0x053d [validation disabled]
                      [Good Checksum: False]
                      [Bad Checksum: False]
                      [Stream index: 0]
                      Bootstrap Protocol (Discover)
                      Message type: Boot Request (1)
                      Hardware type: Ethernet (0x01)
                      Hardware address length: 6
                      Hops: 0
                      Transaction ID: 0x2a7d818f
                      Seconds elapsed: 10
                      Bootp flags: 0x8000, Broadcast flag (Broadcast)
                      1… … … … = Broadcast flag: Broadcast
                      .000 0000 0000 0000 = Reserved flags: 0x0000
                      Client IP address: 0.0.0.0 (0.0.0.0)
                      Your (client) IP address: 0.0.0.0 (0.0.0.0)
                      Next server IP address: 0.0.0.0 (0.0.0.0)
                      Relay agent IP address: 0.0.0.0 (0.0.0.0)
                      Client MAC address: CadmusCo_7d:81:8f (08:00:27:7d:81:8f)
                      Client hardware address padding: 00000000000000000000
                      Server host name not given
                      Boot file name not given
                      Magic cookie: DHCP
                      Option: (53) DHCP Message Type (Discover)
                      Length: 1
                      DHCP: Discover (1)
                      Option: (55) Parameter Request List
                      Length: 36
                      Parameter Request List Item: (1) Subnet Mask
                      Parameter Request List Item: (2) Time Offset
                      Parameter Request List Item: (3) Router
                      Parameter Request List Item: (4) Time Server
                      Parameter Request List Item: (5) Name Server
                      Parameter Request List Item: (6) Domain Name Server
                      Parameter Request List Item: (11) Resource Location Server
                      Parameter Request List Item: (12) Host Name
                      Parameter Request List Item: (13) Boot File Size
                      Parameter Request List Item: (15) Domain Name
                      Parameter Request List Item: (16) Swap Server
                      Parameter Request List Item: (17) Root Path
                      Parameter Request List Item: (18) Extensions Path
                      Parameter Request List Item: (22) Maximum Datagram Reassembly Size
                      Parameter Request List Item: (23) Default IP Time-to-Live
                      Parameter Request List Item: (28) Broadcast Address
                      Parameter Request List Item: (40) Network Information Service Domain
                      Parameter Request List Item: (41) Network Information Service Servers
                      Parameter Request List Item: (42) Network Time Protocol Servers
                      Parameter Request List Item: (43) Vendor-Specific Information
                      Parameter Request List Item: (50) Requested IP Address
                      Parameter Request List Item: (51) IP Address Lease Time
                      Parameter Request List Item: (54) DHCP Server Identifier
                      Parameter Request List Item: (58) Renewal Time Value
                      Parameter Request List Item: (59) Rebinding Time Value
                      Parameter Request List Item: (60) Vendor class identifier
                      Parameter Request List Item: (66) TFTP Server Name
                      Parameter Request List Item: (67) Bootfile name
                      Parameter Request List Item: (128) DOCSIS full security server IP [TODO]
                      Parameter Request List Item: (129) PXE - undefined (vendor specific)
                      Parameter Request List Item: (130) PXE - undefined (vendor specific)
                      Parameter Request List Item: (131) PXE - undefined (vendor specific)
                      Parameter Request List Item: (132) PXE - undefined (vendor specific)
                      Parameter Request List Item: (133) PXE - undefined (vendor specific)
                      Parameter Request List Item: (134) PXE - undefined (vendor specific)
                      Parameter Request List Item: (135) PXE - undefined (vendor specific)
                      Option: (57) Maximum DHCP Message Size
                      Length: 2
                      Maximum DHCP Message Size: 1260
                      Option: (97) UUID/GUID-based Client Identifier
                      Length: 17
                      Client Identifier (UUID): 73921548-12ec-3642-a82b-f04bdec7667c
                      Option: (93) Client System Architecture
                      Length: 2
                      Client System Architecture: IA x86 PC (0)
                      Option: (94) Client Network Device Interface
                      Length: 3
                      Major Version: 2
                      Minor Version: 1
                      Option: (60) Vendor class identifier
                      Length: 32
                      Vendor class identifier: PXEClient:Arch:00000:UNDI:002001
                      Option: (255) End
                      Option End: 255
                      Padding: 000000000000000000000000000000000000000000000000…

                        2 0.001702       10.105.0.1            255.255.255.255       DHCP     381    DHCP Offer    - Transaction ID 0x2a7d818f
                      

                      Frame 2: 381 bytes on wire (3048 bits), 381 bytes captured (3048 bits)
                      Encapsulation type: Ethernet (1)
                      Arrival Time: Dec 3, 2016 10:37:25.360738000 MST
                      [Time shift for this packet: 0.000000000 seconds]
                      Epoch Time: 1480786645.360738000 seconds
                      [Time delta from previous captured frame: 0.001702000 seconds]
                      [Time delta from previous displayed frame: 0.001702000 seconds]
                      [Time since reference or first frame: 0.001702000 seconds]
                      Frame Number: 2
                      Frame Length: 381 bytes (3048 bits)
                      Capture Length: 381 bytes (3048 bits)
                      [Frame is marked: False]
                      [Frame is ignored: False]
                      [Protocols in frame: eth:ethertype:ip:udp:bootp]
                      [Coloring Rule Name: UDP]
                      [Coloring Rule String: udp]
                      Ethernet II, Src: Cisco_1d:10:00 (00:0a:8a:1d:10:00), Dst: Broadcast (ff:ff:ff:ff:ff:ff)
                      Destination: Broadcast (ff:ff:ff:ff:ff:ff)
                      Address: Broadcast (ff:ff:ff:ff:ff:ff)
                      … …1. … … … … = LG bit: Locally administered address (this is NOT the factory default)
                      … …1 … … … … = IG bit: Group address (multicast/broadcast)
                      Source: Cisco_1d:10:00 (00:0a:8a:1d:10:00)
                      Address: Cisco_1d:10:00 (00:0a:8a:1d:10:00)
                      … …0. … … … … = LG bit: Globally unique address (factory default)
                      … …0 … … … … = IG bit: Individual address (unicast)
                      Type: IP (0x0800)
                      Internet Protocol Version 4, Src: 10.105.0.1 (10.105.0.1), Dst: 255.255.255.255 (255.255.255.255)
                      0100 … = Version: 4
                      … 0101 = Header Length: 20 bytes
                      Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN 0x00: Not-ECT (Not ECN-Capable Transport))
                      0000 00… = Differentiated Services Codepoint: Default (0x00)
                      … …00 = Explicit Congestion Notification: Not-ECT (Not ECN-Capable Transport) (0x00)
                      Total Length: 367
                      Identification: 0xa0c5 (41157)
                      Flags: 0x00
                      0… … = Reserved bit: Not set
                      .0… … = Don’t fragment: Not set
                      …0. … = More fragments: Not set
                      Fragment offset: 0
                      Time to live: 255
                      Protocol: UDP (17)
                      Header checksum: 0x0f4f [validation disabled]
                      [Good: False]
                      [Bad: False]
                      Source: 10.105.0.1 (10.105.0.1)
                      Destination: 255.255.255.255 (255.255.255.255)
                      [Source GeoIP: Unknown]
                      [Destination GeoIP: Unknown]
                      User Datagram Protocol, Src Port: 67 (67), Dst Port: 68 (68)
                      Source Port: 67 (67)
                      Destination Port: 68 (68)
                      Length: 347
                      Checksum: 0x29f4 [validation disabled]
                      [Good Checksum: False]
                      [Bad Checksum: False]
                      [Stream index: 1]
                      Bootstrap Protocol (Offer)
                      Message type: Boot Reply (2)
                      Hardware type: Ethernet (0x01)
                      Hardware address length: 6
                      Hops: 0
                      Transaction ID: 0x2a7d818f
                      Seconds elapsed: 0
                      Bootp flags: 0x8000, Broadcast flag (Broadcast)
                      1… … … … = Broadcast flag: Broadcast
                      .000 0000 0000 0000 = Reserved flags: 0x0000
                      Client IP address: 0.0.0.0 (0.0.0.0)
                      Your (client) IP address: 10.105.204.73 (10.105.204.73)
                      Next server IP address: 0.0.0.0 (0.0.0.0)
                      Relay agent IP address: 0.0.0.0 (0.0.0.0)
                      Client MAC address: CadmusCo_7d:81:8f (08:00:27:7d:81:8f)
                      Client hardware address padding: 00000000000000000000
                      Server host name not given
                      Boot file name not given
                      Magic cookie: DHCP
                      Option: (53) DHCP Message Type (Offer)
                      Length: 1
                      DHCP: Offer (2)
                      Option: (54) DHCP Server Identifier
                      Length: 4
                      DHCP Server Identifier: 10.105.0.1 (10.105.0.1)
                      Option: (51) IP Address Lease Time
                      Length: 4
                      IP Address Lease Time: (11858s) 3 hours, 17 minutes, 38 seconds
                      Option: (58) Renewal Time Value
                      Length: 4
                      Renewal Time Value: (5929s) 1 hour, 38 minutes, 49 seconds
                      Option: (59) Rebinding Time Value
                      Length: 4
                      Rebinding Time Value: (10375s) 2 hours, 52 minutes, 55 seconds
                      Option: (1) Subnet Mask
                      Length: 4
                      Subnet Mask: 255.255.0.0 (255.255.0.0)
                      Option: (15) Domain Name
                      Length: 10
                      Domain Name: SITE.local
                      Option: (3) Router
                      Length: 4
                      Router: 10.105.0.1 (10.105.0.1)
                      Option: (43) Vendor-Specific Information
                      Length: 31
                      Value: 031d31302e37352e302e362c31302e37352e302e372c3130…
                      Option: (6) Domain Name Server
                      Length: 12
                      Domain Name Server: dnsserver2 (dnsserver2)
                      Domain Name Server: dnsserver3 (dnsserver3)
                      Domain Name Server: dnsserver1 (dnsserver1)
                      Option: (255) End
                      Option End: 255

                        3 0.095051       10.105.0.45           255.255.255.255       DHCP     412    DHCP Offer    - Transaction ID 0x2a7d818f
                      

                      Frame 3: 412 bytes on wire (3296 bits), 412 bytes captured (3296 bits)
                      Encapsulation type: Ethernet (1)
                      Arrival Time: Dec 3, 2016 10:37:25.454087000 MST
                      [Time shift for this packet: 0.000000000 seconds]
                      Epoch Time: 1480786645.454087000 seconds
                      [Time delta from previous captured frame: 0.093349000 seconds]
                      [Time delta from previous displayed frame: 0.093349000 seconds]
                      [Time since reference or first frame: 0.095051000 seconds]
                      Frame Number: 3
                      Frame Length: 412 bytes (3296 bits)
                      Capture Length: 412 bytes (3296 bits)
                      [Frame is marked: False]
                      [Frame is ignored: False]
                      [Protocols in frame: eth:ethertype:ip:udp:bootp]
                      [Coloring Rule Name: UDP]
                      [Coloring Rule String: udp]
                      Ethernet II, Src: DellInc_a3:1c:b5 (00:13:72:a3:1c:b5), Dst: Broadcast (ff:ff:ff:ff:ff:ff)
                      Destination: Broadcast (ff:ff:ff:ff:ff:ff)
                      Address: Broadcast (ff:ff:ff:ff:ff:ff)
                      … …1. … … … … = LG bit: Locally administered address (this is NOT the factory default)
                      … …1 … … … … = IG bit: Group address (multicast/broadcast)
                      Source: DellInc_a3:1c:b5 (00:13:72:a3:1c:b5)
                      Address: DellInc_a3:1c:b5 (00:13:72:a3:1c:b5)
                      … …0. … … … … = LG bit: Globally unique address (factory default)
                      … …0 … … … … = IG bit: Individual address (unicast)
                      Type: IP (0x0800)
                      Internet Protocol Version 4, Src: 10.105.0.45 (10.105.0.45), Dst: 255.255.255.255 (255.255.255.255)
                      0100 … = Version: 4
                      … 0101 = Header Length: 20 bytes
                      Differentiated Services Field: 0xc0 (DSCP 0x30: Class Selector 6; ECN 0x00: Not-ECT (Not ECN-Capable Transport))
                      1100 00… = Differentiated Services Codepoint: Class Selector 6 (0x30)
                      … …00 = Explicit Congestion Notification: Not-ECT (Not ECN-Capable Transport) (0x00)
                      Total Length: 398
                      Identification: 0xfa07 (64007)
                      Flags: 0x00
                      0… … = Reserved bit: Not set
                      .0… … = Don’t fragment: Not set
                      …0. … = More fragments: Not set
                      Fragment offset: 0
                      Time to live: 64
                      Protocol: UDP (17)
                      Header checksum: 0x7402 [validation disabled]
                      [Good: False]
                      [Bad: False]
                      Source: 10.105.0.45 (10.105.0.45)
                      Destination: 255.255.255.255 (255.255.255.255)
                      [Source GeoIP: Unknown]
                      [Destination GeoIP: Unknown]
                      User Datagram Protocol, Src Port: 67 (67), Dst Port: 68 (68)
                      Source Port: 67 (67)
                      Destination Port: 68 (68)
                      Length: 378
                      Checksum: 0x0c21 [validation disabled]
                      [Good Checksum: False]
                      [Bad Checksum: False]
                      [Stream index: 2]
                      Bootstrap Protocol (Offer)
                      Message type: Boot Reply (2)
                      Hardware type: Ethernet (0x01)
                      Hardware address length: 6
                      Hops: 0
                      Transaction ID: 0x2a7d818f
                      Seconds elapsed: 10
                      Bootp flags: 0x8000, Broadcast flag (Broadcast)
                      1… … … … = Broadcast flag: Broadcast
                      .000 0000 0000 0000 = Reserved flags: 0x0000
                      Client IP address: 0.0.0.0 (0.0.0.0)
                      Your (client) IP address: 0.0.0.0 (0.0.0.0)
                      Next server IP address: 10.105.0.45 (10.105.0.45)
                      Relay agent IP address: 0.0.0.0 (0.0.0.0)
                      Client MAC address: CadmusCo_7d:81:8f (08:00:27:7d:81:8f)
                      Client hardware address padding: 00000000000000000000
                      Server host name not given
                      Boot file name: undionly.kpxe
                      Magic cookie: DHCP
                      Option: (53) DHCP Message Type (Offer)
                      Length: 1
                      DHCP: Offer (2)
                      Option: (54) DHCP Server Identifier
                      Length: 4
                      DHCP Server Identifier: 10.105.0.45 (10.105.0.45)
                      Option: (60) Vendor class identifier
                      Length: 9
                      Vendor class identifier: PXEClient
                      Option: (97) UUID/GUID-based Client Identifier
                      Length: 17
                      Client Identifier (UUID): 73921548-12ec-3642-a82b-f04bdec7667c
                      Option: (43) Vendor-Specific Information (PXEClient)
                      Length: 88
                      Option 43 Suboption: (6) PXE discovery control
                      Length: 1
                      discovery control: 0x03
                      Option 43 Suboption: (8) PXE boot servers
                      Length: 7
                      boot servers: 8000010a69002d
                      Option 43 Suboption: (9) PXE boot menu
                      Length: 48
                      boot menu: 800011426f6f742066726f6d206e6574776f726b00001942…
                      Option 43 Suboption: (10) PXE menu prompt
                      Length: 23
                      menu prompt: 03507265737320463820666f7220626f6f74206d656e75
                      PXE Client End: 255
                      Option: (255) End
                      Option End: 255

                        4 8.019602       0.0.0.0               255.255.255.255       DHCP     590    DHCP Request  - Transaction ID 0x2a7d818f
                      

                      Frame 4: 590 bytes on wire (4720 bits), 590 bytes captured (4720 bits)
                      Encapsulation type: Ethernet (1)
                      Arrival Time: Dec 3, 2016 10:37:33.378638000 MST
                      [Time shift for this packet: 0.000000000 seconds]
                      Epoch Time: 1480786653.378638000 seconds
                      [Time delta from previous captured frame: 7.924551000 seconds]
                      [Time delta from previous displayed frame: 7.924551000 seconds]
                      [Time since reference or first frame: 8.019602000 seconds]
                      Frame Number: 4
                      Frame Length: 590 bytes (4720 bits)
                      Capture Length: 590 bytes (4720 bits)
                      [Frame is marked: False]
                      [Frame is ignored: False]
                      [Protocols in frame: eth:ethertype:ip:udp:bootp]
                      [Coloring Rule Name: UDP]
                      [Coloring Rule String: udp]
                      Ethernet II, Src: CadmusCo_7d:81:8f (08:00:27:7d:81:8f), Dst: Broadcast (ff:ff:ff:ff:ff:ff)
                      Destination: Broadcast (ff:ff:ff:ff:ff:ff)
                      Address: Broadcast (ff:ff:ff:ff:ff:ff)
                      … …1. … … … … = LG bit: Locally administered address (this is NOT the factory default)
                      … …1 … … … … = IG bit: Group address (multicast/broadcast)
                      Source: CadmusCo_7d:81:8f (08:00:27:7d:81:8f)
                      Address: CadmusCo_7d:81:8f (08:00:27:7d:81:8f)
                      … …0. … … … … = LG bit: Globally unique address (factory default)
                      … …0 … … … … = IG bit: Individual address (unicast)
                      Type: IP (0x0800)
                      Internet Protocol Version 4, Src: 0.0.0.0 (0.0.0.0), Dst: 255.255.255.255 (255.255.255.255)
                      0100 … = Version: 4
                      … 0101 = Header Length: 20 bytes
                      Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN 0x00: Not-ECT (Not ECN-Capable Transport))
                      0000 00… = Differentiated Services Codepoint: Default (0x00)
                      … …00 = Explicit Congestion Notification: Not-ECT (Not ECN-Capable Transport) (0x00)
                      Total Length: 576
                      Identification: 0x0003 (3)
                      Flags: 0x00
                      0… … = Reserved bit: Not set
                      .0… … = Don’t fragment: Not set
                      …0. … = More fragments: Not set
                      Fragment offset: 0
                      Time to live: 20
                      Protocol: UDP (17)
                      Header checksum: 0xa4ab [validation disabled]
                      [Good: False]
                      [Bad: False]
                      Source: 0.0.0.0 (0.0.0.0)
                      Destination: 255.255.255.255 (255.255.255.255)
                      [Source GeoIP: Unknown]
                      [Destination GeoIP: Unknown]
                      User Datagram Protocol, Src Port: 68 (68), Dst Port: 67 (67)
                      Source Port: 68 (68)
                      Destination Port: 67 (67)
                      Length: 556
                      Checksum: 0xddf3 [validation disabled]
                      [Good Checksum: False]
                      [Bad Checksum: False]
                      [Stream index: 0]
                      Bootstrap Protocol (Request)
                      Message type: Boot Request (1)
                      Hardware type: Ethernet (0x01)
                      Hardware address length: 6
                      Hops: 0
                      Transaction ID: 0x2a7d818f
                      Seconds elapsed: 10
                      Bootp flags: 0x8000, Broadcast flag (Broadcast)
                      1… … … … = Broadcast flag: Broadcast
                      .000 0000 0000 0000 = Reserved flags: 0x0000
                      Client IP address: 0.0.0.0 (0.0.0.0)
                      Your (client) IP address: 0.0.0.0 (0.0.0.0)
                      Next server IP address: 0.0.0.0 (0.0.0.0)
                      Relay agent IP address: 0.0.0.0 (0.0.0.0)
                      Client MAC address: CadmusCo_7d:81:8f (08:00:27:7d:81:8f)
                      Client hardware address padding: 00000000000000000000
                      Server host name not given
                      Boot file name not given
                      Magic cookie: DHCP
                      Option: (53) DHCP Message Type (Request)
                      Length: 1
                      DHCP: Request (3)
                      Option: (50) Requested IP Address
                      Length: 4
                      Requested IP Address: 10.105.204.73 (10.105.204.73)
                      Option: (55) Parameter Request List
                      Length: 36
                      Parameter Request List Item: (1) Subnet Mask
                      Parameter Request List Item: (2) Time Offset
                      Parameter Request List Item: (3) Router
                      Parameter Request List Item: (4) Time Server
                      Parameter Request List Item: (5) Name Server
                      Parameter Request List Item: (6) Domain Name Server
                      Parameter Request List Item: (11) Resource Location Server
                      Parameter Request List Item: (12) Host Name
                      Parameter Request List Item: (13) Boot File Size
                      Parameter Request List Item: (15) Domain Name
                      Parameter Request List Item: (16) Swap Server
                      Parameter Request List Item: (17) Root Path
                      Parameter Request List Item: (18) Extensions Path
                      Parameter Request List Item: (22) Maximum Datagram Reassembly Size
                      Parameter Request List Item: (23) Default IP Time-to-Live
                      Parameter Request List Item: (28) Broadcast Address
                      Parameter Request List Item: (40) Network Information Service Domain
                      Parameter Request List Item: (41) Network Information Service Servers
                      Parameter Request List Item: (42) Network Time Protocol Servers
                      Parameter Request List Item: (43) Vendor-Specific Information
                      Parameter Request List Item: (50) Requested IP Address
                      Parameter Request List Item: (51) IP Address Lease Time
                      Parameter Request List Item: (54) DHCP Server Identifier
                      Parameter Request List Item: (58) Renewal Time Value
                      Parameter Request List Item: (59) Rebinding Time Value
                      Parameter Request List Item: (60) Vendor class identifier
                      Parameter Request List Item: (66) TFTP Server Name
                      Parameter Request List Item: (67) Bootfile name
                      Parameter Request List Item: (128) DOCSIS full security server IP [TODO]
                      Parameter Request List Item: (129) PXE - undefined (vendor specific)
                      Parameter Request List Item: (130) PXE - undefined (vendor specific)
                      Parameter Request List Item: (131) PXE - undefined (vendor specific)
                      Parameter Request List Item: (132) PXE - undefined (vendor specific)
                      Parameter Request List Item: (133) PXE - undefined (vendor specific)
                      Parameter Request List Item: (134) PXE - undefined (vendor specific)
                      Parameter Request List Item: (135) PXE - undefined (vendor specific)
                      Option: (57) Maximum DHCP Message Size
                      Length: 2
                      Maximum DHCP Message Size: 1260
                      Option: (54) DHCP Server Identifier
                      Length: 4
                      DHCP Server Identifier: 10.105.0.1 (10.105.0.1)
                      Option: (97) UUID/GUID-based Client Identifier
                      Length: 17
                      Client Identifier (UUID): 73921548-12ec-3642-a82b-f04bdec7667c
                      Option: (93) Client System Architecture
                      Length: 2
                      Client System Architecture: IA x86 PC (0)
                      Option: (94) Client Network Device Interface
                      Length: 3
                      Major Version: 2
                      Minor Version: 1
                      Option: (60) Vendor class identifier
                      Length: 32
                      Vendor class identifier: PXEClient:Arch:00000:UNDI:002001
                      Option: (255) End
                      Option End: 255
                      Padding: 000000000000000000000000000000000000000000000000…

                        5 8.020447       10.105.0.1            255.255.255.255       DHCP     381    DHCP ACK      - Transaction ID 0x2a7d818f
                      

                      Frame 5: 381 bytes on wire (3048 bits), 381 bytes captured (3048 bits)
                      Encapsulation type: Ethernet (1)
                      Arrival Time: Dec 3, 2016 10:37:33.379483000 MST
                      [Time shift for this packet: 0.000000000 seconds]
                      Epoch Time: 1480786653.379483000 seconds
                      [Time delta from previous captured frame: 0.000845000 seconds]
                      [Time delta from previous displayed frame: 0.000845000 seconds]
                      [Time since reference or first frame: 8.020447000 seconds]
                      Frame Number: 5
                      Frame Length: 381 bytes (3048 bits)
                      Capture Length: 381 bytes (3048 bits)
                      [Frame is marked: False]
                      [Frame is ignored: False]
                      [Protocols in frame: eth:ethertype:ip:udp:bootp]
                      [Coloring Rule Name: UDP]
                      [Coloring Rule String: udp]
                      Ethernet II, Src: Cisco_1d:10:00 (00:0a:8a:1d:10:00), Dst: Broadcast (ff:ff:ff:ff:ff:ff)
                      Destination: Broadcast (ff:ff:ff:ff:ff:ff)
                      Address: Broadcast (ff:ff:ff:ff:ff:ff)
                      … …1. … … … … = LG bit: Locally administered address (this is NOT the factory default)
                      … …1 … … … … = IG bit: Group address (multicast/broadcast)
                      Source: Cisco_1d:10:00 (00:0a:8a:1d:10:00)
                      Address: Cisco_1d:10:00 (00:0a:8a:1d:10:00)
                      … …0. … … … … = LG bit: Globally unique address (factory default)
                      … …0 … … … … = IG bit: Individual address (unicast)
                      Type: IP (0x0800)
                      Internet Protocol Version 4, Src: 10.105.0.1 (10.105.0.1), Dst: 255.255.255.255 (255.255.255.255)
                      0100 … = Version: 4
                      … 0101 = Header Length: 20 bytes
                      Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN 0x00: Not-ECT (Not ECN-Capable Transport))
                      0000 00… = Differentiated Services Codepoint: Default (0x00)
                      … …00 = Explicit Congestion Notification: Not-ECT (Not ECN-Capable Transport) (0x00)
                      Total Length: 367
                      Identification: 0xa0c6 (41158)
                      Flags: 0x00
                      0… … = Reserved bit: Not set
                      .0… … = Don’t fragment: Not set
                      …0. … = More fragments: Not set
                      Fragment offset: 0
                      Time to live: 255
                      Protocol: UDP (17)
                      Header checksum: 0x0f4e [validation disabled]
                      [Good: False]
                      [Bad: False]
                      Source: 10.105.0.1 (10.105.0.1)
                      Destination: 255.255.255.255 (255.255.255.255)
                      [Source GeoIP: Unknown]
                      [Destination GeoIP: Unknown]
                      User Datagram Protocol, Src Port: 67 (67), Dst Port: 68 (68)
                      Source Port: 67 (67)
                      Destination Port: 68 (68)
                      Length: 347
                      Checksum: 0x9640 [validation disabled]
                      [Good Checksum: False]
                      [Bad Checksum: False]
                      [Stream index: 1]
                      Bootstrap Protocol (ACK)
                      Message type: Boot Reply (2)
                      Hardware type: Ethernet (0x01)
                      Hardware address length: 6
                      Hops: 0
                      Transaction ID: 0x2a7d818f
                      Seconds elapsed: 0
                      Bootp flags: 0x8000, Broadcast flag (Broadcast)
                      1… … … … = Broadcast flag: Broadcast
                      .000 0000 0000 0000 = Reserved flags: 0x0000
                      Client IP address: 0.0.0.0 (0.0.0.0)
                      Your (client) IP address: 10.105.204.73 (10.105.204.73)
                      Next server IP address: 0.0.0.0 (0.0.0.0)
                      Relay agent IP address: 0.0.0.0 (0.0.0.0)
                      Client MAC address: CadmusCo_7d:81:8f (08:00:27:7d:81:8f)
                      Client hardware address padding: 00000000000000000000
                      Server host name not given
                      Boot file name not given
                      Magic cookie: DHCP
                      Option: (53) DHCP Message Type (ACK)
                      Length: 1
                      DHCP: ACK (5)
                      Option: (54) DHCP Server Identifier
                      Length: 4
                      DHCP Server Identifier: 10.105.0.1 (10.105.0.1)
                      Option: (51) IP Address Lease Time
                      Length: 4
                      IP Address Lease Time: (86400s) 1 day
                      Option: (58) Renewal Time Value
                      Length: 4
                      Renewal Time Value: (43200s) 12 hours
                      Option: (59) Rebinding Time Value
                      Length: 4
                      Rebinding Time Value: (75600s) 21 hours
                      Option: (1) Subnet Mask
                      Length: 4
                      Subnet Mask: 255.255.0.0 (255.255.0.0)
                      Option: (15) Domain Name
                      Length: 10
                      Domain Name: SITE.local
                      Option: (3) Router
                      Length: 4
                      Router: 10.105.0.1 (10.105.0.1)
                      Option: (43) Vendor-Specific Information
                      Length: 31
                      Value: 031d31302e37352e302e362c31302e37352e302e372c3130…
                      Option: (6) Domain Name Server
                      Length: 12
                      Domain Name Server: dnsserver2 (dnsserver2)
                      Domain Name Server: dnsserver3 (dnsserver3)
                      Domain Name Server: dnsserver1 (dnsserver1)
                      Option: (255) End
                      Option End: 255

                      G 1 Reply Last reply Dec 3, 2016, 8:18 PM Reply Quote 0
                      • G
                        george1421 Moderator @MarcB
                        last edited by Dec 3, 2016, 8:18 PM

                        @MarcB would you mind posting the pcap file as an attachment I can’t load what was posted into wireshark to look at it. I’m not smart enough to read the pcap in text form.

                        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                        M 1 Reply Last reply Dec 5, 2016, 3:43 PM Reply Quote 0
                        • S
                          Sebastian Roth Moderator
                          last edited by Dec 3, 2016, 8:59 PM

                          This somehow sounds as if virtualbox client is not happy with option 43 being sent by dnsmasq in frame number 3. Quiet strange I find. Can you please post your dnsmasq config? Maybe try stripping options pxe-service and/or pxe-prompt from it - if set.

                          Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                          Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                          M 1 Reply Last reply Dec 5, 2016, 2:58 PM Reply Quote 0
                          • M
                            MarcB @Sebastian Roth
                            last edited by Dec 5, 2016, 2:58 PM

                            @Sebastian-Roth said in virtualbox client can't netboot pxe-e74 Bad or missing PXE menu and/or prompt information:

                            This somehow sounds as if virtualbox client is not happy with option 43 being sent by dnsmasq in frame number 3. Quiet strange I find. Can you please post your dnsmasq config? Maybe try stripping options pxe-service and/or pxe-prompt from it - if set.

                            I have 2 lines with that specify pxe-service options and tried commenting them both out. I also commented out pxe-prompt. None of these changes to my ltsp.conf file allowed the VM to netboot.

                            I’ll attach the ltsp.conf file here.0_1480949862710_ltsp.conf

                            Thanks for your help.

                            M

                            1 Reply Last reply Reply Quote 0
                            • M
                              MarcB @george1421
                              last edited by Dec 5, 2016, 3:43 PM

                              @george1421

                              I had tried to display everything I saw when I opened it up in Wireshark, but maybe I missed something.

                              There’s some information in the pcap that I can’t seem to scrup. I found an app called tracewrangler that I’ll try to work with to prepare the pcap file.

                              Thanks again,

                              Marc

                              G 1 Reply Last reply Dec 5, 2016, 4:21 PM Reply Quote 0
                              • G
                                george1421 Moderator @MarcB
                                last edited by Dec 5, 2016, 4:21 PM

                                @MarcB If you could post the actual pcap file and I’ll take a look at it.

                                Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                                M 1 Reply Last reply Dec 5, 2016, 6:55 PM Reply Quote 0
                                • M
                                  MarcB @george1421
                                  last edited by Dec 5, 2016, 6:55 PM

                                  @george1421

                                  Here’s the anonymized pcap. Hopefully it still provides all the relevant information you need.0_1480964109034_output_anon.pcapng

                                  1 Reply Last reply Reply Quote 0
                                  • S
                                    Sebastian Roth Moderator
                                    last edited by Sebastian Roth Dec 6, 2016, 6:00 AM Dec 6, 2016, 11:58 AM

                                    @MarcB In that new pcap file I see “boot file name” being empty in all DHCP answers. Therefore the client does not know which file to load. In the config you posted I see:

                                    ...
                                    dhcp-boot=undionly.kpxe,,FOGserverIP
                                    ...
                                    

                                    Please change this to (make sure the IP is the correct one pointing to your FOG server):

                                    ...
                                    dhcp-boot=undionly.kpxe,10.202.47.230,10.202.47.230
                                    ...
                                    

                                    I usually put the IP address twice, first as server name and the later one to point to the actual IP - see the man page for details about all the options.

                                    Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                                    Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                                    M 1 Reply Last reply Dec 6, 2016, 10:31 PM Reply Quote 1
                                    • M
                                      MarcB @Sebastian Roth
                                      last edited by Dec 6, 2016, 10:31 PM

                                      @Sebastian-Roth

                                      VMs are still not able to continue the netboot process with the additional specification of the fog server IP. I just used the IP address twice, as this fog server is not available vi dns (so I didn’t use the name).

                                      Thanks for the suggestions though.

                                      @george1421

                                      I tried the simplified ltsp.conf file you referred me, but that also does not work.

                                      Thanks again,
                                      Marc

                                      G 1 Reply Last reply Dec 6, 2016, 10:45 PM Reply Quote 0
                                      • G
                                        george1421 Moderator @MarcB
                                        last edited by george1421 Dec 6, 2016, 4:46 PM Dec 6, 2016, 10:45 PM

                                        @MarcB Please capture another pcap file with the updated config file.

                                        I can say I just loaded virtual box + extension pack on my zorin (ubuntu based) laptop and I was able to pxe boot from my home fog server running dnsmasq. I just tried in bios (legacy) mode and it worked as it should. So I can say it does work.

                                        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                                        M 1 Reply Last reply Dec 7, 2016, 5:58 PM Reply Quote 0
                                        • M
                                          MarcB @george1421
                                          last edited by Dec 7, 2016, 5:58 PM

                                          @george1421

                                          Cool - I’m glad it’s working for you - there’s hope! What is your OS for FOG (and dnsmasq)? Are you using the simplified ltsp.conf file you posted previously?

                                          Is your Virtualbox 5.1.10? Were there any options in VirtualBox you had so specify (that I might have missed)?

                                          Here’s the logs from the fog server when the VM is netbooted:

                                          Dec 7 10:54:41 FOGserver dnsmasq-dhcp[14381]: 712868239 available DHCP subnet: FOGServerIP/255.255.0.0
                                          Dec 7 10:54:41 FOGserver dnsmasq-dhcp[14381]: 712868239 vendor class: PXEClient:Arch:00000:UNDI:002001
                                          Dec 7 10:54:41 FOGserver dnsmasq-dhcp[14381]: 712868239 PXE(eth0) 08:00:27:7d:81:8f proxy
                                          Dec 7 10:54:41 FOGserver dnsmasq-dhcp[14381]: 712868239 tags: eth0
                                          Dec 7 10:54:41 FOGserver dnsmasq-dhcp[14381]: 712868239 bootfile name: undionly.kpxe
                                          Dec 7 10:54:41 FOGserver dnsmasq-dhcp[14381]: 712868239 next server: FOGServerIP
                                          Dec 7 10:54:41 FOGserver dnsmasq-dhcp[14381]: 712868239 broadcast response
                                          Dec 7 10:54:41 FOGserver dnsmasq-dhcp[14381]: 712868239 sent size: 1 option: 53 message-type 2
                                          Dec 7 10:54:41 FOGserver dnsmasq-dhcp[14381]: 712868239 sent size: 4 option: 54 server-identifier FOGServerIP
                                          Dec 7 10:54:41 FOGserver dnsmasq-dhcp[14381]: 712868239 sent size: 9 option: 60 vendor-class 50:58:45:43:6c:69:65:6e:74
                                          Dec 7 10:54:41 FOGserver dnsmasq-dhcp[14381]: 712868239 sent size: 17 option: 97 client-machine-id 00:48:15:92:73:ec:12:42:36:a8:2b:f0:4b:de…
                                          Dec 7 10:54:41 FOGserver dnsmasq-dhcp[14381]: 712868239 sent size: 60 option: 43 vendor-encap 06:01:03:08:07:80:00:01:0a:69:00:2d:09:14…
                                          Dec 7 10:54:49 FOGserver dnsmasq-dhcp[14381]: 712868239 available DHCP subnet: FOGServerIP/255.255.0.0
                                          Dec 7 10:54:49 FOGserver dnsmasq-dhcp[14381]: 712868239 vendor class: PXEClient:Arch:00000:UNDI:002001

                                          G 1 Reply Last reply Dec 7, 2016, 6:20 PM Reply Quote 0
                                          • 1
                                          • 2
                                          • 1 / 2
                                          1 / 2
                                          • First post
                                            5/21
                                            Last post

                                          219

                                          Online

                                          12.0k

                                          Users

                                          17.3k

                                          Topics

                                          155.2k

                                          Posts
                                          Copyright © 2012-2024 FOG Project