Surface 3 Fails to Image

wwarsin

Hello everyone,

I’ve been trying to get a Surface 3 (not a pro) to image using Fog for a few days now and have run into problems after problems after problems trying to just capture the image…

Currently I’ve done the following:
0) Installed SVN version of Fog (the logo on the webpage shows 5473) on Ubuntu 14.04 following the steps at https://wiki.fogproject.org/wiki/index.php/Ubuntu_14.04 using steps for SVN here https://wiki.fogproject.org/wiki/index.php/SVN (i only installed the SVN version
a) Side note this version seems a bit buggy, i can’t list all hosts (i get a server 500 error), multi-casting didn’t seem to work (All of the computers would load partclone and imaging would never start) and I can’t easily add members to a group (server 500 error) - It could be because i imported hosts/database…

Disabled secure boot on the Surface
Changed DHCP boot option to snp.efi (per this forum post: https://forums.fogproject.org/topic/4982/unable-to-successfully-pxe-boot-to-a-fog-menu-on-a-microsoft-surface-pro-3/10 )
Create an image (I’ve tried both “Single Disk - Resizable” and “Mulitple Partition - Single Disk (not resizable)”
Created a new host with the network adapter MAC address
a) I’ve tried setting the Host Primary Disk to /dev/mmcblk0 - Per this forum: https://forums.fogproject.org/topic/3662/surface-pro-3-pxe/65?page=1 ( I get the error message “cannot find HDD on system” otherwise)
Boot the surface with microsoft network adapter (with a USB hub and keyboard)
a) I have to enter the tftp boot server manually

When the image is set to “Single Disk - Resizable” i get the following error: No resizable partitions found.
When the image is set to "Multiple Partition - Single Disk (Not resizable) - I get the following saying that the task is complete:

<Fog Logo>
verifying network interface configuration...done
checking oerating system... Windows 8.1
Checking CPU Cores...4
Send method....nfs
checking in...done
mounting file system...done,
preparing to send image file to server.
checking mounted file system ...done
using image: <image name>
preparing backup location...done
looking for hard disks...done
re-reading partition tables...done
useing hard disk: /dev/mmcblk0
The protective MBR's 0xEE partition is oversized! Auto-repairing.
Saving partitionTables (GPT)...done
Task Complete!
Stopping fOG status Reporter...done
<tries to restart>

Not sure if this is helpful but here is the dmesg run from the surface ( I ran this without the Host Primary Disk set 0_1448392632297_dmesg.txt

Any help or links to forum posts i may have over looked would be greatly appreciated!

Sebastian Roth

@wwarsin There has been an issue within the upload script lately. Can you please update to the very latest SVN version und re-run the installer. Then use “Multiple Partition - Single Disk (Not resizable)”…

You are pretty close I reckon! The update should fix some of the other issues as well.

wwarsin

Hi @Sebastian-Roth ,

Thanks for the quick reply! I was unfortunately not able to upgrade and try this until today.

I’m currently on version 5590 and now when i PXE boot the surface it boots fine to the FOG Menu but when i try to capture an image (or try to quick image) I get the error “No network interfaces found.”

I booted into debug mode, ran ifconfig and it only returned the lo or the loopback adapter.

I ran lsusb with and without the network adapter and it appears that it is detected, but this is about the extent that I can troubleshoot in linux without assistance/guidance…

Thank you

Sebastian Roth

@wwarsin Can you please boot into debug mode again and tell us the exect model name and number plus USB IDs you see from lsusb when your network device is plugged in? We removed a kernel driver lately which I was pretty sure wouldn’t be in use by anyone but caused issues for someone. I really hope that I am wrong but maybe this driver (cdc_ether) was exactly the one used by your USB network adapter.

wwarsin

@Sebastian-Roth The adapter is a Microsoft Model 1552 - The ID from lsusb is 045e:07ab (i’m assuming this is the correct one as it doesn’t show up when i run lsusb when the network adapter is unplugged)

The other USB IDs are:
05e3:0608
1d6b:0002
1d6b:0003
03f0:034a

Sebastian Roth

@wwarsin said:

045e:07ab

Thanks for the IDs. Turns out that it is not easy to find information about this device on the net. I found a windows driver for it on the windows catalog update website (learn something new every day as I had no idea this existed…) and this is what I found in the INF file:

%RTL8152B.DeviceDesc% = RTL8152B.ndi,USB\VID_045E&PID_07AB&REV_2000

Are you able to confirm my findings?? Boot into windows, open device manager, find the USB NIC and see which driver it uses…?! The RTL8152 USB NICs are supported by our kernel and I really wonder if I am on the right track here.

Re-reading your posts I wonder if I got this right. Before updating you were able to get past the networking stuff just fine (as I see in your first post). After updating to the latest version you see this “No network interfaces found” issue.

On your FOG server please run this command to see if the old kernel is still there and was only moved out of the way when installing the latest version find /var -name "bzImage"

wwarsin

@Sebastian-Roth
In device manager the inf name property is set to oem12.inf and in that file i see the exact same line you posted (see below)

Yes, you are correct. Before I upgraded FOG to 5590 it would pass the network check
When i run the command find /var -name “bzImage” it returns just the following:

root@MICSBRIFOG01:/# find /var -name "bzImage"
/var/www/html/fog/service/ipxe/bzImage
root@MICSBRIFOG01:/#

Unfortunately we only have the 10/100 model (1552) adapters and not the gigabit adapter (1663) to try and Micro$haft only lets you PXE boot with their adapters.

I keep getting a forbidden when i try to upload the contents of the INF file (even with a txt extension) so here are the contents of the INF from the surface for the USB adapter:

; Copyright (C) 2013 Microsoft Corporation. All Right Reserved.
; 

[Version]
Signature   = "$Windows NT$"
Class       = Net
ClassGUID   = {4d36e972-e325-11ce-bfc1-08002be10318}
Provider    = %Microsoft%
CatalogFile = msu64w8.cat
DriverVer   = 08/06/2013,8.10.0806.2013

[Manufacturer]
%Microsoft% = Microsoft, NTamd64

[ControlFlags]
ExcludeFromSelect = *

[Microsoft.NTamd64]
%RTL8152B.DeviceDesc% = RTL8152B.ndi,USB\VID_045E&PID_07AB&REV_2000

;;****************************************************************************
;; Windows 8
;;****************************************************************************
[RTL8152B.ndi.NT]
AddReg = RTLUE8023W8.NT.Reg
AddReg = About.reg,
AddReg = Common.reg,
AddReg = NetworkAddress.reg, Speed10_100.reg
AddReg = ChksumOffloadIV4.reg, ChksumOffloadIV6.reg, flowctrl.reg, EEE.reg
AddReg = PriorityVlanTag.reg
AddReg = LsoV2Offload.reg

Characteristics    = 0x84
BusType            = 15
CopyFiles          = Rtlunic.CopyFilesW8, RTLDLL.CopyFiles
*IfType            = 6             ; IF_TYPE_ETHERNET_CSMACD 
*MediaType         = 0             ; NdisMedium802_3
*PhysicalMediaType = 14            ; NdisPhysicalMedium802_3


[RTL8152B.ndi.NT.Services]
AddService = msu64w8, 2, rtusnt.Service, common.EventLog

;*******************************************************************************
; common paramters
;*******************************************************************************

[NetworkAddress.reg]
HKR,Ndi\params\NetworkAddress,     ParamDesc,  0, %NetworkAddress%
HKR,Ndi\params\NetworkAddress,     type,       0, "edit"
HKR,Ndi\params\NetworkAddress,     default,    0, "000000000000"
HKR,Ndi\params\NetworkAddress,     LimitText,  0, "12"
HKR,Ndi\params\NetworkAddress,     UpperCase,  0, "1"
HKR,Ndi\params\NetworkAddress,     Optional,   0, "1"

[Speed10_100.reg]
HKR,Ndi\params\*SpeedDuplex,       ParamDesc,  0, %SpeedDuplex%
HKR,Ndi\params\*SpeedDuplex,       default,    0, "0"
HKR,Ndi\params\*SpeedDuplex,       type,       0, "enum"
HKR,Ndi\params\*SpeedDuplex\enum,  "0",        0, %AutoDetect%
HKR,Ndi\params\*SpeedDuplex\enum,  "1",        0, %10Mb-Half-Duplex%
HKR,Ndi\params\*SpeedDuplex\enum,  "2",        0, %10Mb-Full-Duplex%
HKR,Ndi\params\*SpeedDuplex\enum,  "3",        0, %100Mb-Half-Duplex%
HKR,Ndi\params\*SpeedDuplex\enum,  "4",        0, %100Mb-Full-Duplex%

[flowctrl.reg]
HKR,Ndi\params\*FlowControl,        ParamDesc,    0, %FlowControl%
HKR,Ndi\params\*FlowControl,        default,      0, "3"
HKR,Ndi\params\*FlowControl,        type,         0, "enum"
HKR,Ndi\params\*FlowControl\enum,   "0",          0, %Disabled%
HKR,Ndi\params\*FlowControl\enum,   "3",          0, %RxTxEnabled%

[ChksumOffloadIV4.reg]
HKR,Ndi\params\*IPChecksumOffloadIPv4,        ParamDesc,  0, %IPChksumOffv4%
HKR,Ndi\params\*IPChecksumOffloadIPv4,        default,    0, "3"
HKR,Ndi\params\*IPChecksumOffloadIPv4,        type,       0, "enum"
HKR,Ndi\params\*IPChecksumOffloadIPv4\enum,   "0",        0, %Disabled%
HKR,Ndi\params\*IPChecksumOffloadIPv4\enum,   "1",        0, %TxEnabled%
HKR,Ndi\params\*IPChecksumOffloadIPv4\enum,   "2",        0, %RxEnabled%
HKR,Ndi\params\*IPChecksumOffloadIPv4\enum,   "3",        0, %RxTxEnabled%


HKR,Ndi\params\*TCPChecksumOffloadIPv4,       ParamDesc,  0, %TCPChksumOffv4%
HKR,Ndi\params\*TCPChecksumOffloadIPv4,       default,    0, "3"
HKR,Ndi\params\*TCPChecksumOffloadIPv4,       type,       0, "enum"
HKR,Ndi\params\*TCPChecksumOffloadIPv4\enum,  "0",        0, %Disabled%
HKR,Ndi\params\*TCPChecksumOffloadIPv4\enum,  "1",        0, %TxEnabled%
HKR,Ndi\params\*TCPChecksumOffloadIPv4\enum,  "2",        0, %RxEnabled%
HKR,Ndi\params\*TCPChecksumOffloadIPv4\enum,  "3",        0, %RxTxEnabled%

HKR,Ndi\params\*UDPChecksumOffloadIPv4,       ParamDesc,  0, %UDPChksumOffv4%
HKR,Ndi\params\*UDPChecksumOffloadIPv4,       default,    0, "3"
HKR,Ndi\params\*UDPChecksumOffloadIPv4,       type,       0, "enum"
HKR,Ndi\params\*UDPChecksumOffloadIPv4\enum,  "0",        0, %Disabled%
HKR,Ndi\params\*UDPChecksumOffloadIPv4\enum,  "1",        0, %TxEnabled%
HKR,Ndi\params\*UDPChecksumOffloadIPv4\enum,  "2",        0, %RxEnabled%
HKR,Ndi\params\*UDPChecksumOffloadIPv4\enum,  "3",        0, %RxTxEnabled%



[ChksumOffloadIV6.reg]
HKR,Ndi\params\*TCPChecksumOffloadIPv6,       ParamDesc,  0, %TCPChksumOffv6%
HKR,Ndi\params\*TCPChecksumOffloadIPv6,       default,    0, "3"
HKR,Ndi\params\*TCPChecksumOffloadIPv6,       type,       0, "enum"
HKR,Ndi\params\*TCPChecksumOffloadIPv6\enum,  "0",        0, %Disabled%
HKR,Ndi\params\*TCPChecksumOffloadIPv6\enum,  "1",        0, %TxEnabled%
HKR,Ndi\params\*TCPChecksumOffloadIPv6\enum,  "2",        0, %RxEnabled%
HKR,Ndi\params\*TCPChecksumOffloadIPv6\enum,  "3",        0, %RxTxEnabled%

HKR,Ndi\params\*UDPChecksumOffloadIPv6,       ParamDesc,  0, %UDPChksumOffv6%
HKR,Ndi\params\*UDPChecksumOffloadIPv6,       default,    0, "3"
HKR,Ndi\params\*UDPChecksumOffloadIPv6,       type,       0, "enum"
HKR,Ndi\params\*UDPChecksumOffloadIPv6\enum,  "0",        0, %Disabled%
HKR,Ndi\params\*UDPChecksumOffloadIPv6\enum,  "1",        0, %TxEnabled%
HKR,Ndi\params\*UDPChecksumOffloadIPv6\enum,  "2",        0, %RxEnabled%
HKR,Ndi\params\*UDPChecksumOffloadIPv6\enum,  "3",        0, %RxTxEnabled%

[PriorityVlanTag.reg]
HKR,Ndi\params\*PriorityVLANTag,        ParamDesc,  0, %PriorityVLAN%
HKR,Ndi\params\*PriorityVLANTag,        default,    0, "1"
HKR,Ndi\params\*PriorityVLANTag,        type,       0, "enum"
HKR,Ndi\params\*PriorityVLANTag\enum,   "0",        0, %Disabled%
HKR,Ndi\params\*PriorityVLANTag\enum,   "1",        0, %Enabled%

[LsoV2Offload.reg]
HKR,Ndi\params\*LsoV2IPv4,       ParamDesc,  0, %LSOv2v4%
HKR,Ndi\params\*LsoV2IPv4,       default,    0, "1"
HKR,Ndi\params\*LsoV2IPv4,       type,       0, "enum"
HKR,Ndi\params\*LsoV2IPv4\enum,  "0",        0, %Disabled%
HKR,Ndi\params\*LsoV2IPv4\enum,  "1",        0, %Enabled%

HKR,Ndi\params\*LsoV2IPv6,       ParamDesc,  0, %LSOv2v6%
HKR,Ndi\params\*LsoV2IPv6,       default,    0, "1"
HKR,Ndi\params\*LsoV2IPv6,       type,       0, "enum"
HKR,Ndi\params\*LsoV2IPv6\enum,  "0",        0, %Disabled%
HKR,Ndi\params\*LsoV2IPv6\enum,  "1",        0, %Enabled%

[EEE.reg]
HKR, Ndi\params\EEE,        ParamDesc,  0, %EEE%
HKR, Ndi\params\EEE,        type,       0, "enum"
HKR, Ndi\params\EEE,        default,    0, "1"
HKR, Ndi\params\EEE\enum,   "0",        0, %Disabled%
HKR, Ndi\params\EEE\enum,   "1",        0, %Enabled%

[Common.reg]
HKR,,HwOption,0x00010001,0
HKR,,HwFlags,0x00010001,1

[About.reg]
HKR,,EnumPropPages32,,"msnicprop64.dll,RTNicPropPageProvider"

;*******************************************************************************
; Windows 8
;*******************************************************************************
[RTLUE8023W8.NT.Reg]
HKR, Ndi\Interfaces,  UpperRange, 0, "ndis5"
HKR, Ndi\Interfaces,  LowerRange, 0, "ethernet"
HKR, Ndi,             Service,    0, "msu64w8"

[rtusnt.Service]
DisplayName    = %Rtlunic.Service.DispName%
ServiceType    = 1    ; %SERVICE_KERNEL_DRIVER%
StartType      = 3    ; %SERRVICE_DEMAND_START%
ErrorControl   = 1    ; %SERRVICE_ERROR_NORMAL%
ServiceBinary  = %12%\msu64w8.sys
LoadOrderGroup = NDIS

[common.EventLog]
AddReg = common.AddEventLog.reg

[common.AddEventLog.reg]
HKR, , EventMessageFile, 0x00020000, "%%SystemRoot%%\System32\netevent.dll"
HKR, , TypesSupported  , 0x00010001, 7

[Rtlunic.CopyFilesW8]
msu64w8.sys,,,2

[RTLDLL.CopyFiles]
msnicprop64.dll,,,0x00006000 ; COPYFLG_NOPRUNE | COPYFLG_IN_USE_RENAME

;*******************************************************************************
; Destination Directory
;*******************************************************************************
[DestinationDirs]
Rtlunic.CopyFilesW8 = 12
DefaultDestDir      = 11  ; LDID_SYS


[SourceDisksNames]
1=%DISKNAME%,,,

[SourceDisksFiles]
msu64w8.sys = 1,, ; on distribution disk 1
msnicprop64.dll = 1,, ; on distribution disk 1

;*******************************************************************************
; Strings
;*******************************************************************************
[Strings]
Microsoft                      = "Microsoft"

;; Source disk name
DISKNAME                       = "Microsoft USB NIC NDIS6.30 64-bit Driver"
Rtlunic.Service.DispName       = "Microsoft USB NIC NDIS6.30 64-bit Driver"

RTL8152B.DeviceDesc            = "Surface Ethernet Adapter"

NetworkAddress                 = "Network Address"
AutoDetect                     = "Auto Negotiation"
SpeedDuplex                    = "Speed & Duplex"
10Mb-Half-Duplex               = "10 Mbps Half Duplex"
10Mb-Full-Duplex               = "10 Mbps Full Duplex"
100Mb-Half-Duplex              = "100 Mbps Half Duplex"
100Mb-Full-Duplex              = "100 Mbps Full Duplex"
FlowControl                    = "Flow Control"

PriorityVLAN                   = "Priority & VLAN"

IPChksumOffv4                  = "IPv4 Checksum Offload"
TCPChksumOffv4                 = "TCP Checksum Offload (IPv4)"
UDPChksumOffv4                 = "UDP Checksum Offload (IPv4)"
TCPChksumOffv6                 = "TCP Checksum Offload (IPv6)"
UDPChksumOffv6                 = "UDP Checksum Offload (IPv6)"

LSOv2v4                        = "Large Send Offload v2 (IPv4)"
LSOv2v6                        = "Large Send Offload v2 (IPv6)"

EEE                            = "Energy Efficient Ethernet"

Enabled                        = "Enabled"
Disabled                       = "Disabled"
TxEnabled                      = "Tx Enabled"
RxEnabled                      = "Rx Enabled"
RxTxEnabled                    = "Rx & Tx Enabled"
10MbFirst                      = "10 Mbps First"
100MbFirst                     = "100 Mbps First"
NotSpeedDown                   = "Not Speed Down"

;;;;; InfVer = 1.000

Imperilled

Same problem on my Surfaces. I have menu but when I make task. Network device not found
I run svn 5612.

Sebastian Roth

Looking through the changes we made in the kernel config I can’t find anything related to USB NICs except the cdc_ether thing we removed only a good week ago. @Tom-Elliott do you think this might be an issue caused by going from 4.2.3 to 4.3.0? I kind of doubt it. Would you mind adding the cdc_ether thing to the very latest kernel and upload bzImage/init.xz somewhere for @wwarsin and @Imperilled to try out?

Imperilled

finaly it works for me with 4.2.3 kernel manualy installed.

Imperilled

Imaging and deploy works but he make a raw image. I will try to set compression as default to see if it’s better …

wwarsin

@Imperilled Would you mind creating some steps to manually install the 4.2.3 kernel so i can try it out? I have a feeling I’ll run into the same problem before i updated where it either didn’t detect the hard drive or tried to image but just set Complete and never actually captured the image…

Imperilled

@wwarsin I just change bzImage file in the directory after downloading it in fog sourceforge…

wwarsin

@Imperilled I tried that and the iPXE loader gets stuck (freezes) right after loading “Init.xz” (which is right after bzimage)

Tom Elliott

@Sebastian-Roth sorry I didn’t get to this sooner when I get home tonight I’ll try to get this done. I’m tired today though so I’m sorry if I forget again lol.

Tom Elliott

@wwarsin you could use the kernel update page to select the kernel you need.

wwarsin

@Tom-Elliott Hi Tom, I just tried that and recieved the following error (I’m on SVN 5666 now)

FOGFTP: Failed to rename file. Remote Path: //var/www/html/fog/service/ipxe/bzImage/backup/bzImage_20151207_214012, Local Path: /var/www/html/fog/service/ipxe/bzImage, Error: ftp_rename(): Rename failed.

I manually renamed the files manually, tried again and it downloaded them.

I still get the same error message on the FOG screen, I’m not sure if this bit helps i must have missed it before:

Error ident-mapping new memmap (0x13ac72000)!
i0042: No controller found
Starting logging: OK
Populating /dev using udev: udevdp2316]: error creating epoll fd: Fonction not implemented
done
Initializing random number generator... done.
Starting eth0 interface
cdc_ether 1-2.1:2.0 eth0: kevent 12 may have been dropped
udhcpc (v1.23.2) started
Sending discover...
Read error: Network is down, reopening socket
udhcpc: bind: no such device
cat: /sys/class/net/eth0/carrier: Invalid argument
cat: /sys/class/net/eth0/carrier: Invalid argument
cat: /sys/class/net/eth0/carrier: Invalid argument
cat: /sys/class/net/eth0/carrier: Invalid argument
cat: /sys/class/net/eth0/carrier: Invalid argument
cat: /sys/class/net/eth0/carrier: Invalid argument
cat: /sys/class/net/eth0/carrier: Invalid argument
cat: /sys/class/net/eth0/carrier: Invalid argument
cat: /sys/class/net/eth0/carrier: Invalid argument
ssh-keygen: generating new host keys: RSA DSA

Then the FOG logo screen loads and fails with No Network interfaces found.

I tried Kernel 4.2.2 and 3.18.5 as well and received the same thing…

Sebastian Roth

@wwarsin So you cannot make it work again even if you use older kernels? When initially posting you didn’t have those network issues, right?

Do you always see the same error messages (“cdc_ether 1-2.1:2.0 eth0: kevent 12 may have been dropped” and “cat: /sys/class/net/eth0/carrier: Invalid argument”)?? Kernel 4.2.2 and 3.18.5 as well??

I really hope we can make this work for you. Others have been successfully imaging their surfaces and you are pretty close as well I reckon.

wwarsin

@Sebastian-Roth Yeah, I was getting past the network portion before i upgraded to SVN… Am I able to download the current package from sourceforge and downgrade FOG?

Yes I see the same CDC and cat errors in 4.2.2 & 3.18.5

I appreciate the help you and Tom have been so far!

Sebastian Roth

@wwarsin Downgrading is not supported. It might work (if there were no major changes in the DB) but it might also cause serious problems. And it wouldn’t help much anyway because the installer always downloads the current kernel. So you would end up with an older version of the webinterface with a current kernel. No better than what you have right now.

Have you tried 4.2.3 yet?

Yeah, I was getting past the network portion before i upgraded to SVN…

Now I am confused! Do you really mean the network was fine BEFORE upgrading to SVN (so using 1.2.0)?? I kind of doubt. You mean before upgrading to 5590!??

I really don’t understand why this NIC would use the cdc_ether driver if it’s really a realtek NIC…

Surface 3 Fails to Image

221

11.6k

17.1k

154.6k