Tesla K40c: Linux Kernel crashed once run 'nvidia-smi'

Hi all,

My server is Lenovo x3650 M5 with 900 AC, and the GPU is Tesla K40c. And my current Env. is: CentOS 7, Cuda 7.5 (driver 352.39). After I install the driver and run ‘nvidia-smi’, the kernel is crashed. And the same situation is on Ubuntu 14.04(linux kernel is 3.13). And I also try to upgrade the driver to 352.99, but still make the system crashed both on CentOS 7 and Ubuntu 14.04. And the kdump message on both OS is the same:

Any tips for this issue, it is very appreciated!

1671 [ 49.353839] virbr0: port 1(virbr0-nic) entered disabled state
1672 [ 71.635748] systemd-readahead[963]: open(/var/tmp/initramfs.Vg5FyY/usr/bin/loginctl) failed: Too many levels of symbolic links
1673 [ 71.645254] systemd-readahead[963]: open(/var/tmp/initramfs.Vg5FyY/usr/lib/systemd/system/dracut-emergency.service) failed: Too many levels of symbolic links
1674 [ 110.513253] nvidia 0000:06:00.0: irq 126 for MSI/MSI-X
1675 [ 111.687839] NVRM: GPU at PCI:0000:06:00: GPU-3c55dda4-f7c4-3e01-e150-eeabf00703ee
1676 [ 111.687843] NVRM: Xid (PCI:0000:06:00): 62, 15a4(4d98) 00000000 00000000
1677 [ 115.725109] BUG: unable to handle kernel NULL pointer dereference at (null)
1678 [ 115.725178] IP: [] _nv003025rm+0x34/0xb0 [nvidia]
1679 [ 115.725320] PGD 1027874067 PUD 1008608067 PMD 0
1680 [ 115.725359] Oops: 0000 [#1] SMP
1681 [ 115.725389] Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun ip6t_rpfilter ip6t_REJECT ipt_REJECT xt_conntrack ebtable_nat ebtable_broute bridge stp llc ebtable_filter ebtables ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6
1682 [ 115.725982] acpi_pad nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs sd_mod crc_t10dif crct10dif_generic mgag200 syscopyarea sysfillrect sysimgblt i2c_algo_bit drm_kms_helper crct10dif_pclmul crct10dif_common crc32c_intel bnx2x ttm drm tg3 mdio i2c_co
1683 [ 115.726252] CPU: 16 PID: 13887 Comm: nvidia-smi Tainted: P OE ------------ 3.10.0-327.el7.x86_64 #1
1684 [ 115.726312] Hardware name: LENOVO System x3650 M5: -[5462I4Y]-/00MU899, BIOS -[TCE106KUS-1.10]- 04/17/2015
1685 [ 115.726370] task: ffff881008464500 ti: ffff881027898000 task.ti: ffff881027898000
1686 [ 115.726415] RIP: 0010:[] [] _nv003025rm+0x34/0xb0 [nvidia]
1687 [ 115.726531] RSP: 0018:ffff88102789b988 EFLAGS: 00010282
1688 [ 115.726564] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000001
1689 [ 115.726608] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffffffffa0d8e6a0
1690 [ 115.726651] RBP: ffff88201feb2f60 R08: ffff8810271cda9c R09: ffff8810228abf00
1691 [ 115.726694] R10: 0000000057be43fb R11: ffffffffa0962d90 R12: ffff8820237401b0
1692 [ 115.726737] R13: 0000000000000000 R14: ffff882026564008 R15: ffff8810188dc008
1693 [ 115.726781] FS: 00007f2648777740(0000) GS:ffff88203f280000(0000) knlGS:0000000000000000
1694 [ 115.726829] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
1695 [ 115.726865] CR2: 0000000000000000 CR3: 0000001025f3d000 CR4: 00000000001407e0
1696 [ 115.726908] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
1697 [ 115.726951] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
1698 [ 115.726994] Stack:
1699 [ 115.727010] ffff882026564008 ffff8820237401b0 0000000000000000 ffffffffa0962de3
1700 [ 115.728749] ffff88201ad58030 ffff88201ff60008 ffff882026564008 ffffffffa09664ad
1701 [ 115.730483] ffff88201ad58018 ffffffffa0962f39 ffff88201ad58008 0000000000000000
1702 [ 115.732216] Call Trace:
1703 [ 115.734082] [] ? _nv013600rm+0x2b3/0x3b20 [nvidia]
1704 [ 115.735980] [] ? _nv013600rm+0x397d/0x3b20 [nvidia]
1705 [ 115.737874] [] ? _nv013600rm+0x409/0x3b20 [nvidia]
1706 [ 115.739761] [] ? _nv013600rm+0x1825/0x3b20 [nvidia]
1707 [ 115.741639] [] ? _nv013600rm+0x239d/0x3b20 [nvidia]
1708 [ 115.743471] [] ? _nv013690rm+0x67b/0x1370 [nvidia]
1709 [ 115.745240] [] ? _nv012509rm+0xe/0x30 [nvidia]
1710 [ 115.747013] [] ? _nv000982rm+0x9/0x20 [nvidia]
1711 [ 115.748733] [] ? _nv012512rm+0x2f/0x40 [nvidia]
1712 [ 115.750418] [] ? _nv000653rm+0xab3/0x2e30 [nvidia]
1713 [ 115.752097] [] ? _nv008602rm+0xf1/0x160 [nvidia]
1714 [ 115.753729] [] ? _nv000779rm+0x15f/0x250 [nvidia]
1715 [ 115.755428] [] ? _nv000689rm+0x3e8/0x760 [nvidia]
1716 [ 115.757006] [] ? rm_init_adapter+0x6a/0x100 [nvidia]
1717 [ 115.758572] [] ? nvidia_open+0x21f/0x980 [nvidia]
1718 [ 115.760127] [] ? nvidia_frontend_open+0x49/0xa0 [nvidia]
1719 [ 115.761600] [] ? chrdev_open+0xa1/0x1e0
1720 [ 115.763085] [] ? do_dentry_open+0x1a7/0x2e0
1721 [ 115.764568] [] ? cdev_put+0x30/0x30
1722 [ 115.766001] [] ? vfs_open+0x39/0x70
1723 [ 115.767389] [] ? do_last+0x1ed/0x1270
1724 [ 115.768728] [] ? path_openat+0xc2/0x490
1725 [ 115.770040] [] ? do_filp_open+0x4b/0xb0
1726 [ 115.771293] [] ? __alloc_fd+0xa7/0x130
1727 [ 115.772511] [] ? do_sys_open+0xf3/0x1f0
1728 [ 115.773682] [] ? SyS_open+0x1e/0x20
1729 [ 115.774821] [] ? system_call_fastpath+0x16/0x1b
1730 [ 115.775924] Code: 00 00 00 45 31 ed 41 54 49 89 d4 31 d2 53 ff 50 20 be 30 00 00 00 48 8b b8 38 09 00 00 ff 90 50 05 00 00 4d 85 e4 48 89 c3 74 5a <48> 8b 03 48 85 c0 74 38 48 83 b8 40 01 00 00 00 75 0a 5b 41 5c
1731 [ 115.778287] RIP [] _nv003025rm+0x34/0xb0 [nvidia]
1732 [ 115.779445] RSP
1733 [ 115.780487] CR2: 0000000000000000

have you removed the nouveau driver?

before the crash, what is the output of

dmesg |grep NVRM

hi txbob,

nouveau driver must be removed, otherwise, the driver can’t be insmod.

[alvin@hal-dev ~]$ sudo cat </etc/modprobe.d/blacklist-nouveau.conf

RPM Fusion blacklist for nouveau driver - you need to run as root:

dracut -f /boot/initramfs-$(uname -r).img $(uname -r)

if nouveau is loaded despite this file.

blacklist nouveau

[alvin@hal-dev ~]$ cat < kdump/127.0.0.1-2016-08-24-21:04:03/vmcore-dmesg.txt |grep NVRM
[ 10.783414] NVRM: loading NVIDIA UNIX x86_64 Kernel Module 352.39 Fri Aug 14 18:09:10 PDT 2015
[ 111.687839] NVRM: GPU at PCI:0000:06:00: GPU-3c55dda4-f7c4-3e01-e150-eeabf00703ee
[ 111.687843] NVRM: Xid (PCI:0000:06:00): 62, 15a4(4d98) 00000000 00000000

[alvin@hal-dev ~]$ cat < kdump/127.0.0.1-2016-08-24-21:04:03/vmcore-dmesg.txt |grep nvidia
[ 10.773243] nvidia: module license ‘NVIDIA’ taints kernel.
[ 10.778081] nvidia: module verification failed: signature and/or required key missing - tainting kernel
[ 10.782847] nvidia 0000:06:00.0: enabling device (0140 → 0142)
[ 10.783396] [drm] Initialized nvidia-drm 0.0.0 20150116 for 0000:06:00.0 on minor 1
[ 110.513253] nvidia 0000:06:00.0: irq 126 for MSI/MSI-X

[alvin@hal-dev ~]$ lsmod|grep nouveau
[alvin@hal-dev ~]$

Just to verify nouveau must be removed.

txbob, since I can not attach files, if needed, I can share my dmesg file to you by email.

Actually, there is a nvidia engineer in my company, and she just took a look at this issue, but no ideas.

I am not sure whether it is possible to share us a debugging driver to locate this issue.

The Xid 62 error code indicates a severe problem (obviously).

It may be caused by unstable motherboard hardware.

Can you try plugging the GPU into a different slot? Have you double checked power delivery to the GPU and is your PSU able to deliver sufficient power for the entire system?

Are you certain this is a K40c and not a K40m ? (i.e. does it have a fan?)

txbob, thanks very much.

Actually, x3650 M5 have two PCIe x16 slots, and I have tried to plug in GPU into both slots, but the same error.

I don’t know how to check the power delivery to GPU, but our sever power is 900 W, and the server has 2 CPU, each CPU is 135w.

Our GPU is K40c, it has a fan, and I check the fan works.

BTW, we use a riser card, and I double check it, it is PCIe x16.

Do you have any other systems you can try the K40c in to verify that it is working correctly (or not)?

OK. We have another 3 new M5 server are coming, but the power are all 900W. Our company has a demo, and the server is M5 also, but the power is 1300W, and K40 has no fan. If we can identify it is a power issue, we can buy one power.

So,txbob, you suspect this issue is a power issue, am I right?

I plan to try windows server 2008 to see whether it works or not.

No I don’t really expect that this is a power issue. It might be, but I’m not convinced at this point. At idle, or even when running the nvidia-smi command, the GPU should only be drawing less than 100W.

Do you have the latest firmware in that system? If not can you please update to the latest firmware?

After that, can you run:

asu show

and paste the output into this thread?

hi txbob,

I have updated the firmware to the latest one, but got no lucky.

[alvin@hal-dev asu]$ sudo ./asu64 show
[sudo] password for alvin:
Lenovo Advanced Settings Utility version 10.3.92I
Licensed Materials - Property of Lenovo
(C) Copyright Lenovo Corp. 2007-2015 All Rights Reserved
Successfully discovered the IMM via SLP.
Discovered IMM at IP address 169.254.95.118
Connected to IMM at IP address 169.254.95.118
IMM.Cert_CSR_Export_Format=DER
IMM.SSH_SERVER_KEY=Installed
IMM.SSL_HTTPS_SERVER_CERT=Private Key and CA-signed cert installed. Expiration: July 11, 2025
IMM.SSL_HTTPS_SERVER_CSR=Private Key and CA-signed cert installed. Expiration: July 11, 2025
IMM.SSL_LDAP_CLIENT_CERT=Private Key and Self-signed cert installed. Expiration: June 14, 2026
IMM.SSL_LDAP_CLIENT_CSR=Private Key and Self-signed cert installed. Expiration: June 14, 2026
IMM.SSL_SERVER_DIRECTOR_CERT=Private Key and CA-signed cert installed. Expiration: July 11, 2025
IMM.SSL_SERVER_DIRECTOR_CSR=Private Key and CA-signed cert installed. Expiration: July 11, 2025
IMM.SSL_SKR_CLIENT_CERT=Cannot get Status. The FOD activation key is not installed!
IMM.SSL_SKR_CLIENT_CSR=Cannot get Status. The FOD activation key is not installed!
IMM.SSL_CLIENT_TRUSTED_CERT_SKR=Cannot get Status. The FOD activation key is not installed!
IMM.SSL_CLIENT_TRUSTED_CERT1=Installed, Expiration: January 01, 2070
IMM.SSL_CLIENT_TRUSTED_CERT2=Not-Installed
IMM.SSL_CLIENT_TRUSTED_CERT3=Not-Installed
IMM.SSL_CLIENT_TRUSTED_CERT4=Not-Installed
IMM.FanSpeedControl=BMC
IMM.DeploymentBoot=Disabled
IMM.MinimalBoot=Disabled
IMM.PowerRestorePolicy=Restore
IMM.ForceBootToUefi=Disabled
IMM.AutoROMPromotion=Enabled
IMM.PowerOnAtSpecifiedTime=0:0:0:0:0
IMM.ShutdownAndPowerOff=WD:HH:MM
IMM.PowerOnServer=WD:HH:MM
IMM.ShutdownAndRestart=WD:HH:MM
IMM.PXE_NextBootEnabled=Disabled
IMM.SystemNextBootMode=Legacy
IMM.TimeZone=GMT+0:00
IMM.DST=Off
IMM.IMMInfo_Name=
IMM.IMMInfo_Contact=
IMM.IMMInfo_Location=
IMM.IMMInfo_RoomId=
IMM.IMMInfo_RackId=
IMM.IMMInfo_Lowest_U=0
IMM.IMMInfo_Height=2
IMM.IMMInfo_BladeBay=0
IMM.IMMInfo_FullPostalAddress=
IMM.OSWatchdog=Disabled
IMM.LoaderWatchdog=Disabled
IMM.PowerOffDelay=Disabled
IMM.NTPAutoSynchronization=Enabled
IMM.NTPHost1=10.96.224.2
IMM.NTPHost2=
IMM.NTPHost3=
IMM.NTPHost4=
IMM.NTPFrequency=17
IMM.LoginId.1=USERID
IMM.LoginId.10=
IMM.LoginId.11=
IMM.LoginId.12=
IMM.LoginId.2=
IMM.LoginId.3=
IMM.LoginId.4=
IMM.LoginId.5=
IMM.LoginId.6=
IMM.LoginId.7=
IMM.LoginId.8=
IMM.LoginId.9=
IMM.AuthorityLevel.1=Supervisor
IMM.UserAccountManagementPriv.1=No
IMM.RemoteConsolePriv.1=No
IMM.RemoteConsoleDiskPriv.1=No
IMM.RemotePowerPriv.1=No
IMM.ClearEventLogPriv.1=No
IMM.BasicAdapterConfigPriv.1=No
IMM.AdapterConfigNetworkSecurityPriv.1=No
IMM.AdvancedAdapterConfigPriv.1=No
IMM.SNMPv3_AuthenticationProtocol.1=NONE
IMM.SNMPv3_PrivacyProtocol.1=NONE
IMM.SNMPv3_AccessType.1=Get
IMM.SNMPv3_TrapHostname.1=
IMM.User_Authentication_Method=LDAP first, then Local
IMM.WebTimeout=20 minutes
IMM.AccountSecurity=Legacy security settings
IMM.LockoutPeriod=2
IMM.LoginPassword=Disabled
IMM.PasswordReuse=Disabled
IMM.ComplexPassword=Disabled
IMM.PasswordAge=0
IMM.MinPasswordLen=0
IMM.PwChangeInterval=0
IMM.PwMaxFailure=5
IMM.PwDiffChar=0
IMM.DefPasswordExp=Disabled
IMM.FirstAccessPwChange=Disabled
IMM.SessionDisconnect_Default=Disabled
IMM.SessionTimeout_Default=60
IMM.RetryLimit=5 times
IMM.EntriesDelay=0.5 minutes
IMM.RetryDelay=0.5 minutes
IMM.SNMPAlerts_CriticalAlert=Disabled
IMM.SNMPAlerts_WarningAlert=Disabled
IMM.SNMPAlerts_SystemAlert=Disabled
IMM.SNMPAlerts_CriticalAlertCategory=none
IMM.SNMPAlerts_WarningAlertCategory=none
IMM.SNMPAlerts_SystemAlertCategory=none
IMM.SerialRedirectionCLIMode1=CLI active / user defined keystroke sequences
IMM.SerialExitCLIKeySequence=[1]83L000000002003oD6mbM2082dPy00000000000?l0000000000000000000000000o0000000000000000000000003o0000000000000000000000000?l0000000000000000000000000o0000000000
LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000003o0000000000000000000000P0000000002]BF9H3050000000@820:kL4URF01@0000004:0P1j;A=HUPy0D00000014P80]RXCF9H3050000000AX2000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000410000040hyhR000000400@010z3z8P00000000800@3PcR8000000P030040hyhR000000y0000000090?h00000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=0000003n1@8000010@00000000000000hyhR0000004000002@3n000000000000000000000000oPD200000@410000000000000z3z8P000002000000T0oP00000000000000000000000?h50P0000410P0000000000003PcR80000000000090?h000000000000000000000003n1@8000010@y0000000000000hyhR00000003
LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=0?0ool0o000PyH003PcR80000000020@400P000@80o03oo3o00020aP00z3z8P00000000810@020002003l0?oo0?l000836000hyhR000000000P41008000y10?0ool0o000PyH003PcR80000000020@400P000O0200000010gP1o000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000P0000000002]BF9H3050000000@820:kL4URF01@
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.VirtualizationMode=None (pNIC)
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.BlinkLEDs=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.LinkStatus=Disconnected
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.PermanentMACAddress=00:0E:1E:7F:6F:00
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.VirtualMACAddress=00:0E:1E:7F:6F:00
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.LegacyBootProtocol=PXE
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.BootStrapType=Auto Detect
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.HideSetupPrompt=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.SetupKeyStroke=Ctrl-S
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.BannerMessageTimeout=5
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.LinkSpeed=10 Gbps Full
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.WakeOnLAN=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.VLANMode=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.VLANID14094=1
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.BootRetryCount=No Retry
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.TCPIPParametersviaDHCP=Enabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIParametersviaDHCP=Enabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.CHAPAuthentication=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.BoottoTarget=Enabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.DHCPVendorID=BRCM ISAN
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIGeneralParameters_LinkUpDelayTime=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.UseTCPTimestamp=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIGeneralParameters_TargetasFirstHDD=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIGeneralParameters_LUNBusyRetryCount=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.IPVersion=IPv4
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIInitiatorParameters_IPAddress=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.SubnetMask=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.SubnetMaskPrefix=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.DefaultGateway=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.PrimaryDNS=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.SecondaryDNS=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIInitiatorParameters_iSCSIName=iqn.1995-05.com.broadcom.iscsiboot
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIInitiatorParameters_CHAPID=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIInitiatorParameters_CHAPSecret=********
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIFirstTargetParameters_Connect=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIFirstTargetParameters_IPAddress=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIFirstTargetParameters_TCPPort=3260
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIFirstTargetParameters_BootLUN=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIFirstTargetParameters_iSCSIName=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIFirstTargetParameters_CHAPID=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIFirstTargetParameters_CHAPSecret=********
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSISecondTargetParameters_Connect=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSISecondTargetParameters_IPAddress=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSISecondTargetParameters_TCPPort=3260
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSISecondTargetParameters_BootLUN=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSISecondTargetParameters_iSCSIName=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSISecondTargetParameters_CHAPID=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSISecondTargetParameters_CHAPSecret=********
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.SecondaryDeviceMACAddress=00:00:00:00:00:00
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.UseIndependentTargetPortal=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.UseIndependentTargetName=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.MFW=7.8.55
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.MBA=7.8.51
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.EFI=7.8.53
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIBoot=7.8.51
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.L2FW=7.8.5
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.FCoEBoot=N/A
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.CCM=N/A
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.DCBProtocol=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.MaxPFMSI-XVectors=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.VirtualizationMode=None (pNIC)
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.BlinkLEDs=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.LinkStatus=Disconnected
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.PermanentMACAddress=00:0E:1E:7F:6F:02
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.VirtualMACAddress=00:0E:1E:7F:6F:02
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.LegacyBootProtocol=PXE
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.BootStrapType=Auto Detect
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.HideSetupPrompt=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.SetupKeyStroke=Ctrl-S
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.BannerMessageTimeout=5
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.LinkSpeed=10 Gbps Full
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.WakeOnLAN=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.VLANMode=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.VLANID14094=1
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.BootRetryCount=No Retry
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.TCPIPParametersviaDHCP=Enabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIParametersviaDHCP=Enabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.CHAPAuthentication=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.BoottoTarget=Enabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.DHCPVendorID=BRCM ISAN
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIGeneralParameters_LinkUpDelayTime=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.UseTCPTimestamp=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIGeneralParameters_TargetasFirstHDD=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIGeneralParameters_LUNBusyRetryCount=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.IPVersion=IPv4
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIInitiatorParameters_IPAddress=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.SubnetMask=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.SubnetMaskPrefix=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.DefaultGateway=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.PrimaryDNS=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.SecondaryDNS=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIInitiatorParameters_iSCSIName=iqn.1995-05.com.broadcom.iscsiboot
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIInitiatorParameters_CHAPID=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIInitiatorParameters_CHAPSecret=********
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIFirstTargetParameters_Connect=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIFirstTargetParameters_IPAddress=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIFirstTargetParameters_TCPPort=3260
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIFirstTargetParameters_BootLUN=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIFirstTargetParameters_iSCSIName=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIFirstTargetParameters_CHAPID=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIFirstTargetParameters_CHAPSecret=********
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSISecondTargetParameters_Connect=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSISecondTargetParameters_IPAddress=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSISecondTargetParameters_TCPPort=3260
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSISecondTargetParameters_BootLUN=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSISecondTargetParameters_iSCSIName=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSISecondTargetParameters_CHAPID=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSISecondTargetParameters_CHAPSecret=********
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.SecondaryDeviceMACAddress=00:00:00:00:00:00
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.UseIndependentTargetPortal=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.UseIndependentTargetName=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.MFW=7.8.55
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.MBA=7.8.51
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.EFI=7.8.53
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIBoot=7.8.51
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.L2FW=7.8.5
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.FCoEBoot=N/A
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.CCM=N/A
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.DCBProtocol=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.MaxPFMSI-XVectors=0
BroadcomGigabitEthernetBCM5719-0894EF01E050.BlinkLEDs=0
BroadcomGigabitEthernetBCM5719-0894EF01E050.LinkStatus=Disconnected
BroadcomGigabitEthernetBCM5719-0894EF01E050.PermanentMACAddress=08:94:EF:01:E0:50
BroadcomGigabitEthernetBCM5719-0894EF01E050.VirtualMACAddress=08:94:EF:01:E0:50
BroadcomGigabitEthernetBCM5719-0894EF01E050.LegacyBootProtocol=PXE
BroadcomGigabitEthernetBCM5719-0894EF01E050.BootStrapType=Auto Detect
BroadcomGigabitEthernetBCM5719-0894EF01E050.HideSetupPrompt=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E050.SetupKeyStroke=Ctrl-S
BroadcomGigabitEthernetBCM5719-0894EF01E050.BannerMessageTimeout=5
BroadcomGigabitEthernetBCM5719-0894EF01E050.LinkSpeed=AutoNeg
BroadcomGigabitEthernetBCM5719-0894EF01E050.Pre-bootWakeOnLAN=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E050.VLANMode=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E050.VLANID14094=1
BroadcomGigabitEthernetBCM5719-0894EF01E050.Bootcode=1.38
BroadcomGigabitEthernetBCM5719-0894EF01E050.MBA=16.8.0
BroadcomGigabitEthernetBCM5719-0894EF01E050.EFI=16.8.4
BroadcomGigabitEthernetBCM5719-0894EF01E050.iSCSIBoot=N/A
BroadcomGigabitEthernetBCM5719-0894EF01E050.NC-SI=1.3.4
BroadcomGigabitEthernetBCM5719-0894EF01E050.CCM=N/A
BroadcomGigabitEthernetBCM5719-0894EF01E051.BlinkLEDs=0
BroadcomGigabitEthernetBCM5719-0894EF01E051.LinkStatus=Connected
BroadcomGigabitEthernetBCM5719-0894EF01E051.PermanentMACAddress=08:94:EF:01:E0:51
BroadcomGigabitEthernetBCM5719-0894EF01E051.VirtualMACAddress=08:94:EF:01:E0:51
BroadcomGigabitEthernetBCM5719-0894EF01E051.LegacyBootProtocol=PXE
BroadcomGigabitEthernetBCM5719-0894EF01E051.BootStrapType=Auto Detect
BroadcomGigabitEthernetBCM5719-0894EF01E051.HideSetupPrompt=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E051.SetupKeyStroke=Ctrl-S
BroadcomGigabitEthernetBCM5719-0894EF01E051.BannerMessageTimeout=5
BroadcomGigabitEthernetBCM5719-0894EF01E051.LinkSpeed=AutoNeg
BroadcomGigabitEthernetBCM5719-0894EF01E051.Pre-bootWakeOnLAN=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E051.VLANMode=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E051.VLANID14094=1
BroadcomGigabitEthernetBCM5719-0894EF01E051.Bootcode=1.38
BroadcomGigabitEthernetBCM5719-0894EF01E051.MBA=16.8.0
BroadcomGigabitEthernetBCM5719-0894EF01E051.EFI=16.8.4
BroadcomGigabitEthernetBCM5719-0894EF01E051.iSCSIBoot=N/A
BroadcomGigabitEthernetBCM5719-0894EF01E051.NC-SI=1.3.4
BroadcomGigabitEthernetBCM5719-0894EF01E051.CCM=N/A
BroadcomGigabitEthernetBCM5719-0894EF01E052.BlinkLEDs=0
BroadcomGigabitEthernetBCM5719-0894EF01E052.LinkStatus=Disconnected
BroadcomGigabitEthernetBCM5719-0894EF01E052.PermanentMACAddress=08:94:EF:01:E0:52
BroadcomGigabitEthernetBCM5719-0894EF01E052.VirtualMACAddress=08:94:EF:01:E0:52
BroadcomGigabitEthernetBCM5719-0894EF01E052.LegacyBootProtocol=PXE
BroadcomGigabitEthernetBCM5719-0894EF01E052.BootStrapType=Auto Detect
BroadcomGigabitEthernetBCM5719-0894EF01E052.HideSetupPrompt=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E052.SetupKeyStroke=Ctrl-S
BroadcomGigabitEthernetBCM5719-0894EF01E052.BannerMessageTimeout=5
BroadcomGigabitEthernetBCM5719-0894EF01E052.LinkSpeed=AutoNeg
BroadcomGigabitEthernetBCM5719-0894EF01E052.Pre-bootWakeOnLAN=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E052.VLANMode=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E052.VLANID14094=1
BroadcomGigabitEthernetBCM5719-0894EF01E052.Bootcode=1.38
BroadcomGigabitEthernetBCM5719-0894EF01E052.MBA=16.8.0
BroadcomGigabitEthernetBCM5719-0894EF01E052.EFI=16.8.4
BroadcomGigabitEthernetBCM5719-0894EF01E052.iSCSIBoot=N/A
BroadcomGigabitEthernetBCM5719-0894EF01E052.NC-SI=1.3.4
BroadcomGigabitEthernetBCM5719-0894EF01E052.CCM=N/A
BroadcomGigabitEthernetBCM5719-0894EF01E053.BlinkLEDs=0
BroadcomGigabitEthernetBCM5719-0894EF01E053.LinkStatus=Disconnected
BroadcomGigabitEthernetBCM5719-0894EF01E053.PermanentMACAddress=08:94:EF:01:E0:53
BroadcomGigabitEthernetBCM5719-0894EF01E053.VirtualMACAddress=08:94:EF:01:E0:53
BroadcomGigabitEthernetBCM5719-0894EF01E053.LegacyBootProtocol=PXE
BroadcomGigabitEthernetBCM5719-0894EF01E053.BootStrapType=Auto Detect
BroadcomGigabitEthernetBCM5719-0894EF01E053.HideSetupPrompt=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E053.SetupKeyStroke=Ctrl-S
BroadcomGigabitEthernetBCM5719-0894EF01E053.BannerMessageTimeout=5
BroadcomGigabitEthernetBCM5719-0894EF01E053.LinkSpeed=AutoNeg
BroadcomGigabitEthernetBCM5719-0894EF01E053.Pre-bootWakeOnLAN=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E053.VLANMode=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E053.VLANID14094=1
BroadcomGigabitEthernetBCM5719-0894EF01E053.Bootcode=1.38
BroadcomGigabitEthernetBCM5719-0894EF01E053.MBA=16.8.0
BroadcomGigabitEthernetBCM5719-0894EF01E053.EFI=16.8.4
BroadcomGigabitEthernetBCM5719-0894EF01E053.iSCSIBoot=N/A
BroadcomGigabitEthernetBCM5719-0894EF01E053.NC-SI=1.3.4
BroadcomGigabitEthernetBCM5719-0894EF01E053.CCM=N/A


  1. (
    IMM.SerialBaudRate=115200
    IMM.CIMOverHTTPPort=5988
    IMM.CIMOverHTTPSPort=5989
    IMM.HTTPPort=80
    IMM.SSLPort=443
    IMM.TelnetPort=23
    IMM.SSHPort=22
    IMM.SNMP_AgentPort=161
    IMM.SNMP_TrapPort=162
    IMM.RemoteConsolePort=3900
    IMM.HttpPortControl=Open
    IMM.HttpsPortControl=Open
    IMM.CIMOverHttpPortControl=Open
    IMM.CIMOverHttpsPortControl=Open
    IMM.TelnetLegacyPortControl=Open
    IMM.SSHLegacyPortControl=Open
    IMM.RemotePresencePortControl=Open
    IMM.SNMPAgentPortControl=Open
    IMM.SLPPortControl=Open
    IMM.FTPDataPortControl=Open
    IMM.FTPServerPortControl=Open
    IMM.SFTPPortControl=Open
    IMM.IMMFTPServerPortControl=Open
    IMM.IMMDebugPortControl=Open
    IMM.DHCPClientPortControl=Open
    IMM.DHCPBootPCClientPortControl=Open
    IMM.CMMIPMIPortControl=Open
    IMM.LanOverUsb=Enabled
    IMM.LanOverUsbIMMIP=169.254.95.118
    IMM.LanOverUsbIMMNetmask=255.255.0.0
    IMM.LanOverUsbHostIP=169.254.95.120
    IMM.PortForwarding=Enabled
    IMM.Network1=Enabled
    IMM.DHCP1=Disabled
    IMM.HostName1=IMM2-0894ef01e055
    IMM.HostIPAddress1=10.9.0.205
    IMM.HostIPSubnet1=255.255.255.0
    IMM.GatewayIPAddress1=10.9.0.1
    IMM.SharedNicMode=Dedicated
    IMM.FailoverMode=None
    IMM.NetworkSettingSync=Enabled
    IMM.DHCPAssignedHostname=IMM2-0894ef01e055
    IMM.DHCPAssignedHostIP1=10.9.0.205
    IMM.DHCPAssignedGateway1=10.9.0.1
    IMM.DHCPAssignedNetMask1=255.255.255.0
    IMM.DHCPAssignedDomainName=
    IMM.DHCPAssignedPrimaryDNS1=0.0.0.0
    IMM.DHCPAssignedSecondaryDNS1=0.0.0.0
    IMM.DHCPAssignedTertiaryDNS1=0.0.0.0
    IMM.IPv6Network1=Enabled
    IMM.IPv6Static1=Disabled
    IMM.IPv6DHCP1=Enabled
    IMM.IPv6Stateless1=Enabled
    IMM.IPv6HostIPAddressWithPrefix1=::/64
    IMM.IPv6GatewayIPAddress1=::
    IMM.IPv6LinkLocalIPAddress1=fe80::0a94:efff:fe01:e055/64
    IMM.IPv6StatelessIPAddress1=::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0
    IMM.IPv6StatelessGateway1=::
    IMM.IPv6DHCPAssignedHostIP1=::
    IMM.IPv6DHCPAssignedDomainName=
    IMM.IPv6DHCPAssignedPrimaryDNS1=::
    IMM.IPv6DHCPAssignedSecondaryDNS1=::
    IMM.IPv6DHCPAssignedTertiaryDNS1=::
    IMM.AutoNegotiate1=Yes
    IMM.LANDataRate1=Auto
    IMM.Duplex1=Auto
    IMM.MTU1=1500
    IMM.MACAddress1=08:94:ef:01:e0:55
    IMM.BurnedInMacAddress=08:94:ef:01:e0:55
    IMM.SNMPv1Agent=Disabled
    IMM.SNMPv3Agent=Disabled
    IMM.SNMPTraps=Disabled
    IMM.Community_Name.1=
    IMM.Community_Name.2=
    IMM.Community_Name.3=
    IMM.Community_AccessType.1=Get
    IMM.Community_AccessType.2=Get
    IMM.Community_AccessType.3=Get
    IMM.Community_HostIPAddress1.1=
    IMM.Community_HostIPAddress1.2=
    IMM.Community_HostIPAddress1.3=
    IMM.Community_HostIPAddress2.1=
    IMM.Community_HostIPAddress2.2=
    IMM.Community_HostIPAddress2.3=
    IMM.Community_HostIPAddress3.1=
    IMM.Community_HostIPAddress3.2=
    IMM.Community_HostIPAddress3.3=
    IMM.DNS_Enable=Disabled
    IMM.DNSPreference=IPv6
    IMM.DNS_IP_Address1=0.0.0.0
    IMM.DNS_IP_Address2=0.0.0.0
    IMM.DNS_IP_Address3=0.0.0.0
    IMM.IPv6DNS_IP_Address1=::
    IMM.IPv6DNS_IP_Address2=::
    IMM.IPv6DNS_IP_Address3=::
    IMM.DDNS_Enable=Enabled
    IMM.DDNSPreference=DHCP
    IMM.Custom_Domain=
    IMM.TelnetSessions=2
    IMM.SMTP_ServerName=4.00588e-11
    IMM.SMTP_Port=25
    IMM.SMTP_Authentication=Disabled
    IMM.SMTP_UserName=
    IMM.SMTP_AuthMethod=CRAM-MD5
    IMM.SMTP_ReversePath=
    IMM.Select_LDAP_Servers=Use Pre-Configured LDAP Servers
    IMM.Search_Domain=memberOf
    IMM.LDAP_Server1_HostName_IPAddress=10.9.0.1
    IMM.LDAP_Server1_Port=50637
    IMM.LDAP_Server2_HostName_IPAddress=
    IMM.LDAP_Server2_Port=389
    IMM.LDAP_Server3_HostName_IPAddress=
    IMM.LDAP_Server3_Port=389
    IMM.LDAP_Server4_HostName_IPAddress=
    IMM.LDAP_Server4_Port=389
    IMM.SKR_Server1_HostName_IPAddress=
    IMM.SKR_Server1_Port=
    IMM.SKR_Server2_HostName_IPAddress=
    IMM.SKR_Server2_Port=
    IMM.SKR_Server3_HostName_IPAddress=
    IMM.SKR_Server3_Port=
    IMM.SKR_Server4_HostName_IPAddress=
    IMM.SKR_Server4_Port=
    IMM.SKR_DEVICE_GROUP=
    IMM.Root_DN=ou=Users,dc=ibmbase,dc=com
    IMM.UID_Search=cn
    IMM.BindingMethod=Bind using Login Credentials
    IMM.ClientDN=
    IMM.RoleBasedSecurity=Disabled
    IMM.ServerTargetName=
    IMM.GroupFilter=
    IMM.Group_Search_Attribute=memberOf
    IMM.AuthorizationMethod=authorization will be done in LDAP Server.
    IMM.Forest_Name=
    IMM.Login_Permission_Attribute=ibm-chassisRole
    IMM.SSL_Server_Enable=Enabled
    IMM.CIMXMLOverHTTPS_Enable=Enabled
    IMM.SSL_Client_Enable=Enabled
    IMM.SSH_Enable=Enabled
    IMM.CryptographyMode=Basic
    IMM.CryptoSnmpv3Exception=Disabled
    IMM.VMMigration_EventCategoryType=custom:error
    IMM.VMMigration_EventCategory=custom:memo|cool
    SYSTEM_PROD_DATA.SysInfoProdName=5462I4Y
    SYSTEM_PROD_DATA.SysInfoProdIdentifier=System x3650 M5:
    SYSTEM_PROD_DATA.SysInfoSerialNum=06GCGXA
    SYSTEM_PROD_DATA.SysInfoUUID=22792FAC29FF11E5BF850894EF01E050
    SYSTEM_PROD_DATA.SysInfoUDI=
    SYSTEM_PROD_DATA.SysEncloseAssetTag=
    PXE.NicPortMacAddress.1=00:0E:1E:7F:6F:00
    PXE.NicPortMacAddress.2=00:0E:1E:7F:6F:02
    PXE.NicPortMacAddress.3=08:94:EF:01:E0:50
    PXE.NicPortMacAddress.4=08:94:EF:01:E0:51
    PXE.NicPortMacAddress.5=08:94:EF:01:E0:52
    PXE.NicPortMacAddress.6=08:94:EF:01:E0:53
    PXE.NicPortPxeMode.1=Enabled
    PXE.NicPortPxeMode.2=Enabled
    PXE.NicPortPxeMode.3=Enabled
    PXE.NicPortPxeMode.4=Enabled
    PXE.NicPortPxeMode.5=Enabled
    PXE.NicPortPxeMode.6=Enabled
    PXE.NicPortPxeProtocol.1=IPV4
    PXE.NicPortPxeProtocol.2=IPV4
    PXE.NicPortPxeProtocol.3=IPV4
    PXE.NicPortPxeProtocol.4=IPV4
    PXE.NicPortPxeProtocol.5=IPV4
    PXE.NicPortPxeProtocol.6=IPV4
    AdvancedRAS.PCIeIsolation=Disable
    POSTAttempts.POSTAttemptsLimit=3
    BackupBankManagement.BackupBankManagementMethod=Auto Promotion
    BackupBankManagement.NumberOfSuccessfulConsecutiveBoots=53
    BackupBankManagement.NumberOfWeeks=52
    LegacySupport.ForceLegacyVideoonBoot=Enabled
    LegacySupport.RehookINT19h=Disabled
    LegacySupport.LegacyThunkSupport=Enabled
    LegacySupport.InfiniteBootRetry=Disabled
    LegacySupport.BBSBoot=Enabled
    LegacySupport.Non-PlanarPXE=Enabled
    DiskGPTRecovery.DiskGPTRecovery=Manual
    OperatingModes.ChooseOperatingMode=Efficiency - Favor Performance
    SystemRecovery.POSTWatchdogTimer=Disable
    SystemRecovery.POSTWatchdogTimerValue=5
    SystemRecovery.RebootSystemonNMI=Enable
    SystemRecovery.HaltOnSevereError=Disable
    Memory.MemoryMode=Independent
    Memory.Sparing=Disable
    Memory.MemorySpeed=Max Performance
    Memory.MemoryPowerManagement=Disable
    Memory.SocketInterleave=NUMA
    Memory.PatrolScrub=Enable
    Memory.MemoryDataScrambling=Enable
    Memory.PagePolicy=Adaptive
    Memory.ColdBootFast=Disable
    Processors.TurboMode=Enable
    Processors.CPUP-stateControl=Legacy
    Processors.C-States=Legacy
    Processors.C1EnhancedMode=Enable
    Processors.Hyper-Threading=Enable
    Processors.ExecuteDisableBit=Enable
    Processors.TrustedExecutionTechnology=Disable
    Processors.IntelVirtualizationTechnology=Enable
    Processors.HardwarePrefetcher=Enable
    Processors.AdjacentCachePrefetch=Enable
    Processors.DCUStreamerPrefetcher=Enable
    Processors.DCUIPPrefetcher=Enable
    Processors.DCA=Disable
    Processors.EnergyEfficientTurbo=Enable
    Processors.UncoreFrequencyScaling=Enable
    Processors.MONITORMWAIT=Enable
    Processors.QPILinkDisable=Enable All Links
    Processors.CODPreference=Disable
    Processors.SnoopPreference=Home Snoop
    Processors.PerCoreP-state=Enable
    Processors.CoresinCPUPackage=All
    Processors.QPILinkFrequency=Max Performance
    Processors.TurboLimits=Full turbo uplift
    Power.ActiveEnergyManager=Capping Enabled
    Power.PowerPerformanceBias=Platform Controlled
    Power.PlatformControlledType=Efficiency - Favor Performance
    Power.WorkloadConfiguration=Balanced
    Power.ZeroOutput=Advance Mode
    Power.Interval=30 minutes
    DevicesandIOPorts.ActiveVideo=Onboard Device
    DevicesandIOPorts.PCI64-BitResourceAllocation=Enable
    DevicesandIOPorts.MMConfigBase=2GB
    DevicesandIOPorts.IntelVTforDirectedIOVT-d=Enable
    DevicesandIOPorts.BCM5719LowPowerMode=Disable
    DevicesandIOPorts.SetOptionROMExecutionOrder=Ethernet 1=Ethernet 2=Ethernet 3=Ethernet 4=Video=Slot 4=Slot 5=Slot 6=Slot 8=Slot 9
    DevicesandIOPorts.Video=Enable
    DevicesandIOPorts.EnableDisableOnboardDevices_Slot4=Enable
    DevicesandIOPorts.EnableDisableOnboardDevices_Slot5=Enable
    DevicesandIOPorts.EnableDisableOnboardDevices_Slot6=Enable
    DevicesandIOPorts.EnableDisableOnboardDevices_Slot8=Enable
    DevicesandIOPorts.EnableDisableOnboardDevices_Slot9=Enable
    DevicesandIOPorts.Legacy_Ethernet1=Enable
    DevicesandIOPorts.Legacy_Ethernet2=Enable
    DevicesandIOPorts.Legacy_Ethernet3=Enable
    DevicesandIOPorts.Legacy_Ethernet4=Enable
    DevicesandIOPorts.Legacy_Video=Enable
    DevicesandIOPorts.Legacy_Slot4=Enable
    DevicesandIOPorts.Legacy_Slot5=Enable
    DevicesandIOPorts.Legacy_Slot6=Enable
    DevicesandIOPorts.Legacy_Slot8=Enable
    DevicesandIOPorts.Legacy_Slot9=Enable
    DevicesandIOPorts.UEFI_Ethernet1=Enable
    DevicesandIOPorts.UEFI_Ethernet2=Enable
    DevicesandIOPorts.UEFI_Ethernet3=Enable
    DevicesandIOPorts.UEFI_Ethernet4=Enable
    DevicesandIOPorts.UEFI_Video=Enable
    DevicesandIOPorts.UEFI_Slot4=Enable
    DevicesandIOPorts.UEFI_Slot5=Enable
    DevicesandIOPorts.UEFI_Slot6=Enable
    DevicesandIOPorts.UEFI_Slot8=Enable
    DevicesandIOPorts.UEFI_Slot9=Enable
    DevicesandIOPorts.PCIeGen1Gen2Gen3SpeedSelection_Slot4=Gen3
    DevicesandIOPorts.PCIeGen1Gen2Gen3SpeedSelection_Slot5=Gen3
    DevicesandIOPorts.PCIeGen1Gen2Gen3SpeedSelection_Slot6=Gen3
    DevicesandIOPorts.PCIeGen1Gen2Gen3SpeedSelection_Slot8=Gen3
    DevicesandIOPorts.PCIeGen1Gen2Gen3SpeedSelection_Slot9=Gen3
    DevicesandIOPorts.COMPort1=Enable
    DevicesandIOPorts.COMPort2=Enable
    DevicesandIOPorts.RemoteConsole=Auto
    DevicesandIOPorts.SerialPortSharing=Disable
    DevicesandIOPorts.SerialPortAccessMode=Disable
    DevicesandIOPorts.LegacyOptionROMDisplay=COM Port 1
    DevicesandIOPorts.Com1BaudRate=115200
    DevicesandIOPorts.Com1DataBits=8
    DevicesandIOPorts.Com1Parity=None
    DevicesandIOPorts.Com1StopBits=1
    DevicesandIOPorts.Com1TerminalEmulation=ANSI
    DevicesandIOPorts.Com1ActiveAfterBoot=Disable
    DevicesandIOPorts.Com1FlowControl=Disable
    DevicesandIOPorts.Com2BaudRate=115200
    DevicesandIOPorts.Com2DataBits=8
    DevicesandIOPorts.Com2Parity=None
    DevicesandIOPorts.Com2StopBits=1
    DevicesandIOPorts.Com2TerminalEmulation=ANSI
    DevicesandIOPorts.Com2ActiveAfterBoot=Disable
    DevicesandIOPorts.Com2FlowControl=Disable
    SecureBootConfiguration.SecureBootis=Disabled
    BootModes.SystemBootMode=UEFI Mode
    BootModes.OptimizedBoot=Enabled
    BootModes.QuietBoot=Enabled
    BootOrder.BootOrder=CentOS Linux - Boot000E=CentOS=Windows Boot Manager=CentOS Linux - Boot000A=CentOS Linux - Boot0008=CD/DVD Rom=Hard Disk 0=PXE Network
    BootOrder.WolBootOrder=PXE Network=CD/DVD Rom=Hard Disk 0
    iSCSI.InitiatorName=iqn.1986-03.com.example
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_UCMDataStructureVersion=2
    LSIMegaRAIDConfigurationTool-0B0.ControllerName=ServeRAID M5210
    LSIMegaRAIDConfigurationTool-0B0.FirmwareVersion=4.270.00-4288
    LSIMegaRAIDConfigurationTool-0B0.UEFIBSDVersion=0x060B0201
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_DriveCount=4
    LSIMegaRAIDConfigurationTool-0B0.VirtualDriveCount=4
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_ProtectionCapable=Yes
    LSIMegaRAIDConfigurationTool-0B0.ProtectionEnabled=Yes
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_RAIDLevel=RAID0
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Media=HDD
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_InterfaceType=SAS
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_DriveCount=1
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Status=Optimal
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_SizeKB=291991552
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_LogicalSectorSize=512B
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Media=HDD
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_InterfaceType=SAS
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_SizeKB=291991552
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_LogicalSectorSize=512B
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Status=Online
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_ProtectionCapable=Yes(2)
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_TargetIDofAssociatedVirtualDrive=3
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Media=HDD
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_InterfaceType=SAS
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_SizeKB=291991552
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_LogicalSectorSize=512B
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Status=Online
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_ProtectionCapable=Yes(2)
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_TargetIDofAssociatedVirtualDrive=2
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Media=HDD
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_InterfaceType=SAS
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_SizeKB=291991552
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_LogicalSectorSize=512B
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Status=Online
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_ProtectionCapable=Yes(2)
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_TargetIDofAssociatedVirtualDrive=1
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Media=HDD
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_InterfaceType=SAS
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_SizeKB=291991552
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_LogicalSectorSize=512B
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Status=Online
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_ProtectionCapable=Yes(2)
    LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_TargetIDofAssociatedVirtualDrive=0
    LSIMegaRAIDConfigurationTool-0B0.SimpleConfiguration_UCMDataStructureVersion=2
    LSIMegaRAIDConfigurationTool-0B0.ClearConfiguration=None
    LSIMegaRAIDConfigurationTool-0B0.SimpleConfiguration_RAIDLevel=RAID0
    LSIMegaRAIDConfigurationTool-0B0.SimpleConfiguration_DriveCount=0
    LSIMegaRAIDConfigurationTool-0B0.SimpleConfiguration_Media=None
    LSIMegaRAIDConfigurationTool-0B0.SimpleConfiguration_InterfaceType=None
    LSIMegaRAIDConfigurationTool-0B0.SimpleConfiguration_LogicalSectorSize=None
    LSIMegaRAIDConfigurationTool-0B0.ProtectVirtualDrive=No
    LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_UCMDataStructureVersion=2
    LSIMegaRAIDConfigurationTool-0B0.Operation=Save
    LSIMegaRAIDConfigurationTool-0B0.ExcludeSystemPDs=No
    LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=Dde3E@800020000En0721X:10o20@D014P00@03P000000011M01@@E0@100400080000000000P00oe1_LW@P=20 ↩︎

bob,

I also try to install windows 2008 server on my system x3650 M5, but while I install cuda 7.5, it reports no GPU device detected, so the driver can’t be installed.

One of my colleagues set up a 3650 M5 with K40c and CentOS 7 and didn’t have any trouble. He had this to say:

I tried out my  x3650 M5.
I used both Centos 6.5 (previously installed) and Centos 7.
In both cases, once I had removed nouveau the systems seem to be working correctly.

I do not get any failures when running nvidia-smi or similar.
With nouveau still loading at startup but after removing before running nvidia-smi I would see a failure under v6.5.  I did not try this under v7.0

In all cases I was using NV r352.99 off of nvidia.com.

My x3650 M5 has broadwell processors in it and recent FW.

So I don’t think we’ll be able to help on this forum. You need to be certain that you are installing the driver correctly. That is covered in the linux installation guide. Be sure to remove nouveau, and do not mix package manager install methods with runfile install methods. If you’re unsure, reinstall the OS, then use the runfile installer for 352.99 from nvidia.com

My next steps would be to suggest that you try a different K40c card in that server, and/or try a different server with that K40c card.

You may also want to discuss your issue with Lenovo.

Bob,

Thanks very much. Actually, I have tried several methods, including re-install the OS, use latest 352.99 driver.

BTW, what’s the power of x3650 M5 your colleague use? Since x3650 has configurations with power 900w, 1300w, and 1500w.And one nvidia engineer also sets up a 3650 M5 with K40c, and the power of M5 is 1300w.

FYI
https://devtalk.nvidia.com/default/topic/852598/34x-35x-36x-freeze-at-reboot-shutdown-tty-switch-rcu_sched-self-detected-stall-detected/