Installing Intel NIC Drivers on VMware ESXi for System x3650 M3

Installing Intel NIC Drivers on VMware ESXi for System x3650 M3

 

This procedure describes, how to setup base Networking configuration for ESXi 4.1 on IBM System X 3650 M3 Servers:

 This is a high level overview and reference only. This is not a step-by-step guide. You will need to have 3rd experience in VMWare to use this guide. This should be used with ESXi build guides and Detailed design.

Installing Intel NIC Drivers on VMware ESXi for System x3650 M3:-

Known Issue:-

 After installing VMware ESXi 4X on IBM System X 3650 M3 Servers, ESXi does not see Intel Quad-Port or Dual-Port NIC – Intel Ethernet Dual-Port or Quad-Port Server Adapter: – http://www-947.ibm.com/support/entry/portal/docdisplay?lndocid=migr-5089106 (Intel Ethernet Dual Port Server Adapter I340-T2 for IBM System x (49Y4230)  See below screenshot:

  • Download the IBM customised ESXi (.iso)

http://www14.software.ibm.com/webapp/download/preconfig.jsp?id=2011-12-14+09%3A23%3A53.641127R&S_TACT=104CBW&S_CMP=

  • Download the appropriate driver (.iso) from VMware.com only (unless otherwise indicated):-

http://downloads.vmware.com/d/info/datacenter_downloads/vmware_vsphere_hypervisor_esxi/4_0#drivers_tools

http://www-947.ibm.com/support/entry/portal/docdisplay?lndocid=MIGR-5085368

  • Download the latest ESX update: – http://www.vmware.com/patchmgr/download.portal
  • Use existing ESXi Base Build Guides and install ESXi.
  • Enable Local Tech support mode in ESXi and use ALT-F1 and ALT-F2 to Enter and Exit local console:

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1017910

  • Insert NIC Driver CD or Mount NIC Driver ISO via Remote RSA/IMM (iLo/DRAC)
  • Issue the following command to ensure CD-ROM is detected:

-       ls –lash /dev/cdrom

-       esxcfg-mpath -l

-       esxcfg-mpath -b | grep "CD-ROM"

-       (You should see an mpx.vmhbaXX:C0:T0:L0-type filename (note the vmhba#) & a vml.-type filename)

  • If CD-ROM is detected, issue the following commands to load the iso9960 module and mount the CD-ROM:

-       vmkload_mod iso9660

-       vim-cmd hostsvc/maintenance_mode_enter

-       vsish -e set /vmkModules/iso9660/mount mpx.vmhba<b>33</b>:C0:T0:L0

-       vim-cmd hostsvc/maintenance_mode_exit

-       vim-cmd hostsvc/hostsummary|grep -i maintenance

-       (Note: the number in RED may differ but is taken from the /dev/cdrom directory listing from the previous command.)

  • The CD-ROM should be mounted and available here:
-       ls –lash /vmfs/volumes/CDROM
  • Change to the offline bundle (.zip file) directory
-       cd /vmfs/volumes/CDROM/OFFLINE_ (or something similar)
  • Place the host into Maintenance Mode:
-       vim-cmd hostsvc/maintenance_mode_enter
  • Execute bundle/update:
-       esxupdate --bundle NameOfBundle.zip update
  • Issue the following command to unmount the CD-ROM:
-       vsish -e set /vmkModules/iso9660/umount mpx.vmhba33:C0:T0:L0
  • Issue the following command to fix incompatibility with ESXi 4.1 and IBM x3650 M3

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1030265

http://www.sysadmintutorials.com/vmware-esx-and-esxi-4-1-incompatibility-with-ibm-x3650-m3-server/


-       esxcfg-advcfg -k TRUE iovDisableIR

-       esxcfg-info –c

  • Reboot the ESXi Server
  • Verify the NICs are visible to ESXi and document the wiring information to the switch ports:

-       cat /etc/vmware/esx.conf | grep “net”

-       esxcfg-nics –l

-       ethtool –i vmnic0

-       esxcfg-vswitch –l

-       ethtool –p vmnic0 10 (Start Blinking NIC LEDs for 10 seconds)

-       vm-support

-       Check /bootbank/oem/oem.tx

-       esxcli network nic up/down –n vmnicX

  • Configure IP addresses for the Management NIC and select the correct NICs:
  • LACP Configuration notes:

As the switch ports will already be configured to LACP or Etherchannel with Load Balancing configurations. Example: IP Hash.

It is not possible to configure all required details for LACP via the command line or ESXi console GUI.

You will need to configure a management IP address on the Management NIC first and then connect to this IP via vSphere Client GUI to complete LACP and Etherchannel settings.

You can also configure an IP address on one of the NICs configured for LACP and VLAN. (Don’t select all LACP NICs, only a single NIC)

Then connect to this IP via vSphere Client GUI to complete the Networking configuration as per Build and Detailed Design.

  • Document the Physical Port wiring:
Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s