Dell R6420 BIOS Settings

• See this page for the R6420 so as to avoid too much confusion from this set of instructions

Dell R620 and R630 BIOS Settings at AGLT2

The following were set in the Dell R620 BIOS at UM prior to first build. Specifics of IP addresses should be modified for R620 at MSU.

Under System BIOS, Memory Settings, I originally set it to test memory. I cleared this during initial setup so that repetitious testing could quickly proceed. Do we want to set this back on for the long term?

• System BIOS settings
  • Under \x93Memory Settings\x94,
    • Did NOT Enable \x93System Memory Testing\x94
    • Left it running \x93Optimizer Mode\x94
  • Under Processor Settings be sure the Logical Processor is "Enabled"
  • Boot Settings
    • BIOS Boot Settings
      • Set NIC1 as first device, hard drive second
      • If R620 or R630 with X520 dual-dual 10G/1G, set NIC3 first, NIC1 last, Disk C second
        • Must first edit Device Settings below and reboot back to BIOS before this can be changed
  • System Profile Settings
    • Set to \x93Performance\x94 on all R620
    • Set to "Custom" on 2015 R630, and then Enable C-States. For the 2016 R630 leave it "Performance"
    • Disabled F1/F2 Prompt on Error
    • Set correct UTC Time
  • System Security (at MSU)
    • Should probably set AC Power Recovery to "off"
• iDRAC Settings
  • Manually set all iDRAC IP, including
  • Network
    • iDrac port setup
      • For R620 with iDrac express and only 1Gb: NIC Enabled on LOM1
      • For R620 with iDrac express with dual-dual 10G/1G devices: NIC Enabled On LOM3
      • For R620/R630 with iDrac Enterprise: Dedicated
    • Set the name, eg, rac-dc32-7-23 at UM, or rac-104-33 at MSU
    • Set the correct IP address for the rac
    • Gateway IP 10.10.1.2 (10.10.128.1) [ UM (MSU) ]
    • Netmask 255.255.252.0 (255.255.240.0)
    • DNS primary 10.10.1.195 (10.10.128.8)
    • Enable IPMI over LAN
  • Front Panel Security
    • LCD as User-Defined String, eg, // c-4-20 // or // c-104-33 // (yes, include the // pairs)
    • Ambient Temp Units \x96 Fahrenheit
    • User Configuration [This is up one level on the Jan, 2015 R620 set]
      • Set the IPMI password
  • Thermal Profile (R630 only)
    • Set to "Maximum Performance"
• Device Settings
  • For original, 2 disk systems with dual 1Gb NICs, No changes
  • Otherwise
    • Enable PXE on NIC1 Port 3
      • Edit the NIC, and look in "Legacy Boot Protocol" [ MBA Configuration or NIC Configuration Menu ]
    • Delete any existing vdisks
      • Virtual Disk Management -> Select Virtual Disk Operations
    • Add new vdisk with all 4 disks (count depends on purchase batch). Named "system" at UM
      • For the 2016 R630 purchase, enter the "Configuration Management" menu
      • Create Virtual Disk -> Raid Level 0
        • Create Virtual Disk -> Select Physical Disks -> Select Media Type SSD, then both disks
        • Be sure to confirm all operations and create the vdisk
      • Must exit and re-enter Virtual Disk Mgmnt after delete of vdisks
      • Following reboot, go back to BIOS Boot Settings above and take care of the BIOS boot order

Creating the machines in Rocks

dc32 appliance with simple, dual 10Gb NICs

Actually, these appear to have 4 NICs, but we do not use em3 or em4

/opt/rocks/bin/rocks add host dc32-4-20 cpus=32 rack=4 rank=20 membership=Dell-R620 os=linux
/opt/rocks/bin/rocks add host interface dc32-4-20 em1
/opt/rocks/bin/rocks add host interface dc32-4-20 em2
/opt/rocks/bin/rocks set host installaction dc32-4-20 action=install
/opt/rocks/bin/rocks set host interface ip dc32-4-20 em1 10.10.1.101
/opt/rocks/bin/rocks set host interface ip dc32-4-20 em2 192.41.230.101
/opt/rocks/bin/rocks set host interface mac dc32-4-20 em1 74:86:7a:f4:0e:04
/opt/rocks/bin/rocks set host interface mac dc32-4-20 em2 74:86:7a:f4:0e:05
/opt/rocks/bin/rocks set host interface module dc32-4-20 em1 bnx2
/opt/rocks/bin/rocks set host interface module dc32-4-20 em2 bnx2
/opt/rocks/bin/rocks set host interface name dc32-4-20 em1 dc32-4-20
/opt/rocks/bin/rocks set host interface name dc32-4-20 em2 c-4-20
/opt/rocks/bin/rocks set host interface subnet dc32-4-20 em1 private
/opt/rocks/bin/rocks set host interface subnet dc32-4-20 em2 public
/opt/rocks/bin/rocks set host runaction dc32-4-20 action=os
/opt/rocks/bin/rocks set host boot dc32-4-20 action=install

dc32 appliance with dual 10Gb NICs and dual 1Gb NICs (Case 1)

This configuration is for simply using the dual 1Gb NICs

/opt/rocks/bin/rocks add host dc32-1-9 cpus=32 rack=1 rank=9 membership=Dell-R620 os=linux
/opt/rocks/bin/rocks add host interface dc32-1-9 em1
/opt/rocks/bin/rocks add host interface dc32-1-9 em2
/opt/rocks/bin/rocks add host interface dc32-1-9 em3
/opt/rocks/bin/rocks add host interface dc32-1-9 em4
/opt/rocks/bin/rocks set host installaction dc32-1-9 action=install
/opt/rocks/bin/rocks set host interface mac dc32-1-9 em1 ec:f4:bb:c7:8c:08
/opt/rocks/bin/rocks set host interface mac dc32-1-9 em2 ec:f4:bb:c7:8c:0a
/opt/rocks/bin/rocks set host interface mac dc32-1-9 em3 ec:f4:bb:c7:8c:0c
/opt/rocks/bin/rocks set host interface mac dc32-1-9 em4 ec:f4:bb:c7:8c:0d
/opt/rocks/bin/rocks set host interface ip dc32-1-9 em3 10.10.2.119
/opt/rocks/bin/rocks set host interface ip dc32-1-9 em4 192.41.231.119
/opt/rocks/bin/rocks set host interface module dc32-1-9 em1 ixgbe
/opt/rocks/bin/rocks set host interface module dc32-1-9 em2 ixgbe
/opt/rocks/bin/rocks set host interface module dc32-1-9 em3 igb
/opt/rocks/bin/rocks set host interface module dc32-1-9 em4 igb
/opt/rocks/bin/rocks set host interface name dc32-1-9 em3 dc32-1-9
/opt/rocks/bin/rocks set host interface name dc32-1-9 em4 c-1-9
/opt/rocks/bin/rocks set host interface subnet dc32-1-9 em3 private
/opt/rocks/bin/rocks set host interface subnet dc32-1-9 em4 public
/opt/rocks/bin/rocks set host runaction dc32-1-9 action=os
/opt/rocks/bin/rocks set host boot dc32-1-9 action=install

dc32 appliance with dual 10Gb NICs and dual 1Gb NICs (Case 2)

This configuration is for bonded, active-active 10Gb NICs

/opt/rocks/bin/rocks add host dc32-7-15 cpus=32 rack=7 rank=15 membership=Dell-R620 os=linux
/opt/rocks/bin/rocks add host interface dc32-7-15 em1
/opt/rocks/bin/rocks add host interface dc32-7-15 em2
/opt/rocks/bin/rocks add host interface dc32-7-15 em3
/opt/rocks/bin/rocks add host interface dc32-7-15 em4
/opt/rocks/bin/rocks set host installaction dc32-7-15 action=install
/opt/rocks/bin/rocks set host interface mac dc32-7-15 em1 ec:f4:bb:c7:99:88
/opt/rocks/bin/rocks set host interface mac dc32-7-15 em2 ec:f4:bb:c7:99:8a
/opt/rocks/bin/rocks set host interface mac dc32-7-15 em3 ec:f4:bb:c7:99:8c
/opt/rocks/bin/rocks set host interface mac dc32-7-15 em4 ec:f4:bb:c7:99:8d
/opt/rocks/bin/rocks set host interface module dc32-7-15 em1 ixgbe
/opt/rocks/bin/rocks set host interface module dc32-7-15 em2 ixgbe
/opt/rocks/bin/rocks set host interface module dc32-7-15 em3 igb
/opt/rocks/bin/rocks set host interface module dc32-7-15 em4 igb
/opt/rocks/bin/rocks add host bonded dc32-7-15 channel=bond0 interfaces="em1,em2" ip=10.10.2.154 network=private
/opt/rocks/bin/rocks set host interface options dc32-7-15 bond0 options="mode=4 xmit_hash_policy=1"
/opt/rocks/bin/rocks add host interface dc32-7-15 bond0.4001
/opt/rocks/bin/rocks set host interface ip dc32-7-15 bond0.4001 192.41.231.154
/opt/rocks/bin/rocks set host interface name dc32-7-15 bond0.4001 c-7-15
/opt/rocks/bin/rocks set host interface subnet dc32-7-15 bond0.4001 public
/opt/rocks/bin/rocks set host runaction dc32-7-15 action=os
/opt/rocks/bin/rocks set host boot dc32-7-15 action=install

dc32 appliance with Broadcom BCM57800 dual 10Gb NICs and dual 1Gb NICs (Case 3)

These 10Gb NICs are RJ45 from Broadcom, not SFP+ from Intel (82599EB). Action is as for case 2, EXCEPT the Mac addresses increase by a delta of 2 in all cases. For example, the last octet set could be A1, A3, A5 and A7 for em1, em2, em3 and em4. PXE boot will be from em3 as usual.

One other difference, the network driver for all 4 NICs is bnx2x. This is a full example, showing the first R620 of this group that was built.

/opt/rocks/bin/rocks add host dc40-16-22 cpus=40 rack=16 rank=22 membership=Dell-R620 os=linux
/opt/rocks/bin/rocks add host interface dc40-16-22 em1
/opt/rocks/bin/rocks add host interface dc40-16-22 em2
/opt/rocks/bin/rocks add host interface dc40-16-22 em3
/opt/rocks/bin/rocks add host interface dc40-16-22 em4
/opt/rocks/bin/rocks set host installaction dc40-16-22 action=install
/opt/rocks/bin/rocks set host interface mac dc40-16-22 em1 b8:2a:72:cf:79:a1
/opt/rocks/bin/rocks set host interface mac dc40-16-22 em2 b8:2a:72:cf:79:a3
/opt/rocks/bin/rocks set host interface mac dc40-16-22 em3 b8:2a:72:cf:79:a5
/opt/rocks/bin/rocks set host interface mac dc40-16-22 em4 b8:2a:72:cf:79:a7
/opt/rocks/bin/rocks set host interface module dc40-16-22 em1 bnx2x
/opt/rocks/bin/rocks set host interface module dc40-16-22 em2 bnx2x
/opt/rocks/bin/rocks set host interface module dc40-16-22 em3 bnx2x
/opt/rocks/bin/rocks set host interface module dc40-16-22 em4 bnx2x
#
/opt/rocks/bin/rocks add host bonded dc40-16-22 channel=bond0 interfaces="em1,em2" ip=10.10.2.164 network=private
/opt/rocks/bin/rocks set host interface options dc40-16-22 bond0 options="mode=4 xmit_hash_policy=1"
/opt/rocks/bin/rocks add host interface dc40-16-22 bond0.4001
/opt/rocks/bin/rocks set host interface ip dc40-16-22 bond0.4001 192.41.231.164
/opt/rocks/bin/rocks set host interface name dc40-16-22 bond0.4001 c-16-22
/opt/rocks/bin/rocks set host interface subnet dc40-16-22 bond0.4001 public
#
/opt/rocks/bin/rocks set host runaction dc40-16-22 action=os
/opt/rocks/bin/rocks set host boot dc40-16-22 action=install

-- BobBall - 29 Jan 2014