Friday, August 22, 2008

SUN M5000 server

SUN's M500 server has a new management interface card called XSCF -- it's vastly different from the sc interface of the other ilo products.

Here are my notes from setting up our system. Note that ip and MAC addresses are bogus -- I've changed them from my system settings...

rebootxscf
- reboots the xscf system

XSCF> console -d 0
XSCF> showstatus
XSCF> showversion -c xcp -v [shows xcp firmware, version, openboot prom version
XSCF> showenvironment
XSCF> showenvironment temp
XSCF> showenvironment volt
XSCF> showhardconf
XSCF> showdcl -va [check domain id...]
XSCF> showdomainstatus -a
XSCF> showboards -a
XSCF> poweron -a [powers up all domains]
XSCF> poweroff -a [powers off all domains]
XSCF> poweron -d 0 [powers on domain 0]
XSCF> poweroff -d 0 [powers off domain 0]
XSCF> poweroff -f -d 0 [forces a power off domain 0]
XSCF> reset -d 0 por [resets domain 0]
XSCF> reset -d 0 xir [resets domain 0 with XIR reset]
XSCF> sendbreak -d 0 [sends break command to domain 0]
XSCF> setautologout -s 60 [sets autologout to 60 minutes]
XSCF> showautologout
XSCF> shownetwork -a
XSCF> setnetwork xscf#0-lan#0 -m 255.255.255.0 10.10.10.5
XSCF> sethostname xscf#0 fire-xscf
XSCF> sethostname -h host.org
XSCF> setroute -h host.org
XSCF> setnameserver 10.10.10.2 10.10.10.3
XSCF> setroute -c add -n 10.10.10.1 -m 255.255.255.0 xscf#0-lan#0

--------------------

I boot from a SAN, so here are the SAN FC disks:

{8} ok show-disks
a) /pci@2,600000/QLGC,qlc@0,1/fp@0,0/disk
b) /pci@2,600000/QLGC,qlc@0/fp@0,0/disk
q) NO SELECTION
Enter Selection, q to quit:

ok nvalias mydev /pci@2,600000/QLGC,qlc@0,1/fp@0,0/disk

{8} ok show-disks
a) /pci@2,600000/QLGC,qlc@0,1/fp@0,0/disk
b) /pci@2,600000/QLGC,qlc@0/fp@0,0/disk
q) NO SELECTION
Enter Selection, q to quit: b
/pci@2,600000/QLGC,qlc@0/fp@0,0/disk has been selected.
Type ^Y ( Control-Y ) to insert it in the command line.
e.g. ok nvalias mydev ^Y
for creating devalias mydev for /pci@2,600000/QLGC,qlc@0/fp@0,0/disk
{8} ok nvalias mydev /pci@2,600000/QLGC,qlc@0/fp@0,0/disk
{8} ok boot mydev - install
Boot device: /pci@2,600000/QLGC,qlc@0/fp@0,0/disk File and args: - install
QLogic QLE2462 Host Adapter Driver(SPARC): 1.17 03/31/06


-------------------------

Need to make a system snapshot for diagnostic purposes? Use this command:

snapshot -l -v -p xxxxxxxxx -t me@myhost.host.org:/tmp

-----------------

ok> boot mydev - install

ok> watch-net-all

ok> show-nets

XSCF> showhardconf

-----------------------

{8} ok devalias net /pci@3,700000/network@0,1
{8} ok devalias
net /pci@3,700000/network@0,1
san /pci@2,600000/QLGC,qlc@0,1/fp@0,0/disk
name aliases
{8} ok boot net - install
Boot device: /pci@3,700000/network@0,1 File and args: - install
1000 Mbps full duplex Link up
Requesting Internet Address for 0:15:36:3c:b7:65
Requesting Internet Address for
0:15:36:3c:b7:65
Requesting Internet Address for 0:15:36:3c:b7:65
1000 Mbps full duplex Link up
Requesting Internet Address for
0:15:36:3c:b7:65
1000 Mbps full duplex Link up
Requesting Internet Address for
0:15:36:3c:b7:65
Requesting Internet Address for 0:15:36:3c:b7:65

{8} ok nvunalias net
{8} ok nvunalias net1
{8} ok set-defaults
Setting NVRAM parameters to default values.

{8} ok reset-all
Resetting...

{8} ok devalias net /pci@3,700000/network@0
{8} ok boot net - install
Boot device: /pci@3,700000/network@0 File and args: - install
1000 Mbps full duplex Link up
Requesting Internet Address for
0:15:36:3c:b7:65
Requesting Internet Address for 0:15:36:3c:b7:65
Requesting Internet Address for 0:15:36:3c:b7:65
1000 Mbps full duplex Link up
Requesting Internet Address for
0:15:36:3c:b7:65
Requesting Internet Address for 0:15:36:3c:b7:65
Requesting Internet Address for 0:15:36:3c:b7:65
Requesting Internet Address for 0:15:36:3c:b7:65
Requesting Internet Address for 0:15:36:3c:b7:65
Requesting Internet Address for 0:15:36:3c:b7:65

XSCF> sendbreak -d 1
Send break signal to DomainID 1?[y|n] :y
XSCF> reset -d 1 xir
DomainID to reset:01
Continue? [y|n] :y
01 :Reset

*Note*
This command only issues the instruction to reset.
The result of the instruction can be checked by the "showlogs power".

=----------------------

{8} ok cd /pci@3,700000/network@0
{8} ok ./properties
./properties ?
{8} ok .properties
status okay
assigned-addresses
00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000
phy-type mif
board-model 501-7289
version Sun PCI-E 1G Ethernet UTP Adapter FCode 1.10 06/11/02
model SUNW,pcie-northstar
d-fru-len
00000000
d-fru-off 00000000
d-fru-dev eeprom
s-fru-len
00000000
s-fru-off 00000000
s-fru-dev eeprom
compatible pciex8086,105e.108e.125e.6
pciex8086,105e.108e.125e
pciex108e,125e
pciex8086,105e.6
pciex8086,105e
pciexclass,020000
pciexclass,0200
reg
00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000
max-frame-size 00010000
address-bits 00000030
device_type network
name network
local-mac-address
0:15:36:3c:b7:65
fcode-rom-offset 0000e000
interrupts 00000001
cache-line-size 00000010
class-code 00020000
subsystem-id 0000125e
subsystem-vendor-id 0000108e
revision-id 00000006
device-id 0000105e
vendor-id 00008086

{8} ok nvalias net /pci@3,700000/network@0
{8} ok devalias
net /pci@3,700000/network@0
disk /pci@2,600000/QLGC,qlc@0,1/fp@0,0/disk
name aliases

{8} ok boot net - install
Boot device: /pci@3,700000/network@0 File and args: - install
1000 Mbps full duplex Link up
Requesting Internet Address for
0:15:36:3c:b7:65
Requesting Internet Address for 0:15:36:3c:b7:65
Requesting Internet Address for 0:15:36:3c:b7:65
1000 Mbps full duplex Link up
Requesting Internet Address for
0:15:36:3c:b7:65
Requesting Internet Address for 0:15:36:3c:b7:65
1000 Mbps full duplex Link up
1000 Mbps full duplex Link up

Requesting Internet address for
0:15:36:3c:b7:65
SunOS Release 5.10 Version Generic_120011-14 64-bit
Copyright 1983-2007 Sun Microsystems, Inc. All rights reserved.
Use is subject to license terms.



------------
Need to turn off the IP filter firewall?

# svcs | grep ip
online Nov_21 svc:/network/ipfilter:default
# svcadm disable ipfilter
# svcs | grep ip

---------------

added 2 additional memory boards:

XSCF> addboard -c assign -d 0 00-2
XSCF> addboard -c assign -d 1 00-3

XSCF> showboards -va

-----------------

To disable secure mode in the console (which disables the break command):

XSCF> setdomainmode -d 0 -m secure=off
Diagnostic Level :min -> -
Secure Mode :on -> off
Autoboot :on -> -
The specified modes will be changed.
Continue? [y|n] :y
configured.
Diagnostic Level :min
Secure Mode :off (host watchdog: unavailable Break-signal:receive)
Autoboot :on (autoboot:on)

XSCF> sendbreak -y -d 0
Send break signal to DomainID 0?[y|n] :y

System now sits at the OK prompt:

Type 'go' to resume
{0} ok boot cdrom
Resetting...
POST Sequence 01
[.]
POST Sequence Complete.

Sun SPARC Enterprise M4000 Server, using Domain console
Copyright 2007 Sun Microsystems, Inc. All rights reserved.
Copyright 2007 Sun Microsystems, Inc. and Fujitsu Limited. All rights reserved.
OpenBoot 4.24.4, 32768 MB memory installed, Serial #3333333.
Ethernet address
0:15:36:3c:b7:65, Host ID: 99999999.

Rebooting with command: boot cdrom
Boot device: /pci@0,600000/pci@0/pci@8/pci@0/scsi@1/disk@3,0:f File and args:
SunOS Release 5.10 Version Generic_120011-14 64-bit
Copyright 1983-2007 Sun Microsystems, Inc. All rights reserved.
Use is subject to license terms.
[.]

1 comment:

Anonymous said...

Very helpful thanks. Especially reenabling the break with :

setdomainmode -d 0 -m secure-on

Many of these commands you have listed here are barely documented by Fujitsu and.or Sun. At the very least any docs are hard to find.