Skip to main content
  1. Home >
  2. Products >
  3. Computing Products >
  4. Servers >
  5. Fujitsu SPARC servers >
  6. Downloads >
  7. User Manuals >
  8. Fujitsu M10-4S/SPARC M10-4S Installation Guide >
  9. 9.2.1 Adding the server while the target physical partition (PPAR) is operating

9.2.1 Adding the server while the target physical partition (PPAR) is operating


9.2.1 Adding the server while the target physical partition (PPAR) is operating
This section describes the SPARC M10-4S addition procedure for expanding from the 1BB configuration to the 2BB configuration while the target physical partition (PPAR) and the control domain are operating. To perform maintenance while the physical partition (PPAR) is operating, use dynamic reconfiguration (DR) for the physical partition.
For the software requirements required for this operation, see the latest Product Notes.
For details on the XSCF commands executed in each step, see the Fujitsu SPARC M12 and Fujitsu M10/SPARC M10 XSCF Reference Manual.
For details on the addition procedure for expanding from the 1BB configuration to the 2BB configuration, see also "A.4 For Expansion of a Newly Installed System of Version XCP 2220 or Later from the 1BB to 2BB Configuration" in the Fujitsu SPARC M12 and Fujitsu M10/SPARC M10 Domain Configuration Guide.
  1. Log in to the master XSCF.
    Execute the showbbstatus command to confirm that the XSCF to which you have logged in is the master XSCF.
    If it is a standby XSCF, retry to log in to the master XSCF.
XSCF> showbbstatus
BB#00 (Master)
  1. Execute the showsscp command to check whether the IP address of the SP to SP communication protocol (SSCP) is a default value or a value set by a user.
XSCF> showsscp
Note - For the default values of SSCP IP addresses, see "3.9.5 Understanding the IP Addresses that are Set with SSCP" in the Fujitsu SPARC M12 and Fujitsu M10/SPARC M10 System Operation and Administration Guide.
  1. If the IP address is a default value and the default value should also be used for the IP address of the SPARC M10-4S to be added, go to the next step.
    To set a user value, use the setsscp command to set an IP address, use the applynetwork command to apply the SSCP IP address of the target SPARC M10-4S, and confirm that it was reflected. Then, execute the rebootxscf command to complete settings, and go to the next step. For details on the procedure, see "7.5.6 Applying network settings."
  1. Check the number of CPU Activations registered in the entire system.
    If the number of CPU Activations registered in the system becomes short compared to the number of added CPU cores, purchase a CPU Activation key and execute the addcodactivation command to add the key to the system.
    The following example displays the CPU Activations in the system that are already fully used.
XSCF> showcodusage -p resource
Resource In Use Installed CoD Permitted Status
-------- ------ --------- ------------- ------

PROC 64 64 64 OK
  1. For details on adding a CPU Activation key, see "7.11.3 Registering a CPU Activation key."
  1. Add the SPARC M10-4S.
    a. Execute the addfru command, and add the SPARC M10-4S by following the messages.
Note - If no SSCP IP address is set, an error occurs.
Note - The addfru command cannot specify multiple chassis. Add one chassis at a time.
Note - When the addfru command is executed, the firmware of the building block to be added is automatically matched to the version of the firmware of the building block in which the master XSCF is operating. It is recommended that you update the XCP of the master XSCF to the latest version beforehand.
  1. The following example adds BB#1.
XSCF> addfru
-----------------------------------------------------------------------

Maintenance/Addition Menu
Please select the chassis including added FRU.

No. FRU Status
--- ------------------- --------------

1 /BB#0 Normal
2 /BB#1 Unmount
3 /BB#2 Unmount
4 /BB#3 Unmount
-----------------------------------------------------------------------

Select [1-16|c:cancel] :2

Maintenance/Addition Menu
Please select the BB or a type of FRU to be added.

1. BB itself

2. PSU (Power Supply Unit)

-----------------------------------------------------------------------

Select [1,2|c:cancel] :1

Maintenance/Addition Menu
Please select a FRU to be added.

No. FRU Status
--- ------------------- --------------

1 /BB#1 Unmount
-----------------------------------------------------------------------

Select [1|b:back] :1
You are about to add BB#1.
Do you want to continue?[a:add|c:cancel] :a
Please execute the following steps:
1) After the added device is connected with the system,
please turn on the breaker of the BB#1.
2) Please select[f:finish] :
  1. b. Mount the target SPARC M10-4S in the rack.

    Mount the target SPARC M10-4S in the rack when the above message, "1) After the added device is connected with the system, please turn on the breaker of the BB#1.", appears during command execution.

    For the mounting procedure, see "3.4.1 Mounting the SPARC M10-4S in a rack."
Remarks - When adding the SPARC M10-4S in an existing expansion rack, you need to remove the protection bracket and blank panel of the mounting space (A in Figure 9-1). The blank panel is secured with two M6 screws. The protection bracket is secured with four M6 screws.
Store the removed blank panel and M6 screws for future use when the SPARC M10-4S is removed. After adding the SPARC M10-4S, install the protection bracket and M6 screws at their original locations, for future use when the expansion rack is moved.
Figure 9-1  Protection bracket
Figure 9-1  Protection bracket
  1. c. Set the ID of the target SPARC M10-4S.

  1. d. Connect the additional crossbar cables.

    For a cable routing diagram of connections and a cable list, see "Appendix B Cable Connection Information on Building Block Configurations."

    For details on the connections in direct connections between chassis, see "4.2 Connecting Cables (for Direct Connections between Chassis)."
  1. e. Connect the additional XSCF BB control cables.

    For a cable routing diagram of connections and a cable list, see "Appendix B Cable Connection Information on Building Block Configurations."

    For details on the connections in direct connections between chassis, see "4.2 Connecting Cables (for Direct Connections between Chassis)."
  1. f. The addition expands the 1BB configuration to a multiple BB configuration. So, connect the XSCF DUAL control cable.

    Connect the XSCF DUAL cable from the XSCF DUAL control port of BB#00 to the XSCF DUAL control port of BB#01.
  1. g. Connect LAN cables to the target SPARC M10-4S.

  1. h. Connect the power cords of the target SPARC M10-4S to the input power supply.
  1. i. Enter [f] from the command execution screen of the master XSCF.
2) Please select[f:finish] :f

Waiting for BB#1 to enter install state.
[This operation may take up to 20 minute(s)]
(progress scale reported in seconds)
0..... 30.... done

Waiting for BB#1 to enter ready state.
[This operation may take up to 45 minute(s)]
(progress scale reported in seconds)
0..... 30..... 60... done

Do you want to start to diagnose BB#2?[s:start|c:cancel] :
  1. j. Skip the diagnosis of the building block to be added, and then end the addfru command.

    Enter [c] from the input screen of the addfru command of the master XSCF to skip the diagnosis processing for the BB to be added.

    When "The addition of BB#1 has completed." is output, enter [f] and then [c] at the end to end the addfru command.
Do you want to start to diagnose BB#1?[s:start|c:cancel] :c

Diagnostic tests are about to be skipped.
Running diagnostic tests are strongly recommended before using
BB#1.
Are you sure you want to skip testing?[y:yes|n:no] :y

------------------------------------------------------------------------------

Maintenance/Addition Menu
Status of the added FRU.

FRU Status
------------------- --------------

/BB#1 Normal
------------------------------------------------------------------------------

[Warning:007]
Running diagnostic tests on BB#1 is strongly recommended
after addfru has completed.
The addition of BB#2 has completed.[f:finish] :f

------------------------------------------------------------------------------

Maintenance/Addition Menu
Please select the chassis including added FRU.
No. FRU Status
--- ------------------- --------------

1 /BB#0 Normal
2 /BB#1 Normal
3 /BB#2 Unmount
4 /BB#3 Unmount
------------------------------------------------------------------------------

Select [1,2|c:cancel] :c
  1. Diagnose the added SPARC M10-4S.
    a. Execute the testsb command to perform a diagnosis test.

    Specify the PSB number of the diagnosis target PSB in XX-Y. XX is a BB-ID, and Y is fixed at 0.

    An initial diagnosis and connection I/O check are performed on the diagnosis target PSB.

    <‌Description of options specified>‌

    -v: Additionally displays detailed messages of the initial diagnosis

    -p: Executes the "probe-scsi-all" command of OpenBoot PROM and displays the results while a diagnosis is being processed

    -s: Executes the "show-devs" command of OpenBoot PROM and displays the results while a diagnosis is being processed

    -y: Automatically responds with "y" to a query
XSCF> testsb -v -p -s -y XX-Y
  1. The following example performs a diagnosis test on the added BB#01.
XSCF> testsb -v -p -s -y 01-0
Initial diagnosis is about to start, Continue?[y|n] :y
PSB#01-0 power on sequence started.
  1. If an error is displayed, see "A.2.4 Checking diagnosis results."
  1. b. From the master XSCF, check the cables between the added chassis and the physical partition that is the incorporation destination.

    Execute the diagxbu command to check the cables.

    Specify the BB-ID of the added BB in XX. Specify the PPAR-ID of the incorporation destination in YY.
XSCF> diagxbu -y -b xx -p yy
  1. The following example performs a diagnosis between the added BB#01 and incorporation-destination PPAR#0.
XSCF> diagxbu -y -b 01 -p 00
XBU diagnosis is about to start, Continue?[y|n] :y
Power on sequence started. [7200sec]
0..... 30..... 60..end
XBU diagnosis started. [7200sec]
0..... 30..... 60..... 90.....120.....150.....180.....210.....240...../
270.....300.....330.....360.....390.....420.....450.....480.....510.....\

540.....570.....600.....630.....660.....690.....720.....750.....780.....\

810.....840.....870.....900.....930...end

completed.
Power off sequence started. [1200sec]
0..... 30..... 60..... 90.....120.....150.....180.end
completed.
  1. c. Execute the showlogs error command, and confirm that no error is displayed.
XSCF> showlogs error
  1. If an error is displayed, see "A.2.2 Checking the contents of logs."
  1. d. Execute the showhardconf command to check the configuration, status, and quantities.

  1. The addition expands the 1BB configuration to a multiple-BB configuration. So, configure the XSCF network.
    For details, see "7.5.2 Setting an Ethernet (XSCF-LAN) IP address" and "7.5.3 Setting a takeover IP address."
    After configuration, execute the applynetwork command to apply the settings, and confirm that they were reflected. Then, execute the rebootxscf command to complete settings, and go to the next step.  For details on the procedure, see "7.5.6 Applying network settings."
  2. To configure memory mirroring for the added SPARC M10-4S, set memory mirror mode.
    For details, see "7.6 Configuring Memory Mirroring."
    If you do not use memory mirror mode, this step is not necessary.
  1. Register the system board of the added SPARC M10-4S in the physical partition configuration list.
    a. Execute the showpcl command to check the physical partition configuration list.
XSCF> showpcl -p 0
PPAR-ID LSB PSB Status
00 Running
00 00-0
  1. b. Execute the setpcl command to register a system board in the physical partition configuration list.

    Execute the setpcl command to register the system board of the added SPARC M10-4S in the physical partition configuration list for the incorporation destination.

    The following example associates physical system board (PSB) 01-0 with logical system board (LSB) 01 of physical partition 0.
XSCF> setpcl -p 0 -a 01=01-0
  1. c. Execute the showpcl command, and confirm the set physical partition configuration list.
XSCF> showpcl -p 0
PPAR-ID LSB PSB Status
00 Running
00 00-0
01 01-0
  1. Set the number of CPU Activations in the physical partition, and add CPU core resources.
    a. Execute the showcodusage command to display the CPU Activation information.

    The following example displays the CPU Activation information. As shown, the number of CPU Activations registered in the entire system is 128, 64 CPU core resources are in use, and 64 CPU Activations are currently not in use.
XSCF> showcodusage -p resource
Resource In Use Installed CoD Permitted Status
-------- ------ --------- ------------- ------

PROC 64 128 128 OK: 64 cores available
Note - If the number of CPU Activations registered in the system is insufficient for the number of CPU cores to be used, request the customer to purchase CPU Activations to add CPU Activation keys. For details on adding a CPU Activation key, see "7.11.3 Registering a CPU Activation key."
  1. b. Execute the showcod command to check the CPU Activation information set for the physical partition.
XSCF> showcod -p 0
PROC Permits assigned for PPAR 0: 64
  1. c. If the assigned resources are insufficient, execute the setcod command to assign CPU core resources to the physical partition.

    The following example adds 64 CPU core resources to physical partition 0.
XSCF> setcod -p 0 -s cpu -c add 64
PROC Permits assigned for PPAR 0 : 64 -> 128

PROC Permits assigned for PPAR will be changed.
Continue? [y|n] :y

Completed.
Note - The -c add, -c delete, and -c set options are not supported if the XSCF firmware is XCP 2250 or earlier. Specify the option of the setcod command as shown below to add or delete interactively.
XSCF> setcod -s cpu
  1. d. Execute the showcod command again to check the CPU Activation information set for the physical partition.
XSCF> showcod -p 0
PROC Permits assigned for PPAR 0: 128
  1. Check the operation status of logical domains.
    a. Connect to the control domain console of the physical partition, and then log in.
XSCF> console -p 0
  1. b. Execute the ldm list-domain command to check the operation status of the logical domains.

    Check the operation status of the logical domains through the combination of [STATE] and [FLAGS]. When [STATE] is "active," the second character from the left of the string in [FLAGS] has one of the following meanings:

    "n": Oracle Solaris operating

    "t": OpenBoot PROM state

    "-": Another state (including cases in which STATE is not active)


    In the following example, you can see that the control domain, one guest domain, and one root domain are operating.
# ldm list-domain
NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME
primary active -n-cv- UART 32 28G 0.0% 2h 3m
guest0 active -n---- 5100 64 64G 3.1% 33m
root-dom0 active -n--v- 5000 32 32G 3.1% 47m
  1. Incorporate the system board of the added SPARC M10-4S into the physical partition.
Note - Suppose you add the added SPARC M10-4S together with a PCI expansion unit connected to it and enable/disable the direct I/O function of the PCI expansion unit. In this case, execute the setpciboxdio command to enable/disable it before executing the addboard command for incorporation in the physical partition. When you have changed the setting of the direct I/O function, do not restart the logical domains until you execute the ldm add-spconfig command to save the logical domain configuration in XSCF.
Note - Pull out all the PCIe cassettes with the PCIe card for the PCI expansion unit to be installed. After incorporating the link card into the server, attach the pulled-out PCIe cassette to the PCI expansion unit. Then, install the PCIe card of the PCI expansion unit on the server by using PHP.
  1. a. Return to the XSCF shell, execute the showboards command, and check the system board (PSB) status.

    In the following example, system board 01-0 is in the system board pool.
XSCF> showboards -p 0
PSB PPAR-ID(LSB) Assignment Pwr Conn Conf Test Fault
---- ------------ ----------- ---- ---- ---- ------- --------

00-0 00(00) Assigned y y y Passed Normal
01-0 SP Available n n n Passed Normal
  1. b. Execute the addboard -c configure command to incorporate the system board (PSB) into the physical partition.

    The following example incorporates system board 01-0 into physical partition 0.
XSCF> addboard -c configure -p 0 01-0
PSB#01-0 will be configured into PPAR-ID 0. Continue?[y|n] :y
Start connecting PSB to PPAR. [3600sec]
0..... 30..... 60..... 90.....120.....150.....180.....210.....240.....
270.....300.....330.....360.....390.....420.....450.....480.....510.....

540.....570.....600.....630.....660.....690.....720.....750.....780.....

810.....840.....870.....900.....930.....960.....end

Connected PSB to PPAR.
Start configuring PSB to Logical Domains (LDoms) Manager. [1800sec]
0.....end

Configured PSB to Logical Domains (LDoms) Manager.
Operation has completed.
Note - Incorporation of a system board (PSB) with the addboard command also incorporates the targeted hardware resources on the system board (PSB) into the physical partition after a hardware diagnosis is performed. Therefore, command execution may take some time to complete.
  1. c. Execute the showresult command to confirm the end status of the previously executed addboard command.

    In the following example, 0 is returned as the end status, so the execution of the addboard command has completed correctly.
XSCF> showresult
0
  1. d. Execute the showboards command to check the system board (PSB) status.

    Confirm that the added system board (PSB) is in the "Assigned" state and "y" is displayed for all of the [Pwr], [Conn], and [Conf] columns.

    In the following example, since both the [Conn] and [Conf] fields display "y" for system board 01-0, the system board (PSB) has been added correctly.
XSCF> showboards -p 0
PSB PPAR-ID(LSB) Assignment Pwr Conn Conf Test Fault
---- ------------ ----------- ---- ---- ---- ------- --------

00-0 00(00) Assigned y y y Passed Normal
01-0 00(01) Assigned y y y Passed Normal
  1. Check the operation status of logical domains.
    a. Execute the console command to connect to the console of the control domain, and then log in.
XSCF> console -p 0
  1. b. Execute the ldm list-domain command, and confirm that the operation status of the logical domains has not changed after the system board (PSB) addition.

    Check the operation status of the logical domains through the combination of [STATE] and [FLAGS]. When [STATE] is "active," the second character from the left of the string in [FLAGS] has one of the following meanings:

    "n": Oracle Solaris operating

    "t": OpenBoot PROM state

    "-": Another state (including cases in which STATE is not active)
# ldm list-domain
NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME
primary active -n-cv- UART 32 28G 0.0% 2h 3m
guest0 active -n---- 5100 64 64G 3.1% 33m
root-dom0 active -n--v- 5000 32 32G 3.1% 47m
  1. Reconfigure the logical domains.
    Assign the resources of the added SPARC M10-4S to an existing logical domain or a newly configured logical domain. For details, see the Fujitsu SPARC M12 and Fujitsu M10/SPARC M10 Domain Configuration Guide.
    After the reconfiguration, execute the ldm add-spconfig command to save the logical domain configuration in the XSCF.