Skip to main content

Contents

  1. Preface
  2. Chapter 1 Before Starting Maintenance Work
    1.  1.1 Warning/Caution Indications
    2.  1.2 Warning Labels
    3.  1.3 Labels/Tags
    4.  1.4 Safety Precautions
    5.  1.5 Precautions on Static Electricity
    6.  1.6 Other Precautions
    7.  1.7 Emergency Power Off
  3. Chapter 2 Understanding the System Components
    1.  2.1 Identifying the Names and Locations of Components
    2. Click 2.2 Checking the Memory Configuration Rules
    3. Click 2.3 Confirming the Functions of the Operation Panel
    4. Click 2.4 Checking the LED Indications
    5. Click 2.5 Confirming the Types of Cable
  4. Chapter 3 Types of Maintenance
    1.  3.1 Types of Maintenance Supported in the SPARC M10-4/M10-4S
    2.  3.2 Active Maintenance
    3.  3.3 Inactive Maintenance
    4.  3.4 System-stopped Maintenance
  5. Chapter 4 Preparation and Precautions for Maintenance
    1. Click 4.1 Confirming the System Configuration
    2. Click 4.2 Troubleshooting
    3. Click 4.3 Maintenance Precautions
  6. Chapter 5 Preparations Required for Maintenance
    1.  5.1 Preparing Tools Required for Maintenance
    2.  5.2 Switching the Mode Switch to Service Mode
    3. Click 5.3 Checking the Operating Condition and Resource Usage Status
    4. Click 5.4 Preparations for Enabling Active Maintenance
    5.  5.5 Powering Off the Physical Partition Requiring Maintenance
    6. Click 5.6 Stopping the Entire System
    7.  5.7 Saving XSCF Setting Information
    8. Click 5.8 Releasing a SPARC M10-4/M10-4S FRU from the System with the replacefru Command
    9. Click 5.9 Accessing a FRU
  7. Chapter 6 Restoring the System
    1. Click 6.1 Restoring the Chassis
    2. Click 6.2 Incorporating a SPARC M10-4/M10-4S FRU into the System with the replacefru Command
    3. Click 6.3 Diagnosing a Replacement FRU
    4.  6.4 Restoring XSCF Setting Information
    5. Click 6.5 Incorporating a Chassis and I/O Device into a Physical Partition
    6.  6.6 Returning the Mode Switch to Locked Mode
    7.  6.7 Powering On the Physical Partition Requiring Maintenance
    8. Click 6.8 Starting the Entire System
  8. Chapter 7 Maintenance Flow
    1.  7.1 Maintenance Workflow
    2. Click 7.2 FRU Replacement Workflow
    3. Click 7.3 FRU Installation Workflow
    4. Click 7.4 FRU Removal Workflow
  9. Chapter 8 Maintaining the PCI Express Cards
    1.  8.1 Before Maintaining a PCI Express Card
    2.  8.2 PCI Express Card Configuration
    3.  8.3 FRU Removal and Installation Flow
    4. Click 8.4 Removing a PCI Express Card
    5. Click 8.5 Installing a PCI Express Card
  10. Chapter 9 Maintaining the CPU Memory Unit/Memory
    1.  9.1 Before Maintaining a CPU Memory Unit/Memory
    2. Click 9.2 Configuration of the CPU Memory Unit and Memory
    3.  9.3 Maintenance Precautions
    4.  9.4 FRU Removal and Installation Flow
    5. Click 9.5 Removing a CPU Memory Unit
    6.  9.6 Installing a PCI Express Cable
    7.  9.7 Switching the microSD Card
    8.  9.8 Removing Memory
    9.  9.9 Installing Memory
    10. Click 9.10 Installing a CPU Memory Unit
    11.  9.11 Checking the XCP Firmware Version
    12.  9.12 Checking the XCP Firmware Version (Building Block Configuration)
  11. Chapter 10 Maintaining the Internal Disks
    1.  10.1 Before Maintaining an Internal Disk
    2.  10.2 Configuration of the Internal Disks
    3.  10.3 FRU Removal and Installation Flow
    4.  10.4 Removing an Internal Disk
    5.  10.5 Installing an Internal Disk
  12. Chapter 11 Maintaining the Fan Units
    1.  11.1 Before Maintaining a Fan Unit
    2.  11.2 Configuration of the Fan Units
    3.  11.3 Removing a Fan Unit
    4.  11.4 Installing a Fan Unit
  13. Chapter 12 Maintaining the Power Supply Units
    1.  12.1 Before Maintaining a Power Supply Unit
    2.  12.2 Configuration of the Power Supply Units
    3.  12.3 Removing a Power Supply Unit
    4.  12.4 Installing a Power Supply Unit
  14. Chapter 13 Maintaining the PSU Backplane Unit/Operation Panel
    1.  13.1 Before Maintaining the PSU Backplane Unit/Operation Panel
    2.  13.2 Locations of the PSU Backplane Unit and Operation Panel
    3.  13.3 Maintenance Precautions
    4.  13.4 FRU Removal and Installation Flow
    5. Click 13.5 Removing the PSU Backplane Unit/Operation Panel
    6. Click 13.6 Installing the PSU Backplane Unit/Operation Panel
  15. Chapter 14 Maintaining the Crossbar Cables
    1.  14.1 Before Maintaining a Crossbar Cable
    2.  14.2 Configuration of the Crossbar Cable Connection Ports
    3.  14.3 Removing the Crossbar Cables
    4.  14.4 Installing the Crossbar Cables
  16. Chapter 15 Maintaining the Crossbar Units
    1.  15.1 Before Maintaining a Crossbar Unit
    2.  15.2 Configuration of the Crossbar Units
    3.  15.3 Removing a Crossbar Unit
    4.  15.4 Installing a Crossbar Unit
  17. Chapter 16 Maintaining the XSCF BB Control Cables
    1.  16.1 Before Maintaining an XSCF BB Control Cable
    2.  16.2 Configuration of the XSCF BB Control Ports
    3.  16.3 Removing an XSCF BB Control Cable
    4.  16.4 Installing an XSCF BB Control Cable
  18. Chapter 17 Maintaining the XSCF DUAL Control Cables
    1.  17.1 Before Maintaining an XSCF DUAL Control Cable
    2.  17.2 Configuration of the XSCF DUAL Control Ports
    3.  17.3 Removing an XSCF DUAL Control Cable
    4.  17.4 Installing an XSCF DUAL Control Cable
  19. Appendix A Component List
  20. Appendix B Component Specifications
    1.  B.1 CPU Memory Unit
    2.  B.2 Crossbar Unit
    3.  B.3 Power Supply Unit
    4.  B.4 Fan Unit
    5.  B.5 Internal Disk Drive
    6.  B.6 PCI Express Card
    7.  B.7 Backplanes
    8.  B.8 Operation Panel
  21. Appendix C Oracle Solaris Troubleshooting Commands
    1.  C.1 iostat Command
    2.  C.2 prtdiag Command
    3.  C.3 prtconf Command
    4.  C.4 netstat Command
    5.  C.5 ping Command
    6.  C.6 ps Command
    7.  C.7 prstat Command
  22. Appendix D External Interface Specifications
    1. Click D.1 Serial Port
    2.  D.2 USB Port
    3.  D.3 SAS Port
    4.  D.4 RESET Switch
  23. Appendix E Removing the Lithium Battery
    1.  E.1 Location of the Lithium Battery
    2.  E.2 Removing the Lithium Battery

6.5.3 Restoring a logical domain to the pre-maintenance state


6.5.3 Restoring a logical domain to the pre-maintenance state
This section describes the flow of work in restoring a logical domain after FRU maintenance to the pre-maintenance state. For details on the work and the commands used, see "3.2 Operations and Commands Related to Logical Domain Configurations" in the Fujitsu SPARC M12 and Fujitsu M10/SPARC M10 Domain Configuration Guide and the Oracle VM Server for SPARC Reference Manual for the version you are using.
Note - If you have replaced the CPU memory unit lower in a system that has internal disks in a hardware RAID configuration, you need to reactivate the hardware RAID volume. For details, see "14.2.11 Re-enabling a Hardware RAID Volume" in the Fujitsu SPARC M12 and Fujitsu M10/SPARC M10 System Operation and Administration Guide.
The following procedure returns a logical domain to the state in the ldm list-io output results that were checked in step 4 in "5.3.2 Checking the assignment status of I/O devices."
Returning the root complex to the control domain
Return the root complex that was released from the control domain to the control domain.
The work procedure varies depending on whether the dynamic reconfiguration function (Dynamic PCIe bus assignment) for the root complex is used. For details, see Table 6-1.
Table 6-1  Procedure that depends on whether the dynamic reconfiguration function (Dynamic PCIe bus assignment) for the root complex is used
-: Unnecessary
Item Task Command Dynamic reconfiguration function used (*1) Dynamic reconfiguration function not used (*2)
1 Set the control domain to delayed reconfiguration. ldm start-reconf - Yes
2 Assign the physical I/O device to the control domain. ldm add-io Yes Yes
3 Restart the control domain. shutdown -i6 -g0 -y - Yes
*1 Dynamic reconfiguration of the root complex is supported by XCP 2240 or later and Oracle VM Server for SPARC 3.2 or later. In addition, the control domain must be Oracle Solaris 11.2 SRU11.2.8 or later.
*2 If dynamic reconfiguration of the root complex is not used, set the control domain to delayed reconfiguration, and then assign the physical I/O device.
  1. Log in to Oracle Solaris on the control domain of the physical partition.
  2. Transition the control domain to delayed reconfiguration mode.
    If you are dynamically reconfiguring the root complex, this step is unnecessary. Go to step 3.
# ldm start-reconf <control domain name>
  1. Reassign the physical I/O device to the control domain.
# ldm add-io <physical I/O device name> <control domain name>
  1. Restart Oracle Solaris on the control domain.
    If you are dynamically reconfiguring the root complex, this step is unnecessary.
# shutdown -i6 -g0 -y
Note - When set to delayed reconfiguration mode, the control domain does not have control over the guest domains. If you have set the control domain to delayed reconfiguration mode, restart the control domain as soon as possible.
Returning the root complex to the root domain
Return the physical I/O device (root complex) that was released from the root domain to the root domain.
The work procedure varies depending on whether the dynamic reconfiguration function (Dynamic PCIe bus assignment) for the root complex is used. For details, see Table 6-2.
Table 6-2  Procedure that depends on whether the dynamic reconfiguration function (Dynamic PCIe bus assignment) for the root complex is used
-: Unnecessary
Item Task Command Dynamic reconfiguration function used (*1) Dynamic reconfiguration function not used (*2)
1 Assign the physical I/O device (root complex) to the root domain. ldm add-io Yes Yes
2 Start the root domain. ldm start-domain - Yes
*1 Dynamic reconfiguration of the root complex is supported by XCP 2240 or later and Oracle VM Server for SPARC 3.2 or later. In addition, the root domain must be Oracle Solaris 11.2 SRU11.2.8 or later.
*2 If dynamic reconfiguration of the root complex is not used, assign the physical I/O device (root complex), and then start the root domain.
  1. Reassign the I/O device (PCIe root complex) released from the root domain to the root domain.
# ldm add-io <physical I/O device name> <root domain name>
  1. Start the root domain.
    If you are dynamically reconfiguring the root complex, this step is unnecessary.
# ldm start-domain <root domain name>
Returning the physical I/O device to the I/O domain
If you released the I/O device assigned to an I/O domain before maintenance according to "When using virtual I/O" in "5.4.1 Releasing the assignment of I/O devices," restore the physical I/O device (PCIe end point device) to its original status.
PCIe slots are automatically assigned to the root domain. Therefore, to reassign them to I/O domains, they must be released from the root domain and then reassigned.
The work procedure varies depending on whether the dynamic reconfiguration function for the PCIe end point device is used. For details, see Table 6-3.
Table 6-3  Procedure that depends on whether the dynamic reconfiguration function for the PCIe end point device is used
-: Unnecessary
Item Task Command Dynamic reconfiguration function used (*1) Dynamic reconfiguration function not used
1 Enable the hotplug service. svcadm enable hotplug Yes Yes (*2)
2 Set the root domain to delayed reconfiguration. ldm start-reconf - Yes
3 Delete the physical IO from the root domain. ldm remove-io Yes Yes
4 Restart the root domain. shutdown -i6 -g0 -y - Yes
5 Assign physical I/O to the root domain. ldm add-io Yes Yes
6 Start the I/O domain. ldm start-domain - Yes
7 Disable the hotplug service. svcadm disable hotplug Yes Yes (*2)
*1 Dynamic reconfiguration of the PCIe end point device is supported by XCP 2230 or later and Oracle VM Server for SPARC 3.1.1.1 or later.
*2 If dynamic reconfiguration of the PCIe end point device is not used, the hotplug service operates regardless of its enable/disable setting.
  1. If the hotplug service is disabled for the I/O and root domains, execute the svcadm enable command to enable the hotplug service.
# svcadm enable hotplug
  1. Transition the root domain to delayed reconfiguration mode.
    If you are using the dynamic reconfiguration function for the PCIe end point device, this step is unnecessary. Go to step 5.
# ldm start-reconf <root domain name>
  1. Delete the physical I/O device from the root domain.
# ldm remove-io <device name> <root domain name>
  1. Log in to the root domain, and restart Oracle Solaris on the root domain.
    If you are using the dynamic reconfiguration function for the PCIe end point device, this step is unnecessary. Go to step 5.
# telnet localhost <port number>
...
# shutdown -i6 -g0 -y
  1. Assign the physical I/O device to the I/O domain.
# ldm add-io <device name> <I/O domain name>
  1. Start the I/O domain.
    If you are using the dynamic reconfiguration function for the PCIe end point device, this step is unnecessary. Go to step 7.
# ldm start <I/O domain name>
  1. If you need to disable the hotplug service for the I/O and root domains, disable the hotplug service.
# svcadm disable hotplug
Restoring the SR-IOV function
Suppose that the SR-IOV function was used to delete and discard a virtual function (VF) before maintenance, according to "When using the SR-IOV virtual function" in "5.4.1 Releasing the assignment of I/O devices." In this case, create the virtual function again and assign it to the domain based on the retained output results from the idm list-io command.
The work procedure differs between the dynamic SR-IOV function and the static SR-IOV function. For details, see Table 6-4.
Table 6-4  Procedure that depends on the function: dynamic SR-IOV function or static SR-IOV function
-: Unnecessary
Item Task Command Dynamic SR-IOV function used (*1) Static SR-IOV function used
1 Enable the hotplug service. svcadm enable hotplug Yes Yes (*2)
2 Set the PF root domain to delayed reconfiguration. ldm start-reconf - Yes
3 Create a VF. ldm create-vf Yes Yes
4 Assign the VF to the I/O domain. ldm add-io Yes Yes
5 Restart the root domain. shutdown -i6 -g0 -y - Yes
6 Start the I/O domain. start-domain - Yes
7 Disable the hotplug service. svcadm disable hotplug Yes Yes (*2)
*1 Dynamic reconfiguration for the SR-IOV virtual function is supported by XCP 2210 or later and Oracle VM Server for SPARC 3.1 or later.
*2 If static reconfiguration for the SR-IOV virtual function is used, the hotplug service operates regardless of its enable/disable setting.
  1. If the hotplug service is disabled for the I/O and root domains, execute the svcadm enable command to enable the hotplug service.
# svcadm enable hotplug
  1. Transition the root domain that has the assigned physical function (PF) to delayed reconfiguration mode.
    If the dynamic SR-IOV function is used, this step is unnecessary. Go to step 3.
# ldm start-reconf <root domain name>
  1. Create the virtual function.
# ldm create-vf <PF name>
  1. Assign the virtual function (VF) to the I/O domain.
# ldm add-io <VF name> <I/O domain name>
  1. Log in to the root domain, and restart Oracle Solaris.
    If the dynamic SR-IOV function is used, this step is unnecessary. Go to step 7.
# telnet localhost <port name>
...
# shutdown -i6 -g0 -y
  1. Start the I/O domain.
# ldm start <I/O domain name>
  1. If you need to disable the hotplug service for the I/O and root domains, disable the hotplug service.
# svcadm disable hotplug
  1. If a virtual device of a guest domain has been kept unused or the redundant configuration was released in "5.4.1 Releasing the assignment of I/O devices," resume the use of the virtual device or set the redundant configuration again.
    For details on the work, see the manual for the application being used.
  2. Confirm that the status of the physical I/O device is the same as before maintenance.
# ldm list-io
  1. Confirm that the operating condition of the logical domain remains unchanged.
# ldm list-domain
Restoring a virtual device
If a virtual device (vnet, vdisk) of a guest domain has been kept unused before maintenance, return it to its original status.
  1. If a virtual device of a guest domain has been kept unused or the redundant configuration was released, resume the use of the virtual device or set the redundant configuration again.
    For details on the work, see the manual for the application being used.
  1. The following is a command execution example for configuring the virtual disk (vdisk11) and virtual network device (vnet10) in a logical domain.
# ldm add-vdisk vdisk11 guest0
# ldm add-vnet vnet10 guest0
  1. Confirm that the status of the virtual device is the same as before maintenance.
# ldm list-domain -l
  1. Confirm that the operating condition of the logical domain remains unchanged.
# ldm list-domain

Top of Page