QuickSpec Changes

HP TruCluster Server V5.1A


September 4, 2003 - From Version 16 to 17
Changed
Document was put into the new format.
March 24, 2003 - From Version 15 to 16
Changed
Significant changes occurred throughout the entire document.
April 4, 2002 - From Version 14 to 15
Changed
Features –TruCluster Server V5.1A
Support for Memory Channel API
Note to users of the Memory Channel application programming interface (MC API) with Memory Channel virtual hub (vhub) configuration:

The Memory Channel API is not supported for data transfers larger than 8K bytes when loopback mode is enabled in two member clusters configured with MC virtual hub. For more information on loopback mode go to http://www.tru64unix.compaq.com/docs/updates/TCR51A/TITLE.HTM and refer to the 21.Mar.2002 Technical Update titled "MC API Applications May Not Use Transfers Larger Than 8 KB with Loopback Mode Enabled on Clusters Utilizing Virtual Hubs."

Optional Software
SANworks™ Data Replication Manager by Compaq
SANworks Data Replication Manager (DRM) is controller-based data replication software for disaster tolerance and data movement solutions. DRM works with the new StorageWorksä Fibre Channel MA8000 /EMA12000 Storage Solutions by Compaq. The RAID Array 8000 (RA8000) and Enterprise Storage Array 12000 (ESA12000) are also supported.

Multiple clusters or standalone systems can be connected using DRM to replicate application data. DRM within a single cluster is supported only through Custom Special Systems' "Campus-Wide Disaster Tolerant Cluster" product offering.

For more information about DRM, see the SANworks Data Replication Manager QuickSpec. For more information about the Campus-Wide DisasterTolerant Product, see http://www.compaq.com/solutions/customsystems/ha/tru64_campus_clusters.html.

Supported Systems and Cluster Interconnect Hardware Requirements
Supported Systems
System Shared Storage IO Adapter Cluster Interconnect
AlphaServer 800 KZPSA, KZPBA-CB/CC, KGPSA MC1, 1.5 & 2, 100 Mbps & 1000 Mbps LAN
AlphaServer 1000A KZPSA MC1.5, 100 Mbps & 1000 Mbps LAN
AlphaServer 1200 KZPSA, KZPBA-CB/CC, KGPSA MC1, 1.5 & 2, 100 Mbps & 1000 Mbps LAN
AlphaServer 2000 KZPSA MC1, 1.5, 100 Mbps& 1000 Mbps LAN
AlphaServer 2100 KZPSA MC1, 1.5 , 100 Mbps & 1000 Mbps LAN
AlphaServer 2100A KZPSA MC1, 1.5 , 100 Mbps& 1000 Mbps LAN
AlphaServer 4000, 4100 KZPSA, KZPBA-CB/CC, KGPSA MC1, 1.5 & 2, 100 Mbps& 1000 Mbps LAN
AlphaServer 8200 KZPSA, KZPBA-CB/CC, KGPSA MC1, 1.5 & 2, 100 Mbps & 1000 Mbps LAN
AlphaServer 8400 KZPSA, KZPBA-CB/CC, KGPSA MC1, 1.5 & 2, 100 Mbps & 1000 Mbps LAN
AlphaServer DS10 KZPBA-CB/CC, KGPSA MC2, 100 Mbps & 1000 Mbps LAN
AlphaServer DS10L KZPBA-CB/CC 100 Mbps LAN
AlphaServer DS20, DS20E KZPBA-CB/CC, KGPSA MC2, 100 Mbps & 1000 Mbps LAN
AlphaServer ES40 KZPBA-CB/CC, KGPSA MC2, 100 Mbps & 1000 Mbps LAN
AlphaServer ES45 KZPBA-CB/CC, KGPSA MC2 (see notes), 100 Mbps & 1000 Mbps LAN
AlphaServer GS60, GS60E KZPSA, KZPBA-CB/CC, KGPSA MC1, 1.5 & 2, 100 Mbps & 1000 Mbps LAN
AlphaServer GS80 KZPBA-CB/CC, KGPSA-CA MC2, 100 Mbps& 1000 Mbps LAN
AlphaServer GS140 KZPSA, KZPBA-CB/CC, KGPSA MC1, 1.5 & 2, 100 Mbps & 1000 Mbps LAN
AlphaServer GS160 KZPBA-CB/CC, KGPSA-CA MC2, 100 Mbps& 1000 Mbps LAN
AlphaServer GS320 KZPBA-CB/CC, KGPSA-CA MC2, 100 Mbps& 1000 Mbps LAN
Hardware Requirements
Supported Tape Devices and Media Changers
NOTES: The TL881, TL891, TL893, TL894, TL895, TL896, Compaq 20/40-GB DLT Tape Drive, Compaq 40/80 GB DLT Tape Drive, and ESL9326D Enterprise Library are supported with both the KZPSA and KZPBA-CB/CC adapters. All other SCSI tape device and media changer support is provided with KZPSA adapters only.
March 11, 2002 - From Version 13 to 14
Changed
Supported Systems and Cluster Interconnect Hardware Requirements
TruCluster Server Version 5.1 supports the systems listed in the following table with up to eight systems in a cluster.
TruCluster Server Version 5.1 supports the KZPSA-BB, KZPBA-CB,
KZPBA-CC, KGPSA-BC, KGPSA-CA, and KGPSA-DA as shared storage bus adapters, subject to the current maximum number of adapters and any other restrictions for a given system. TruCluster Server supports a maximum of 62 shared buses in any combination. Information on firmware releases can be found at http://www.compaq.com/support/ or from the current Alpha™ systems firmware update CD-ROM.
Supported SCSI Controllers
The systems are connected to shared SCSI buses using an adapter from the following list. The TruCluster Server Cluster Hardware Configuration manual and Release Notes provide more information regarding SCSI controller configuration, respectively:
· KZPSA — PCI to Fast Wide Differential SCSI-2 adapter
· KZPBA-CB/CC — PCI to UltraSCSI wide differential adapter
NOTE: The TL881, TL891, TL893, TL894, TL895, TL896, Compaq 20/40-GB DLT Tape Drive, Compaq 40/80 GB DLT Tape Drive, and ESL9326D Enterprise Library are supported with both the KZPSA and KZPBA adapters. All other SCSI tape device and media changer support is provided with KZPSA adapters only.
March 7, 2002 - From Version 12 to 13
Added
Storage Hardware Requirements
Supported Fibre Channel Hardware
TruCluster Server supports the following Fibre Channel hardware. For more information on the supported Fibre Channel solutions, see the TruCluster Server Release Notes and the Cluster Hardware Configuration manual.
Device Description
KGPSA-BC PCI-to-Fibre Channel host adapter
KGPSA-CA PCI-to-Fibre Channel host adapter
DS-DSGGA-AA/AB 8/16-port Fibre Channel switch
DS-DSGGB-AA/AB 8/16-port Fibre Channel switch
DS-DSGGC-AA/AB 8/16-port FC switch
DS-DMGGD-AA/AB McData 64-Port Fibre Channel Director Class Switch
DS-DSGGD-AA (240602-B21) 16-port Fibre Channel 2GB Switch
DS-SWXHB-07 7-port FC hub
HSG60 Array Controller
HSG80 Array Controller
February 22, 2002 - From Version 11 to 12
Added
Storage Hardware Requirements
Supported Fibre Channel Hardware
The use of the 7 port Fibre Channel hub is restricted to use with DS10, DS10L, DS20, DS20E, and ES40 (ES45) systems and these clusters are restricted to a maximum of 2 members.
Supported Terminators and Connectors
TruCluster Server supports the following terminators and connectors:
Device Description
H879-AA or 330563-001 HD68 terminator
H885-AA HD68 tri-link connector
H8861-AA VHDCI tri-link connector
H8863-AA VHDCI terminator
H8574-A 50-pin LD terminator
H8860-AA 50-pin LD terminator
341102-001 50-pin HD terminator
152732-001 VHDCI 68-pin LVD terminator
Supported Tape Devices and Media Changers
  1. Can be expanded to two TZ89N-AV drives with part number DS-TL892-UA.
  2. A DS-TL890-NE/NG MiniLibrary Expansion Unit can be connected to up to three DS-TL891-NE/NG drive units to manage the drives and cartridges in all connected units. A DS-TL800-AA pass-through mechanism is required for the second and third DS-TL891-NE/NG.
  3. Can be expanded to two DLT 35/70 drives with part number 120878-B21.
  4. The MiniLibrary Expansion Unit can be used to control the drives and cartridges of up to five drive and data units. A MiniLibrary Pass-Through Mechanism, part number 120880-B21, is needed for each additional unit beyond the first drive unit.
  5. Can be expanded to two DLT 20/40 drives with part number 128671-B21.
  6. An upgrade kit to add one DS-TZ89N-VA tape drive.
  7. An upgrade kit to add one 35/70 DLT tape drive.
  8. Can be upgraded by the addition of a single or multiple 35/70 DLT tape drives with part number 146209-B21.
February 13, 2002 - From Version 10 to 11
Added
Features –TruCluster Server V5.1A
Support for Memory Channel API
TruCluster Server provides a special application programming interface (API) library for high-performance data delivery over Memory Channel by giving access to Memory Channel data transfer and locking functions. This Memory Channel API library enables highly optimized applications that require high-performance data delivery over the Memory Channel interconnect. This library is supported solely for use with Memory Channel.

High performance within the cluster is achieved by providing user applications with direct access to the capabilities of the Memory Channel. For example, a single store instruction on the sending host is sufficient for the data to become available for reading in the memory of another host.

The Memory Channel API library allows a programmer to create and control access to regions of the clusterwide address space by specifying UNIX-style protections. Access to shared data can be synchronized using Memory Channel spin locks for clusterwide locking.

The Memory Channel API library facilitates highly optimized implementations of Parallel Virtual Machine (PVM), Message Passing Interface (MPI), and High Performance Fortran (HPF), providing seamless scalability from SMP systems to clusters of SMP machines. This provides the programmer with comprehensive access to the current and emerging de facto standard software development tools for parallel applications while supporting portability of existing applications without source code changes.

Note to users of the Memory Channel API V1.6 product on Tru64 UNIX Version 4.0*:

On Tru64 UNIX V5.*, the TruCluster Memory Channel Software V1.6 product is bundled as a feature of TruCluster Server V5.*. To run the Memory Channel API library on Tru64 UNIX version 5.1A, you must install a TruCluster Server license to configure a valid TruCluster Server cluster.

Note to users of the Memory Channel API with ES45:

The Memory Channel application programming interface (MC API) is not supported in a two-member cluster containing an AlphaServer ES45 and configured with Memory Channel in virtual hub mode. Everything else in the TruCluster product is supported with ES45 in vhub mode, but to deploy an application that uses the MC API in a two-member cluster containing an AlphaServer ES45, a Memory Channel hub must be configured for each rail.

Configuration
Software Requirements
TruCluster Server Version 5.1A requires the Tru64 UNIX Version 5.1A operating system. The Tru64 UNIX operating system is a separately licensed product. See the Tru64 UNIX operating system QuickSpec for more information.

TruCluster Server Version 5.1A requires that additional software subsets be installed. See the TruCluster Server Software Installation manual for more information.

Growth Considerations
The minimum hardware and software requirements for any future version of this product may be different from the requirements for the current version.

A rolling upgrade to the next version of the cluster software requires the following:

  • At least 50 percent free space in root (/), cluster_root#root
  • At least 50 percent free space in /usr, cluster_usr#usr
  • At least 50 percent free space in /var, cluster_var#var, plus an additional 425 MB to hold the subsets for the new version of the Tru64 UNIX operating system
  • At least 50 percent free space in /usr/i18n, cluster_i18n#i18n when used
Hardware Requirements
Hardware Restrictions
TruCluster Server has the following hardware restrictions. The TruCluster Server Cluster Hardware Configuration manual provides additional information regarding hardware restrictions.
  • Prestoserve NVRAM failover is not supported on shared disk devices.

TruCluster Server supports up to eight member cluster configurations as follows:

  • Switched Fibre Channel: Eight-member systems may be connected to common storage over Fibre Channel in a fabric (switch) configuration.
  • Parallel SCSI: Only four of the member systems may be connected to any one SCSI bus. Multiple SCSI buses may be connected to different sets of members and the sets of members may overlap. Use of a DS-DWZZH-05 UltraSCSI hub with fair arbitration enabled is recommended when connecting four member systems to a common SCSI bus.
Changed
Supported Systems and Cluster Interconnect Hardware Requirements
Notes:
  • Hard partitions of GS80, GS160, and GS320 can be clustered together either across separate systems or within systems, but each hard partition must have at least one cluster interconnect connection.
  • TruCluster Server Version 5.1A requires all members to be connected with either all members using Memory Channel hardware or all members using a private 100 MB or 1000 Mbps full-duplex LAN. Note that there are two variants of Memory Channel (MC):
  • ES45 supports single rail Mermory Channel (MC) configured for either 512 MB or 128 MB, and it supports dual rail MC only at 128 MB.
  • The use of the MC API is not supported in a two-member cluster containing an AlphaServer ES45 and configured with Memory Channel in virtual hub mode. To use the MC API in a two-member cluster containing an AlphaServer ES45, a Memory Channel hub must be configured for each rail.
  • For further information on deploying an ES45 in a TruCluster, please refer to the Cluster Hardware Configuration Technical Update for the AlphaServer ES45 which resides in the repository found at http://www.tru64unix.compaq.com/docs/pub_page/tcr_update.html
Removed
Hardware Requirements
RAID Controller
SWXRA-Z1 Array Controller (HSZ20)
RAID Array 3000 (HSZ22)
HSZ40-Bx Array Controller
HSZ40-Cx Array Controller
HSZ50-Ax Array Controller
HSZ70 Array Controller
HSZ80 Array Controller
HSV110 Array Controller
(see note)

Note: For the current status of supported TruCluster HSV110 configurations, please contact TruCluster Product Manager Bob Grosso at bob.grosso@compaq.com or by phone at 1-603-884-1403.

Hardware Configuration Examples
  • The TruCluster Server Cluster Hardware Configuration manual provides hardware configuration examples.

TruCluster Server supports up to eight member cluster configurations as follows:

  • Switched Fibre Channel: Eight-member systems may be connected to common storage over Fibre Channel in a fabric (switch) configuration.
  • Parallel SCSI: Only four of the member systems may be connected to any one SCSI bus. Multiple SCSI buses may be connected to different sets of members and the sets of members may overlap. Use of a DS-DWZZH-05 UltraSCSI hub with fair arbitration enabled is recommended when connecting four member systems to a common SCSI bus.
January 8, 2002 - From Version 9 to 10
Added
Hardware Requirements
Supported Tape Devices and Media Changers
The following tape controllers and modular data routers are supported on shared storage:
  • 340654-001 Fibre Channel Tape Controller
  • 152975-001 Fibre Channel Tape Controller II
  • 163082-B21 3R-A2673-AA Fibre Channel Modular Data Router (MDR)
  • 163083-B21 3R-A2774-AA Fibre Channel Modular Data Router (MDR)
  • 218240-B21 3R-A3292-AA Fibre Channel Modular Data Router (MDR)
  • 218241-B21 3R-A3312-AA Fibre Channel Modular Data Router (MDR)
 
RAID Controller
SWXRA-Z1 Array Controller (HSZ20)
RAID Array 3000 (HSZ22)
HSZ40-Bx Array Controller
HSZ40-Cx Array Controller
HSZ50-Ax Array Controller
HSZ70 Array Controller
HSZ80 Array Controller
HSV110 Array Controller (see note)

Note: For the current status of supported TruCluster HSV110 configurations, please contact TruCluster Product Manager Bob Grosso at bob.grosso@compaq.com or by phone at 1-603-884-1403.

   
Changed
Supported Systems and Cluster Interconnect Hardware Requirements
Supported Systems
Notes:
October 30, 2001 - From Version 8 to 9
Added
Ordering Information
TruCluster Server V5.1A licenses include:
Systems TruCluster Plus packages* TruCluster Server License TruCluster Server Migration License**
AlphaServer™ 800, 1000A, 1200, DS10, DS10L, DS20, DS20E QP-6R9AC-AA QL-6BRAC-AA QL-6J1AC-AA
AlphaServer ES40, ES45 QP-6R9AE-AA QL-6BRAE-AA QL-6J1AE-AA
AlphaServer 2000, 2100, 2100A, 4000, 4100, GS60E, GS80 QP-6R9AG-AA QL-6BRAG-AA QL-6J1AG-AA
AlphaServer 8200, 8400, GS60, GS140, GS160, GS320 QP-6R9AQ-AA QL-6BRAQ-AA QL-6J1AQ-AA
   
Supported Systems and Cluster Interconnect Hardware Requirements
Supported Systems
System Shared Storage IO Adapter Cluster Interconnect
AlphaServer ES40 KZPBA, KGPSA MC2, 100 Mbps& 1000 Mbps LAN
AlphaServer ES45 KZPBA, KGPSA MC2 (see notes), 100 Mbps& 1000 Mbps LAN
AlphaServer GS60, GS60E KZPSA, KZPBA, KGPSA MC1, 1.5 & 2, 100 Mbps & 1000 Mbps LAN
Notes:
  • Hard partitions of GS80, GS160, and GS320 can be clustered together either across separate systems or within systems, but each hard partition must have at least one cluster interconnect connection.
  • TruCluster Server Version 5.1A requires all members to be connected with either all members using Memory Channel hardware or all members using a private 100 MB or 1000 Mbps full-duplex LAN. Note that there are two variants of Memory Channel (MC):
  • ES45 supports single rail Mermory Channel (MC) configured for either 512 MB or 128 MB, and it supports dual rail MC only at 128 MB.
  • ES45 does not support virtual hub mode. A Memory Channel hub must be configured for each rail.
  • For further information on deploying an ES45 in a TruCluster, please refer to the Cluster Hardware Configuration Technical Update for the AlphaServer ES45 which resides in the repository found at http://www.tru64unix.compaq.com/docs/
    pub_page/update_list.html
  
September 14, 2001 - From Version 7 to 8
Added
Supported Systems
System Shared Storage IO Adapter Cluster Interconnect
AlphaServer 800 KZPSA, KZPBA, KGPSA MC1, 1.5 & 2, 100 Mbps & 1000 Mbps LAN
AlphaServer 1000A KZPSA MC1.5, 100 Mbps & 1000 Mbps LAN
AlphaServer 1200 KZPSA, KZPBA, KGPSA MC1, 1.5 & 2, 100 Mbps & 1000 Mbps LAN
AlphaServer 2000 KZPSA MC1, 1.5, 100 Mbps& 1000 Mbps LAN
AlphaServer 2100 KZPSA MC1, 1.5 , 100 Mbps & 1000 Mbps LAN
AlphaServer 2100A KZPSA MC1, 1.5 , 100 Mbps& 1000 Mbps LAN
AlphaServer 4000, 4100 KZPSA, KZPBA, KGPSA MC1, 1.5 & 2, 100 Mbps& 1000 Mbps LAN
AlphaServer 8200 KZPSA, KZPBA, KGPSA MC1, 1.5 & 2, 100 Mbps & 1000 Mbps LAN
AlphaServer 8400 KZPSA, KZPBA, KGPSA MC1, 1.5 & 2, 100 Mbps & 1000 Mbps LAN
AlphaServer DS10 KZPBA, KGPSA MC2, 100 Mbps & 1000 Mbps LAN
AlphaServer DS10L KZPBA 100 Mbps LAN
AlphaServer DS20, DS20E KZPBA, KGPSA MC2, 100 Mbps& 1000 Mbps LAN
AlphaServer ES40 KZPBA, KGPSA MC2, 100 Mbps& 1000 Mbps LAN
AlphaServer GS60, GS60E KZPSA, KZPBA, KGPSA MC1, 1.5 & 2, 100 Mbps & 1000 Mbps LAN
AlphaServer GS80 KZPBA, KGPSA-CA MC2, 100 Mbps& 1000 Mbps LAN
AlphaServer GS140 KZPSA, KZPBA, KGPSA MC1, 1.5 & 2, 100 Mbps & 1000 Mbps LAN
AlphaServer GS160 KZPBA, KGPSA-CA MC2, 100 Mbps& 1000 Mbps LAN
AlphaServer GS320 KZPBA, KGPSA-CA MC2, 100 Mbps& 1000 Mbps LAN
Notes:
  • Hard partitions of GS80, GS160, and GS320 can be clustered together either across separate systems or within systems, but each hard partition must have at least one cluster interconnect connection.
  • TruCluster Server Version 5.1A requires all members to be connected with either all members using Memory Channel hardware or all members using a private 100 MB or 1000 Mbps full-duplex LAN. Note that there are two variants of Memory Channel (MC):
Changed
Overview
Description
TruCluster Server supports a variety of hardware configurations that are cost-effective and meet performance needs and availability requirements. Hardware configurations can include different types of systems and storage units, and can be set up to allow easy maintenance. In addition, administrators can set up hardware configurations that allow the addition of a system or storage unit without shutting down the cluster.

For the fastest communication with the lowest latency, use the PCI-based Memory Channel cluster interconnect for communication between cluster members. TruCluster Server Version 5.1A also supports the use of 100 Mbps Ethernet or 1000 Mbps Ethernet hardware as a private LAN cluster interconnect. The LAN interconnect is suitable for clusters with low-demand workloads generated by a cluster running fail-over style, highly available applications in which there is limited application data being shared between the nodes over the cluster interconnect. Refer to the first chapter of the "Cluster LAN Interconnect" manual for a discussion of the merits of each cluster interconnect.

Cluster members in a given cluster must all use Memory Channel or all must use LAN, but these interconnects cannot be mixed for cluster communication in the same cluster. Using multiple shared buses and redundant Memory Channel or LAN interconnect hardware promotes no-single-point-of-failure (NSPOF) characteristics for mission-critical applications.

Supported Memory Channel Hardware
MC 1 & 1.5 MC2 Description
BN39B-01 (one meter) Connects MC adapter to CCMFB optical converter
CCMFB-AA Fiber Optics Converter
BN34R-10 (10 meter) Fiber-optic cable: Connect one optical converter to another
BN34R-31 (31 meter) Fiber-optic cable: Connect one optical converter to another
Supported LAN Interconnect Hardware
Use of dedicated LAN is supported for use as a cluster interconnect. A LAN interconnect must be private to cluster members. As long as any packet that is transmitted by a cluster member's interconnect adapter can only be received by interconnect adapters of other members of the same cluster, the interconnect meets the privacy requirement.

A LAN interconnect can be a direct connection between two cluster members or can employ hubs or switches. In general, any Ethernet adapter, switch, or hub that works in a standard LAN at 100 Mbps or 1000 Mbps should work within a LAN interconnect. (Fiber Distributed Data Interface (FDDI), ATM LAN Emulation (LANE), and 10 Mbps Ethernet are not supported.)

Although hubs and switches are interchangeable in most LAN interconnect configurations, switches are recommended for performance and scalability. Most hubs run in half-duplex mode and do not detect network collisions, so their use in a LAN interconnect may limit cluster performance. Overall, using a switch, rather than a hub, provides greater scalability for clusters with three or more members.

Adapters and switch ports must be configured compatibly with respect to speed (100 Mbps or 1000 Mbps) and operational mode (full-duplex). A maximum of three hops is allowed between cluster members, where a hop means passing from a system, switch, hub, or router, to another system, switch, hub, or router. That is, any combination of up to two hubs, switches, or routers is supported between two cluster members. You must not introduce unacceptable latencies by using, for example, a satellite uplink or a wide area network (WAN) in the path between two components of a LAN interconnect.

A fully redundant LAN interconnect configuration employs two or more Ethernet adapters in a NetRAIN set on each member, with redundant wiring to two or more switches interlinked by two crossover cables. These Ethernet switches must be capable of one of the follow mechanisms for managing traffic across parallel inter-switch links: link aggregation (also known as port trunking), resilient links, or per-port-enabled spanning tree algorithm.

September 5, 2001 - From Version 6 to 7
Changed
Please note that this document was completely revised.