|
|
Overview
| HP InfiniBand Options for HP BladeSystems c-Class |
|
HP supports 40Gbps 4x Quad Data Rate (QDR) and 20Gbps 4X Double Data
Rate (DDR) InfiniBand products that include mezzanine Host Channel Adapters
(HCA) for server blades, switch blades for c-Class enclosures, and rack
switches and cables for building scale-out solutions. This QuickSpecs
focuses on mezzanine HCAs for server blades, and InfiniBand switch blades
for c-Class enclosures; for details on the InfiniBand rack switches, standup
PCI Express HCAs for HP ProLiant and Integrity servers, as well as InfiniBand
cables, please refer to the HP InfiniBand for HP ProLiant and Integrity
servers QuickSpecs at: http://h18000.www1.hp.com/products/quickspecs/13078_div/13078_div.html
The HP 4X QDR IB CX-2 Dual-port Mezzanine HCA for HP BladeSystem c-Class
is based on the Mellanox ConnectX-2 IB technology. The QDR IB HCA delivers
low-latency and up to 40Gbps (QDR) bandwidth for performance-driven server
and storage clustering applications in High-Performance Computing (HPC)
and enterprise data centers. Parallel or distributed applications running
on multi-processor multi-core servers will benefit from the reliable transport
connections and advanced multicast support offered by ConnectX IB. End-to-end
Quality of Service (QoS) enables partitioning and guaranteed service levels
while hardware-based congestion control prevents hot spots from degrading
the effective throughput. The HP 4X QDR IB CX-2 Dual-port Mezzanine HCA
card is designed for PCI Express 2.0 x8 connectors on HP BladeSystem c-Class
G6 server blades. Depending on the server blade models, some configuration
rules may apply which may result in only one port being connected to the
enclosure mid-plane. Please refer to server blades specification for more
details.
The QLogic 4X QDR IB Mezzanine HCA is based on the QLogic TrueScale ASIC architecture which has a unique hardware architecture that delivers unprecedented levels of performance, reliability, and scalability, making it an ideal solution for highly scaled High Performance Computing (HPC) and high throughput, low-latency enterprise applications. InfiniBand host stack software (driver) is required to run on servers connected to the InfiniBand fabric. For HCAs based on QLogic technology, HP supports QLogic OFED driver stacks on Linux 64-bit operating systems. The QLogic BLc 4X QDR IB Switch for HP BladeSystem c-Class uses the QLogic TrueScale ASIC architecture designed to cost-effectively link workgroup resources into a cluster or provide an edge switch option for a larger fabric. Customers have the ability to internally or externally manage the modular IB switch. The QLogic BLc 4X QDR IB Switch also has an optional management module that includes an embedded subnet manager. This management module is an option for both the 32-port QDR BladeSystem switch and the 36-port QDR edge switch. When combined with the optional InfiniBand Fabric Suite software, users can mange up to a 288 node fabric using only the management capability of the unit, without requiring additional host processing. In a bladed environment this alleviates the need to use a node for fabric management. An InfiniBand fabric is constructed with one or more InfiniBand switches
connected via inter-switch links. The most commonly deployed fabric topology
is a fat tree or its variations. A subnet manager is required to manage
an InfiniBand fabric. OpenSM is a host-based subnet manager that runs
on a server connected to the InfiniBand fabric. QLogic OFED software stack
includes OpenSM for Linux. For comprehensive management and monitoring
capability, QLogic InfiniBand Fabric Suite (IFS) is recommended for managing
the InfiniBand fabric based on QLogic InfiniBand products. |
| |
| What's New |
|
|
|
| At A Glance |
|
|
|
Models
| InfiniBand mezzanine HCA cards and options | NOTE: The HCA cards listed in this section are based on Mellanox technology. | |
| HP 4X QDR IB CX-2 Dual Port Mezz HCA for HP BladeSystem c-Class | 592519-B21 | |
| HP 4X DDR IB Dual-port Mezzanine HCA for HP BladeSystem c-Class | 448262-B21 | |
| Voltaire OFED driver stack RTU license | 450716-B21 | |
| Voltaire Unified Fabric Mgr
(UFM) Per Node RTU NOTE: Right to use (RTU) License for Voltaire Unified Fabric Manager (UFM), 1 per node for every node connected to the Voltaire InfiniBand fabric. |
590643-B21 | |
| QLogic IB mezzanine HCA card | QLogic 4X QDR IB Dual Port Mezz HCA | 583210-B21 |
| Mellanox IB switch blades and options | HP BLc 4X QDR IB Switch for HP BladeSystem c-Class | 489184-B21 |
| HP BLc 4X DDR IB Gen2 Switch for HP BladeSystem c-Class | 489183-B21 | |
| NOTE: The HP
BLc 4X QDR IB Switch is only supported on the HP BladeSystem c7000 Enclosures
(P/N's: 507014-B21, 507015-B21, 507016-B21, 507017-B21 and 507019-B21. NOTE: Please see the HP BladeSystem c7000 Enclosure QuickSpecs for additional information at: http://h18000.www1.hp.com/products/quickspecs/12810_div/12810_div.html (Worldwide) |
||
| Mellanox Fabric IT Mgr Per Node
RTU NOTE: Right to use (RTU) License for Mellanox FabricIT, 1 per node for every node connected to the Mellanox InfiniBand fabric. |
588055-B21 | |
| Voltaire Unified Fabric Mgr
Per Node RTU NOTE: Right to use (RTU) License for Voltaire Unified Fabric Manager (UFM), 1 per node for every node connected to the Voltaire InfiniBand fabric. |
590643-B21 | |
| QLogic IB switch blade and options | QLogic BLc 4X QDR IB Switch for HP BladeSystem c-Class | 505958-B21 |
| QLogic BLc 4X QDR IB Management Module | 505959-B21 | |
| QLogic InfiniBand Fabric Suite
(IFS) NOTE: Right to use (RTU) License for QLogic IFS, 1 per node for every node connected to the QLogic InfiniBand fabric. |
589485-B21 |
|
|
Performance
| Latency and Bandwidth |
All ports on 4X QDR HCA card and switch are capable of supporting 40Gbps
signaling rate, with a peak data rate of 32 Gbps in each direction. | |
|
|
Scalability and Reliability
| Standards support |
|
| | Operating systems support |
|
|
|
|
| PCI-Express Mezzanine connectors |
HP 4X QDR IB HCA mezzanine card is specified to run on PCI Express Gen2 connectors. HP 4X DDR IB HCA mezzanine cards are specified to run on PCI Express mezzanine connectors. Either x8 or x4 connectors can be used for the IB 4X DDR HCA cards, however, for the best 4X DDR performance, DDR IB HCA mezzanine cards should only be plugged on x8 PCI Express connectors. Depending on the server blade models, multiple HCAs per server blade may be supported; please refer to server blades specification for more details. |
|
|
Switch bays on c-Class enclosure | HP IB switch blades are designed to fit into the double wide switch bays on the c-Class enclosures. Depending on the mezzanine connectors used for IB HCA mezzanine cards, the IB switch blade has to be inserted into corresponding switch bays. |
|
|
InfiniBand Fabric Management
| Auto-negotiation/ self-discovery |
InfiniBand QDR ports support auto-negotiation down to DDR/SDR, InfiniBand
DDR ports support auto-negotiation down to SDR. For example, external
uplink ports of a DDR switch blade will negotiate down to SDR speed if
they are connected to a device which can only operate at SDR. |
|
|
|
| Management Support |
Mellanox OFED, Voltaire® OFED and QLogic OFED+ include drivers and utilities to configure and manage the HCA in a Linux environment and Mellanox WinOF includes drivers and utilities to configure and manage the HCA in the Microsoft Windows server HPC 2008 environment. InfiniBand fabric has to be set up with a subnet manager: see the subnet manager discussion above. |
|
|
Additional Features
| Warranty |
HP branded hardware options qualified for BladeSystem c-Class and p-Class
servers are covered by a global limited warranty and supported by HP Services
and a worldwide network of HP Authorized Channel Partners. The HP branded
hardware option diagnostic support and repair is available for one year
from date of purchase, or the length of the server they are attached to,
whichever is greater. Support for software and initial setup is available
for 90 days from date of purchase. Additional support may be covered under
the warranty or available for an additional fee. Enhancements to warranty
services are available through HP Care Pack services or customized service
agreements. |
| HP Services and Support |
The HP Care Pack service for ProLiant BL c-Class and p-Class server blades
cover the server blade and all HP branded hardware options qualified for
the server, purchased at the same time or afterwards, internal to the
server. HP Care Pack Services provide total care and support expertise
with committed response designed to meet your IT and business needs.
Enhanced Service - Optimum service level to increase IT performance and availability.
Installation & Start-Up service for HP BladeSystem Infrastructure
plus HP BladeSystem Enhanced Network Installation and Start-UP as per
the Customer Description and/or Data Sheet. To be delivered on a scheduled
basis 8am-5pm, M-F, excluding HP holidays. |
|
|
Technical Specifications
| Compliance | Mezzanine: | Dual-port QDR HCA:
PCI Express 2.0 (1.1 compliant) Dual-port DDR HCA: PCI Express 2.0 (1.1 compliant) |
||
| ROHS-R5 (QLogic HCA is ROSH-R6 compliant) | ||||
| Switches: | IBTA version 1.2 compatible | |||
| ROHS-R5 (QLogic switch blade is ROSH-R6 compliant) | ||||
|
General Specifications |
Communications Processor | Mezzanine: | Dual-port QDR HCA:
Mellanox ConnectX-2 Dual-port DDR HCA: Mellanox ConnectX-2 QLogic QDR HCA: QLogic TrueScale |
|
| QDR switch: | MT48436A1-FCC-Q, InfiniScale IV | |||
| DDR Gen2 switch: | MT48436A1-FCC-D, InfiniScale IV | |||
| QLogic QDR switch: | QLogic TrueScale | |||
|
Dimensions (LxW) |
Mezzanine HCA: | 4.5 x 4.0 in (11.43 x 10.16 cm) | ||
| Switches: | 15.3 x 10.6 in (38.86 x 26.92 cm) | |||
|
Power and Environmental Specifications |
Operating | Temperature | Mezzanine HCA: | 32º to 131º F (0º to 55º C) |
| Switch module: | 32º to 104º F (0º to 40º C) |
|||
|
Humidity |
Mezzanine HCA: | 5% to 85% | ||
| Switch module: | 5% to 85% | |||
| Power requirement | Mezzanine HCAs: | Dual-port QDR HCA:
max 11.4W Dual-port DDR HCA: max 12.9W QLogic QDR HCA: max 8.4W |
||
| Switch blades: | QDR switch: 10.8A
at 12V Max (130W) DDR Gen2 switch: 10 A at 12V max ( 120 W) QLogic QDR switch: 150W @ 12V QLogic Management Module: 1.5W @ 12V |
|||
|
Emissions Classifications |
HCA and Switches: | FCC CFR 47 Part 15
Class A CISPR 22 Class A ICES-003 Class A VCCI Class A ACA CISPR 22 Class A |
||
| Switches: | MIC Korea "EMC Registration Regulation" Class A | |||
|
|
||||
|
© Copyright 2009 Hewlett-Packard Development Company,
L.P. |