Ask Maclean

infiniband协议在Oracle RAC的兼容性

原文链接： http://www.dbaleet.org/infiniband_protocol_oracle-rac_compatible/

上篇介绍了infiniband的的各种协议，以及他们是如何与Oracle数据库产品集成的，但是还有一个非常重要的信息没有提到，那就是在个各平台和数据库版本的兼容性。

在Oracle官方网站上有两个链接专门介绍RAC技术在Unix平台和Linux平台的兼容性。其中截取infiniband的情况如下：

Oracle RAC Technologies Certification Matrix for UNIX Platforms 

InfiniBand (IB)

  • RDS over IB is supported (see notes)
  • IP over IB is supported
 IBM POWER system with AIX 5.3 TL8 Service Pack 4 or AIX 6.1 TL4 with Service Pack 1 and Oracle RAC 11.1. Customers planning deployment must review MetaLink 282036.1 for details on supported software versions.HPUX 11iv3 (B.11.31.0909) and OS Patches: DLPI patch PHNE_38689, ARPA Transport patch PHNE_38680, APA/LM web release of Dec 2008 OR the 0903 Fusion release.  Oracle patch for skgxp – bug # 8618175 to be installed on top of Oracle RAC 11.1.0.7.  Download and install the HPUX Infiniband driver: IB4X-00 Driver for InfiniBandRDSv1 is supported on Solaris SPARC and x86-64 with Oracle version 10.2.0.4 and Solaris 10 update 5/09 or higherRDSv1 is supported on Solaris SPARC  with Oracle version 11.1.0.7 on Solaris 10 10/08 and above. The patch for fixing Oracle Bug 9788507 is required.RDSv3 is supported on Solaris 11 SPARC and x86-64  with Oracle 11gR2 (11.2.0.3)  on Solaris 11 SRU5 and later.

RAC Technologies Matrix for Linux Platforms

InfiniBand (IB)

  • RDS over IB is supported
  • IP over IB is supported
  • Reliable Datagram Sockets (RDS) is supported with QLogic (SilverStorm) switches on x86 and x86-64 with Oracle 10.2.0.3
  • Open Fabrics Enterprise Distribution (OFED) 1.3.1 and higher (RDS v2 and higher) is supported with Oracle 11.1 and higher with Oracle/Sun, HP, QLogic and Voltaire switches
  • Oracle only supports InfiniBand HCA with Mellanox chip set

 

简单的总结如下：

AIX平台和HP-UX目前只能使用11.1.0.7这个版本才能使用infiniband的RDS协议（IPoIB不受这个限制）：

AIX平台：  综合IBM官方网站信息

  • AIX 5.3 TL8 SP6+AIX 5.3 TL11 SP1+  (Oracle database 11.1.0.7)
  • AIX 6.1 TL4 SP1+APAR IZ64144     (Oracle database 11.1.0.7)
  • AIX 7.1 暂不支持。
对于11.2， 目前还存在一个bug没有修复，详见MOS文档Minimum Software Versions and Patches Required to Support Oracle Products on IBM Power Systems (Doc ID 282036.1)的附件PDF，其中有一段话摘录如下：
In general IP over InfiniBand for the RAC cluster interconnect is supported as a Generic Certification (see section 1.3.0), 10gR2 and
11gR1 are supported. However, it is not recommended to use InfiniBand with Oracle RAC 11gR2 for the cluster interconnect at this time. On AIX, high availability for InfiniBand interfaces is provided using the Virtual IP Address (VIPA) feature. Oracle RAC 11gR2 introduced functionality which is incompatible with VIPA and in some cases also incompatible with the InfiniBand interface. IBM and Oracle are working to resolve these incompatibilities in the future. Customers requiring a higher bandwidth interconnect should consider 10GbEthernet, which is Generically Certified with 10gR2, 11gR1 and 11gR2. IT architects requiring more details on these incompatibilities, and the status of enhancements, should contact [email protected].

 

HP-UX平台：
  • HP-UX 11.31.0909+PHNE_38689+PHNE_38680 （Oracle Database 11.1.0.7+patch 8599853）
HP-UX暂无法在11.2上使用RDS协议。
Oracle Solaris平台：

10.2.0.4 and Solaris 10 update 5/09 or higher

  • Solaris 10  5/09 + (Oracle Database 10.2.0.4)
  • Solaris 10 10/08+ (Oracle Database 11.1.0.7+patch 9788507)
  • Solaris 11 SRU5+ (Oracle Database11.2.0.3)

Linux X86平台：

  • Linux X86 + (QLogic交换机+Oracle Database 10.2.0.3+)
  • Linux X86+ OFED 1.3.1 (Oracle/Sun, HP, QLogic and Voltaire交换机+Oracle Database 11.1+ )
Linux + Oracle Database  10.2上的配置，请参看这个白皮书。Oracle Real Application Clusters 10g Release 2: Installation and Configuration of Linux Clusters Using RDS over InfiniBand Interconnect 
另外值得一提的是，Oracle目前只认证QLogic公司的infiniband交换机。但是大部分infiniband厂商都提供了针对Oracle RAC的解决方案：以下是一些白皮书：
 最后简单发表一下个人看法：
如果要使用infiniband，一定需要确保对应的软硬件平台能支持RDS协议。如果不支持，则还不如使用10GBps的以太网。对于infiniband协议支持最好的两个平台是Linux和Solaris，这也是Exadata的操作系统只有这两者的一个原因，完美支持infiniband各种协议的只有Linux平台和Solaris平台。
目前在AIX和HP-UX平台，能使用RDS协议的Oracle数据库只有11.1.0.7 这个版本，更高版本目前并不是完美兼容，虽然可以使用一些workaround绕过去，单终究不是太好的选择。
Tips：
在打Exadata的BP（Bundle Patch）的时候，尽量不要使用apply或者napply的方式手工去做，很多高级dba往往觉得auto模式不靠谱（事实也是如此），情愿选择手工的模式，但是觉得自己对此比较熟悉，往往不去看readme，结果导致下面步骤漏掉，后果可想而知。。。
dcli -l oracle -g /home/oracle/dbs_group ORACLE_HOME=/u01/app/11.2.0.3/grid make -C /u01/app/11.2.0.3/grid/rdbms/lib -f ins_rdbms.mk ipc_rds ioracle

 

Posted

in

by

mac

Tags:

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *