hp talk at Sept. 2003 Oracle World

1
Extended ServiceGuard/Oracle 9iRAC a high
availability cluster solution with DWDM and Dark
Fiber
Mai Cutler HP Oracle Alliance Lab Sandy Gruver
HP Oracle Advanced Technology Center Stefan
Pommerenk Cluster and Parallel Storage
Technology/Oracle
2
Agenda

• Why stretch RAC cluster.
• what are the business drivers
• Review of 9iRAC architecture
• short review of RAC on HPUX
• What is DWDM and Dark Fiber?...
• Use Joes ideas and pictures
• Architecture used for the tests
• include mention of other partners - ATT and
  Nortel?
• Description of tests and results..
• Oracle tests..
• I/O tests
• Failover tests
• ?? Other testing - aka Bob Sauers suggestions (in
  support of customer-LCH).

Sandy Sandy Sandy Mai Mai Mai Mai Sandy Sandy

3
Agenda

• Why stretch RAC cluster
• Review of 9iRAC architecture
• What is DWDM and Dark Fiber?
• Architecture used for the tests
• Description of tests and results

4
Why a stretch RAC cluster?what are the
business drivers

• A need for a single RAC solution which can span
  an extended distance (up to 100km)
• This solution
• Is simpler than maintaining a standby
• Disaster site is built-in to the solution
• Provides data protection in case of a local
  disaster
• Allows having a single RAC database spanning two
  geographically distant sites
• Ensures no data loss in case of a failure at one
  site

5
Review of 9iRAC architecture on HP-UXSingle
Instance Oracle
Single Oracle Database
HP Server
Raw Device and File System Files
Control
Data
DB System
Temp
Index
Rollback
Log files
files
files
files
files
files
files
Archive Redo Logs
6
Review of 9iRAC architecture on HP-UX Oracle 9iRAC
Oracle Real Application Cluster Database
System A
System B
HP Server
Raw Devices
Redo Log files Instance A
Control
Data
Index
Redo Log files Instance B
DB System file(s)
Temp
Rollback/ Undo files
files
files
files
files
Per instance
mirrored
Archive Redo Logs Instance B
Archive Redo Logs Instance A
7
Review of 9iRAC architecture on HP-UX Cache
services
Global Cache Service
Node 1, Instance A
Node 2, Instance B
SGA
LCK0
SGA
LCK0
9i Cache Fusion
Database Buffer Cache
Database Buffer Cache
Redo Log Buffers
Redo Log Buffers
USER
USER
DBWR
LGWR
DBWR
LGWR
USER
USER
USER
USER
Data
Redo
Redo
Data
Redo
Redo
Data
Redo
Redo
Data
Control
8
What is DWDM and Dark Fiber DWDM

• Dense Wavelength Division Multiplexing
• Optoelectronic technology
• Single optical fiber
• Simultaneous transmission of signals
• Wavelength of incoming signals changed
• Similar to radio or TV broadcasting

9
What is DWDM
Passive Optical Multiplexer
Passive Optical Multiplexer
ESCON
ESCON
Wavelength
Wavelength
Ch 1
Ch 1
1300 nm
1300 nm
Converter
Converter
Fibre Channel
Fibre Channel
Dark fiber
Wavelength
Wavelength
Converter
Converter
Ch 2
Ch 2
1300 nm
1300 nm
Ch 3
Ch 2
Ch 1
100BaseFX
100BaseFX
Wavelength
Wavelength
Converter
Converter
Ch 3
1300 nm
1300 nm
Ch 3
10
What is DWDM and Dark Fiber Dark Fiber

• fiber optic cable
• sold by telecom provider
• has no light or signal (is dark) until
  customer puts a signal on it.
• Commonly today, telecom providers sell dark
  fiber over DWDM

11
What is DWDM and Dark Fiber Classic Dark Fiber
REMOTE CPU SITE B
LOCAL CPU SITE A
Common Carrier Dark Fiber
12
What is DWDM and Dark Fiber Dark Fiber with DWDM
REMOTE CPU SITE B
LOCAL CPU SITE A
DWDM Device
DWDM Device
Common Carrier Dark Fiber
13
Previous testing Extended ServiceGuard Cluster
with DWDM

• Original tests

Extended Distance Clusters (new name) allows
distances up to 100 km using DWDM technology
Dense Wave Division Multiplexing (DWDM)
technology provides the capability to extend the
Fibre Channel link distance. Network and disk
communication sharing DWDM links. Two and three
site configurations. VERITAS VxVM or CVM
mirroring (supported up to 100 km) Quorum
Server, arbitrator nodes or dual cluster locks
for arbitration. Extended Distance ServiceGuard
eRAC cluster configurations of 2 or 4 nodes using
VERITAS CVM, for distances of up to 10 km

• Current tests

Extended Distance ServiceGuard eRAC cluster
configurations of 2 nodes using VERITAS CVM, for
distances of up to 100 km
14
Architecture used for the tests Local
ServiceGuard Cluster with 9iRAC
15
Architecture used for the tests Extended
ServiceGuard Cluster and 9i RAC with DWDM
16
Description of tests Test Configuration

• 2 rp7410s (8 CPUs, 32GB RAM)
• 2 Tachyon XL2 FibreChannel HBAs.
• 4 ULTRA SCSI internal disks(73GB)
• 4 Fibre-based GB Ethernet interfaces
• HP-UX B.11.11 and September 2002 bundle
• ServiceGuard A.11.14.14
• ServiceGuard Extension A.11.14
• Veritas VxVM 3.5
• Veritas CVM 3.5
• Oracle 9.2.0.3 with RAC option, UDP/IPC

17
Description of tests Test Scenarios

• CR-Test micro-level benchmark.
• TPCC-like workload.
• I/O performance tests
• Failover Tests

18
More information