Sunil Mahale

1
Oracle 10g RAC on Linux with Networked
Storage-An Overview

• Sunil Mahale
• Database Storage Solutions Architect
• Network Appliance, Inc
• mahale_at_netapp.com

2
Objectives

• Oracle 10g RAC Architecture - Overview
• Why Oracle 10g RAC on Linux ?
• Oracle 10g RAC Validated Solution
• Performance Scalability
• NFS O_DIRECT enhancements in RHEL 3
• Customer Case Study
• Q A

3
Oracle 10g RAC Architecture - Overview

• Each instance
• Own SGA
• Background processes
• Data and control files are shared
• Own redo logs
• Own set of rollback/undo tablespaces
• Cache fusion
• Guarantees cache coherency
• No disk I/O costs

4
Oracle10g RAC Architecture
Shared Disk Sub-system
5
Oracle 10g RAC Architecture

• Integrated Clusterware Management (CRS)
• All nodes must be on the same OS
• Works with existing vendor clusterware
• SSI Management
• Fast Connection Failover (VIPCA)
• Zero Downtime Patching

6
CRS Architecture

• CRSD (Cluster Ready Services Daemon)
• Engine for HA operation
• Manages application resources (start, stop, fail)
• Maintains configuration profile in OCR
• OCSSD (Oracle Cluster Synchronization SD)
• Runs in RAC and single instance with ASM
• Node membership
• Group services
• Provides cluster locking
• Internode communication voting disk monitoring
• EVMD (Event Manager Daemon)
• Generates Events

7
CRS Architecture

• CRS should be installed before installing 10g RAC
• CRS_HOME ORACLE_HOME, different
• Shared location for voting disk and OCR
• Network Interfaces
• Public Interface (Node Name/Host Name)
• Private Interface (Cluster Interconnect)
• Virtual Interface (VIPCA)
• Storage Interface (Dedicated Network Interface
  for Storage)
• OraInventory cannot be shared

8
Why Oracle 10gRAC on Linux with NetApp

• Designed for shared disk
• A shared file system is built in
• Improved manageability
• Snapshot/SnapRestore
• Reduces planned downtime
• Allows for flexible upgrade/testing options
• Immediate online storage scalability
• High degree of uptime

9
Oracle 10g RAC on NFS Validated Solution

• Minimum Hardware Requirements
• Cluster Nodes
• 2 2 way, 2GB RAM Intel architecture based
  servers
• 2 Gigabit Ethernet NICs (cluster interconnect)
• 2 Gigabit Ethernet NICs (for filer i/o)
• Storage
• 1 Network Appliance filer (F2xx/F9xx)
• 1 8 port Gigabit Ethernet Switch
• 1 Gigabit Ethernet NIC
• Software Requirements
• Oracle 10g RAC Release 10.1.0.2 with RAC license
• Red Hat Enterprise Linux 3, Update 2, kernel
  2.4.21-15

10
Oracle 10g RAC Validated Solution
Public Network/VIP
10/100 Switch
eth0
eth0
eth2 heartbeat
CPQRH1
CPQRH2
Gigabit switch
eth1
eth1
Private network
e5
Dedicated Gigabit Network to the Filer Cluster
Interconnect network
11
Oracle 10g RAC - Validated Solution

• Volumes
• Volhome (Shared Oracle/CRS Home)
• Vollog (Oracle log files, control files arch
  logs)
• Voldb (Shared Oracle datafiles)
• Mount options
• rw,bg,hard,nointr,rsize32768,
• wsize32768,tcp,actimeo0,vers3
• cssfile for CRS voting disk
• ocrfile for Cluster Management utilities such as
  dbca, olsnodes, etc

12
Oracle 10g RAC - Validated Solution

• Installation Highlights (contd)
• Install and configure Oracle 10g RAC CRS
• Install Oracle 10g RAC on the cluster nodes. Do
  not create database during the install
• Enable direct IO for database, filesystemio_option
  sdirectIO
• Run netca dbca after the Oracle installation
  process
• Refer to
• www.netapp.com/tech_library/3339.html

13
Oracle RAC Validated Configurations
14

Oracle 9i RAC An Oracle White Paper
15

10g RAC Backup and Recovery

• Backups in Real Application Cluster
• Recommendations
• Separate volumes
• Accessible from all nodes
• Online redo and archive log
• Reside in a single volume
• Accessible from all the nodes
• Use NetApp snap create to take snapshots
• More details at http//www.netapp.com

16
Fast Recovery from Unplanned Downtimes

• Database Recovery Scenario - An Example
• 300 GB database
• Tape recovery time is 60 GB/hour
• Normal Recovery time is 5 hours log replay
• Recovery time with NetApp 2min log replay

Oracle 10g RAC Multiple Instances One Database
Oracle 10g RAC Database
Gigabit Ethernet
Oracle Logs
17
Case Study 8-Node 9i RAC Deployment
Load generator
Cisco Switch
8 Intel Xeon Processor based Servers running
RH3.0 AS 4 way 2GHz
Cisco Switch
18
Test environment

• Telco App A online telco app that allows a
  customer to log on and create a list of friends
  and family, they can then obtain discounts when
  phoning these numbers. The benchmark simulates
  the SQL that is generated by the mid tier. 70 of
  all transactions perform an insert or update.
• Order Entry Similar to the TPC-C benchmark.
  Simulates customers ordering products and the
  associated transactions.
• Insurance Warehouse A large star schema that
  tests scanning and aggregation performance.

19
Metric Transactions
20
Metric Node scalability
21
NFS O_DIRECT Enhancement in RHEL 3

• NFS O_DIRECT
• Bypasses file system buffer cache
• Available in RHEL 3 Update 2
• Enabling O_DIRECT
• Metalink patch for Oracle 9i (2448994)
• Set filesystemio_optionsdirectIO
• Oracle 10g Direct IO is built in

22
NFS O_DIRECT Enhancement in RHEL 3
23
Summary

• The Solution
• Oracle Oracle10g Real Application Clusters on
  RHEL 3
• Network Appliance NetApp FAS9XX/F8XX
• Linux RHEL 3.0 with DirectIO

24
(No Transcript)