ODI for BI

1
The following is intended to outline our general
product direction. It is intended for information
purposes only, and may not be incorporated into
any contract. It is not a commitment to deliver
any material, code, or functionality, and should
not be relied upon in making purchasing
decisions.The development, release, and timing
of any features or functionality described for
Oracles products remains at the sole discretion
of Oracle.
2
(No Transcript)
3
Introduction to Oracle Data Integration - The
Raiffeisen International Success Story Mag.
Thomas Mayer, MSc. Oracle Fusion Middleware
Oracle Proprietary and Confidential DO NOT
DISTRIBUTE
4
Business Motivation
5
Everyday Data Integration ProblemsExample
End-Consumer Demand Drivers for Data Integration
Q Why do my credit card reward points take 15
days to appear on my airline website?
Q Why does this store keep sending me three of
the same catalogs every month?
Q Why cant the bank reconcile my London account
with my NY account?
6
Oracles Customer Demand DriversDemand Drivers
for Data Integration

• Oracle Customers want Unified View of Information
• Across many Heterogeneous Sources of Structured
  Unstructured Information
• Structured Information Databases Packaged
  Applications Data Warehouses
• Unstructured Information B2B Sources XML
  Sources Document Sources
• Multi-Dimensional Sources OLAP Sources
  Financial Operational Planning
• To Drive Superior Business Performance
• To Drive Better Business Intelligence with
  Unified Semantics across Transaction Systems,
  Data Warehouses Data Marts
• To Drive Financial Performance Management with
  Unified Information across Planning, Budgeting,
  Financial Consolidation Reporting Systems
• To Drive SOA-based Business Processes Composite
  Applications spanning Multiple Lines of Business
  and Functions
• To Drive Master Data Management with Unified View
  of Master Data across Transaction Systems,
  Packaged Applications, Master Data Hubs
• With Comprehensive Data Integration Foundation
• Comprehensive Complete Data Integration
  Technology Foundation
• Integrated Unified Tools Unified Metadata
  Management Unified Administration
• Pre-Integrated with Applications To Lower Cost
  Complexity of Integration

7
Data Integrator Core
8
Customer Value PropositionStrategy
Best-of-Breed Core Architecture Foundation

• Data Movement and Transformation from Multiple
  Sources to Heterogeneous Targets

BENEFITS
KEY DIFFERENTIATED FEATURES

• Performance Heterogeneous E-LT
• Flexibility Event-Driven Platform
• Productivity Declarative Design
• Open 100 Java and SOA Native
• Hot-Pluggable Knowledge Modules

9
Differentiator E-LT ArchitectureHigh Performance

• Conventional Separate ETL Server
• Proprietary ETL Engine
• Poor Performance
• High Costs for Separate Standalone Server
• IBM Informaticas approach
• Oracle No New Servers
• Lower Cost Leverage Compute Resources
  Partition Workload efficiently
• Efficient Exploits Database Optimizer
• Fast Exploits Native Bulk Load Other Database
  Interfaces
• Scalable Scales as you add Processors to Source
  or Target
• Benefits
• Optimal Performance Scalability
• Better Hardware Leverage
• Easier to Manage Lower Cost

9
10
Differentiator Declarative DesignDeveloper
Productivity Maintainability

• Conventional Specify ETL Data Flow
• Developer must define every step of Complex ETL
  Flow Logic
• Traditional approach requires specialized ETL
  skills
• Significant development maintenance cost
• Oracle Declarative Set-based Design
• Abstracts Modeling to High Level Design
• Simplifies the Number of Steps
• Automatically generates the Data Flow whatever
  the sources and target DB
• Easy to Handle Customizations eg. Extension
  Columns in ERP Schemas
• Benefits
• Significantly reduce the learning curve
• Shorter implementation times
• Streamline access to non-IT pros

10
11
Differentiator Native SOA ArchitectureNative
SOA for Evolution to Modern IT Architecture

• Conventional Monolithic/Legacy C
• Decade(s) old heavy-weight architectures
• SOA is a bolt-on not integral
• Java is a wrapper not native
• Oracle Lightweight 100 Java
• Lightweight Java Runtime
• lt36MB memory, runs on any platform
• Data Flow Steps accessible as Web Services
• Out-of-box data access services
• Published to Service Registry
• Easy to Test Deploy
• Data Transformation Services
• Deployable as SQL-Oriented Transforms
  (Structured Sources)
• Or as XSL-T Transforms
• (Unstructured Sources)
• Easy SOA Integration
• Invoke Data Flow as part of ESB
• Invoke Workflow via SOA for Error Management
  Escalation

SOA Clients Business Intelligence Web 2.0
Mashups etc.
Data Access Service
Batch DataService
Transformation Service
ODI Agent Data Flow Conductor
Staging Area
Sources
Targets
Any DB
Custom Database
Data Warehouse
CRM
Custom DB
Data
Legacy
ERP
Apps
Files / XML
Files / XML
ESB
ESB
11
12
Differentiator Flexible Error WorkflowError
Recycling, Native Integration with BPEL Human
Workflow

• Conventional Rigid/Non-Existent Workflow
• Proprietary workflow baked-in
• No workflow / 3rd party solution
• Weak integration, non-standard
• Oracle Open, Flexible Workflow
• Flexible Data Correction Workflow
• Static Constraint Checking and Validation
• Flow-based Constraint Checking and Validation
• Error Recycling
• Standards-Based Process Flow
• BPEL Process Manager / BPEL4People
• Reuse Standardized Error Handling Procedures
• Integrated with Human Workflow
• Manage Long Running Transactions
• Manage Complex Approval and Overriding Patterns

Target
StaticCheck
Sales
IntegrationProcess
Sources
Errors
Flow Check During Integration
Corrections
Errors
Error Recycling
BPEL Process Manager
Human Workflow
13
Differentiator Knowledge ModulesHot-Pluggable,
Modular, Extensible
Pluggable Knowledge Modules Architecture
Journalize Read from CDC Source
Load From Sources to Staging
Check Constraints before Load
Integrate Transform and Move to Targets
Service Expose Data and Transformation Services
Reverse Engineer Metadata
Reverse
WS
WS
WS
Staging Tables
Load
Integrate
Services
CDC
Check
Journalize
Target Tables
Sources
Error Tables
Sample out-of-the-box Knowledge Modules
SAP/R3
Log Miner
SQL Server Triggers
Oracle DBLink
JMS Queues
Check MS Excel
TPump/ Multiload
Oracle Merge
Oracle Web Services
Siebel
DB2 Journals
DB2 Exp/Imp
Check Sybase
Oracle SQLLoader
Type II SCD
Siebel EIM Schema
DB2 Web Services
Benefits

• Leverage Database Optimizations Native SQL
  Native Functions Native Loads Native Journaling
  / CDC
• Tailor to an organizations existing best
  practices
• Ease administration work
• Reduce cost of ownership

13
14
Differentiator Broad ConnectivityVariety of
Different Kinds of Systems
DB Application KMs

• IMS/DB()
• IMS/TM ()
• Software AG Natural
• Tuxedo()
• Unisys DMS 1100/2200
• VSAM()

Content Adapters

• Ariba
• AXIOM mx/open
• Baan
• BroadVision
• Clarify
• Commerce One
• Hogan Financials
• i2 Technologies
• Lawson
• Livelink
• LotusNotes
• Manugistics
• Microsoft CRM
• Vantive
• Walker Interactive
• Remedy
• Sales Force

• IDAPI
• IDS-II
• ImageSQL
• Informix()
• Ingres
• MicroFocus Cobol
• Microsoft Access
• Microsoft SQL Server()
• MUMPS
• Navision Financials
• Nucleus
• OpenIngres
• Oracle()
• Paradox
• Pointbase
• PostgreSQL
• Progress
• Quattro Pro Windows v5
• Rbase (ODBC 3.x)

• Generic SQL DB
• Oracle DB 9i
• Oracle DB 10g
• Oracle DB 10g XE
• IBM DB2/400
• IBM DB2/UDB
• IBM Informix SE
• IBM LDAP Server
• MS SQL Server 2000
• MS SQL Server 2005
• MS SQL Server 2005 SE
• MS Office Access 2000
• MS Office Excel 2000
• MS Active Directory
• Sybase ASA 8.x 9.x
• Sybase IQ 12.x
• Sonic MQ v7.0
• Teradata V2R5.x
• Teradata V2R6.x

• DEC WPS Plus
• Display Write 2, 3, 4 5
• Enable (Writer Spreadsheet)
• First Choice
• Framework
• IBM Writing Assistant
• Lotus Manuscript
• Lotus AMI/AMI Professional
• Microsoft Word Works
• MultiMate
• Novell WordPerfect
• Office Writer
• PFS Write
• Total Word
• Wang PC (IWP)
• WordMARC
• WordStar
• JustSystems Ichitaro
• JustWrite

Tech Adapters

• ActiveX
• AQ()
• COM / DCOM
• CORBA
• Email
• Flat Files()
• FTP()
• HTTP / HTTPS
• IBM MQSeries(native)
• JMS()
• Microsoft DTS
• MS MQ (Native)
• NET
• Oracle Advanced Queues
• RPG
• Socket
• Telnet
• Tibco Rendezvous (Native)

Data Adapters

• AccountMate S
• ALLBASE/SQL
• Alpha Four
• Apache Common Logfile
• BizTalk XML
• Btrieve DDF
• Clarion
• Clipper
• Cloudscape
• Data Junction Logfile
• DataEase
• DataFlex (ODBC 3.x)
• IBM DB2
• DB2/400
• DBASE
• Dialog
• Dodge Bidders
• Enable
• DB2 ()

B2B Standards

• EDI
• UCCNet
• RosettaNet
• CIDX
• PIDX
• VICS
• ebXML
• UBL
• UN/EDIFACT
• X12
• X12, Property Casualty
• X12, HIPPA
• X12N, Life Annuity
• X12N, Healthcare
• NCPDP SCRIPT
• HL7
• OAG
• cXML
• xCBL

Legacy Adapters

• Adabas
• Bull TDS
• Bull TP8
• CA-Datacom
• CA-IDMS/DB
• CA-IDMS/SQL
• C-ISAM (Informix)
• C-ISAM (Microfocus)
• C-ISAM ACCUCORP
• CICS()
• D-ISAM
• Hitachi HiRDB (ODBC)

Application Adapters

• Oracle Applications ()
• SAP()
• Peoplesoft()
• J.D.Edwards()
• Siebel()

14
15
Differentiator Changed Data CaptureEvent-Driven
Framework for Realtime Business Intelligence

• Oracle One-Click CDC
• Publish and Subscribe Framework for Changed Data
  Capture (CDC)
• Ensures read transaction integrity across
  multiple tables
• Out-of-box Log Mining and Triggers (platform
  dependent)
• Extensible to any capture technique
• Steps to Easy CDC
• Design or generate Mappings
• Select Journalized Data Only
• Start Journals

CDC
15
16
Differentiator Data QualityInline E-LT Data
Integrity Framework

• Data Integrity Firewall
• Auditing, cleansing and recycling
• Declare constraints at table level
• Design mappings and check flow integrity
• Audit, cleanse or recycle rejected records

16
16
17
ODI References
18
ODI Sample Customers
- ORACLE CONFIDENTIAL DO NOT DISTRIBUTE
19
Raiffeisen International the next ETL Generation
20
Company Background

• Raiffeisen International is among the Top 3
  companies in the ATX based on market value.
• Raiffeisen International Bank-Holding AG for the
  first time reported the highest market
  capitalization among Austria's listed companies.
• Some weeks ago Raiffeisen International surpassed
  the 13 million customer benchmark and opened in
  the Russian city Tyumen its official 3,000th
  business outlet in Central and Eastern Europe.
  With a staff of more than 61,800 Raiffeisen
  International is also a top employer among
  Austria's listed companies.
• Raiffeisen International operates one of the
  largest banking networks in CEE. 17 markets of
  Europe's growth region are covered by subsidiary
  banks, finance leasing companies, two
  representative offices and a number of other
  financial service providers.
•  

21
Company Structure
22
Business Scenario

• Information Management Competence Center (IM CC)
  formerly Data Warehouse Competence Center
• DW started 6 years ago, self developed model
  (Basel II compliant)
• Raiffeisen decided for Ascential - DataStage - 5
  years ago
• DataStage was a strategic product for Raiffeisen
  for the whole DWH. Group IT designed the DWH and
  was responsible for the roll out to 12 countries.
  
• This means about 16000 ETL Jobs for the entire
  RZB Group (local and central)
• As IBM bought DataStage Raiffeisen would have to
  buy new licenses for the latest version of IBM
  DataStage and migrate the existing jobs.
• That was the reason why Raiffeisen was also
  thinking of other ETL vendors - but not Oracle.
  Stefan Turk (prior account manager) and Johannes
  Reitermayer told the customer the story of the
  Sunopsis acquisition and the major advantages of
  our technology. 

23
Raiffeisenbank Technical Points

• Customer Situation
• Performance Issues (12 countries) with existing
  ETL Tool (IBM DataStage) at DWH data import
• Need for new DWH releases
• Need for implementation new DWH in certain
  countries
• Need to upgrade existing ETL Tool (migration and
  license costs)
• Customers Criteria for a new tool
• Better performance, better functionality
• No more manual coding
• TCO
• Support for new DWH releases and support for all
  future requirements
• Migration Path for existing solution
• Flexibility and Scalability to support growth
  into new huge markets like Russia
• Support all over EE available

24
PoC Headlines

• Databases Environment
• Oracle 10g,
• Sybase ASE 12,
• Informix,
• SQL Server 2000,
• Linux Red Hat O.S.
• Additionally, we have been requested to
• find a way to help the customer to migrate more
  than 16.000 jobs previously developed in
  Datastage!
• We came up with the idea of building an automatic
  job converter using ODI capabilities
• to generate Metadata out of XML Datastage job
  definitions (converting as much as possible
  Datastage Jobs logic to ODI Interfaces)
• Ideally this utility could be used for
• any other migration from Datastage to ODI

25
Facts Figures

• The Biggest
• ODI deal worldwide
• IBM DataStage Replacement for RZB Group
• OU deal in Austria
• The First
• ULA at Raiffeisen
• The Largest
• Contribution ever we got in EECIS for Tech from
  a product originated from an acquired company

26
Links and References

• IAS (Internal)http//ias.us.oracle.com/portal/pa
  ge?_pageid33,1704614_dadportal_schemaPORTAL
• OTN (external)http//otn.oracle.com/goto/odi
• Product Management SupportORACLEDI-PM_US_at_oracle.
  com
• Field supportORACLEDI-COMMUNITY_WW_at_oracle.com
• Forumhttp//forums.oracle.com/forums/forum.jspa?
  forumID374start0
• KMs
• http//odi.fr.oracle.com
• Product Management Wiki
• http//aseng-wiki.us.oracle.com/asengwiki/display
  /ASPMODI/OracleDataIntegratorProductManagement
  
• Tutorial VM Ware (Fusion Factory)
• http//ff.us.oracle.com/pls/htmldb/f?p10051642
  829471391505NO51P51_ID,P1000_PAGE_ID,P51_VM_IM
  AGE_ID1585,51,1585

27
(No Transcript)
28
The preceding is intended to outline our general
product direction. It is intended for information
purposes only, and may not be incorporated into
any contract. It is not a commitment to deliver
any material, code, or functionality, and should
not be relied upon in making purchasing
decisions.The development, release, and timing
of any features or functionality described for
Oracles products remains at the sole discretion
of Oracle.