Adabas: Present and Future

1
Adabas Present and Future

• Your cost efficient, high performance enterprise
  database

Becky Albin Database Architect November 2003
2
Adabas, The next releases...

• The small print
• Disclaimer the material presented is not
  necessarily what will be included in the upcoming
  releases of Adabas. The next versions/releases
  are still in development, and the features listed
  are some of the ideas under investigation.
  Software AG reserves the right to change/alter
  the project development. The next version or
  release of Adabas may or may not contain some or
  all of these proposed ideas.

3
Later
Arriving in 2003
Released in 2002
Adabas 8 (2005)
Cluster Services 7.2.2

• Adabas 7.4.2 (released)

• The next major version
• Close SQL integration
• Large Object support
• Spanned records

• Adabas add-on products
• VSE,VM,OS/390 releases

• Adabas Add-ons 7.3

• 1st database to exploit IBMs 64-bit Real/Virtual
  storage architecture

Parallel Services 7.4

• Multiple update servers in a SMP environment

• Adabas VSAM Bridge 5.1

Adabas SQL Server (2005)
Adabas 3.3 (released)
Adabas 7.4.1 (OS/390,z/OS)

• Referential integrity
• Sub-transactions
• New user interface

• SQL support

Adabas Manager
Adabas SQL Server 5
Cluster Services 7.4.2

• Controlled release

Adabas 5 (2005)
Adabas 3.2
Adabas REVIEW 4.3

• Database File extents
• MU/PE occurrences
• SQL enhancements

4
2004
2005
4Q2003
Adabas SQL Server 5.1.3
Adabas 8 (Mainframe)
Transaction Manager 7.5

• Technical improvements

• The next major version
• Close SQL integration
• Large Object support
• integrated infrastructure for Adabas Manager
  options

• Bug fixes
• Improved ODBC
• Inner Join

• Cluster Services 7.5

Adabas 7.4.2 ( Add-ons)

• Technical improvements

• Bug fixes
• BS2000 OSD only other platforms already
  released

Adabas 5 (Open Systems)
Parallel Services 7.5

• The next major version
• Close SQL integration
• Increased limits
• Unicode support

• Technical improvements

Adabas SQL Server 5.2
Adabas SQL Server

• More flexible ODBC
• JDBC
• Support of additional pre-compiler dialects
• Outer, left and right Join

• Referential integrity
• Sub-transactions
• New user interface

z/OS and OS/390 available today
5
Released in 2003

• Adabas 7.4 (mainframe)
• Including add-ons, particularly
• Adabas Parallel Services (new)
• Adabas SQL Server 5.1
• As a controlled release
• Adabas 3.2 (Open Systems)
• Adabas 3.3 (Open Systems)

6
The Context
Current
Version
Adabas 7.1
Adabas 7.1
Add
-
ons
7.3
Add
-
ons
7.3
Adabas 7.4
Adabas 8
Adabas 7.4
Adabas 8
For
Sysplex
users only
Adabas 7.2
Adabas 7.2
7
7
Adabas mainframe versions

• Adabas supported versions
• Adabas v7.1.3 Released 9/2001
• (last sm for Adabas v7.1) Drops support 5/2005
• Adabas v7.2.2 Released 1/2002 IBM Parallel
  Sysplex
• Add-ons v7.3.1 Released 12/2001 - for v71/v72
• Adabas v7.4.1 Released 12/2002 (OS/390, z/OS)
• Adabas v7.4.2 Released 7/3/2003 (OS/390, z/OS)
  7/23/2003 (VSE)
• Current/Upcoming releases
• Adabas v8.1.1 tbd/1st half 2005

8
Adabas versions

• Adabas supported versions
• Adabas v6.2.3 Released 6/1999
• Dropped support 6/2001
• Adabas v7.1.2 Released 6/2000
• Dropped support 10/2002
• Adabas v7.1.3 Released 9/2001
• Drops support 5/2004
• Adabas v7.2.2 Released 1/2002 IBM Parallel
  Sysplex
• Add-ons v7.3.1 Released 12/2001 - for v71/v72
• Adabas v7.4.1 Released 12/2002 (OS/390, z/OS)
• Current/Upcoming releases
• Adabas v7.4.2 1st half 2003 (VSE,VM, OS/390,
  z/OS)
• Adabas v8.1.1 2nd half 2004

9
New since Adabas v71

• v7.1.3
• 64-bit Real Storage Exploitation
• OS/390 v2r10 ARCHLEVEL2 or z/OS 1.2 and above
• Max. 128 GB Real Storage
• 2 GB size limitation for allocation
• 64-bit Virtual Storage Exploitation
• z/OS 1.2 and above
• 2 GB size limitation removed
• data caches only
• other structures in later versions of z/OS

10
Adabas 64-bit Virtual Storage Support for High
Performance Caching

• Adabas was first !Adabas was the first database
  to exploit IBMs 64-bit Virtual Storage
  architecture for mainframes
• Availability in parallel with IBMs introduction
  of the architecture
• High Performance!!!

Main Memory
64-bit
Adabas Cache gt 2 GB
Virtual Storage
Adabas Buffer Pool max 2GB
32-bit
Adabas Cache max. 2GB
Adabas Server
Adabas Buffer Pool max. 2GB
11
Adabas Cluster Services v7.2.2

• Adabas specifically designed for IBMs Parallel
  Sysplex
• OS/390 or z/OS only
• Multiple Adabas nuclei updating/reading the same
  physical database
• Optimized performance features
• Automated peer level recovery
• Robustness
• Extensibility
• 24 x 7 availability
• Production sites
• Test sites in the U.S.
• More on this later

12
Adabas v7.4

• Re-merging of Adabas v7.1 and v7.2 code
• New SQL solution for desktop access to Adabas
• Adabas Parallel Services
• Cluster support of an Adabas DB on a single
  machine
• Multiple update nuclei
• Adabas Cluster Services
• Support for IBM Parallel Sysplex environment
• Coupling Facility used for 24 x 7 support
• Other new enhancements
• Performance, performance, performance
• Customer change enhancement requests
• Add-on product enhancements

13
Adabas v7.4

• Steps for migration from Adabas v71 to v74
• Install new Adabas v7.4 SVC
• Install Adabas add-on products
• Upgrade to new Adabas version

14
Adabas v7.4

• Fast Copy Product support
• Support the Snapshot / Flashcopy /
  TimeFinder/TDMF feature while nucleus is active
• ADADBS TRANSACTIONS SUSPEND/RESUME
• Not a replacement for ADASAV
• Enhanced Backup and Restore Performance
• Exploits IBMs large block (gt32,760 bytes)
  support for sequential access methods BDAM and
  QSAM
• OS/390 v2 r10 and above
• ADAIOR supports tape drives with a blocksizes of
  up to
• 256k for 3590 devices
• 64k for 3490/3490E devices

15
Adabas v7.4

• Hot standby
• via IBMs Automated Restart Manager (ARM)
• ADARUN ARMNAME
• Single SVC for Adabas, Parallel Services and
  Cluster Services

16
Adabas v7.4

• Adabas Cluster Services
• better performance
• more stability
• SPaTs
• Online INVERT
• Up to 8 PLOGs/CLOGs
• ADARUN NPLOGn,PLOGDEVn,PLOGSIZEn
• ADARUN NCLOGn,CLOGDEVn,CLOGSIZEn
• User Exit 12 and User Exit 2
• ADARUN PLOGRQyes/no/sel/FORCE
• LP2,000,000,000

17
Adabas v7.4

• Prefetch
• INCLUDE parameters
• PREFICMD
• PREFIFIL
• Buffer Flush change
• ASYTVSyes/no
• FMXIO1/gt1
• Support of Parallel Access Volume (PAV)
• PLOG timestamps
• 8 bytes
• Async CLOG I/Os

18
Adabas V7.4 Desktop Access to Adabas
Embedded SQL
Java
3GL 4GL
Desktop Tools
Natural
not Natural
Adabas SQL Server
Jadabas
JDBC
ODBC
Client
TCP/IP
TCP/IP
Net-Work optional
Net-Work optional
SQL Engine
Net-Work optional if different platforms
Adabas
Server
19
Adabas V7.4 Desktop Access to Adabas

• AQA v5.1 - Improved SQL Access to Adabas
• Closer integration with Adabas 7.4 and Adabas
  3.2
• One product (SQL engine, ODBC and JDBC drivers)

• AQA V5.1 Features
• Natural Date/Time support
• New Precompilers
• Cobol
• PL/1
• C
• C

• New ODBC and JDBC interfaces
• New Installation procedure
• New SQL functions
• decode
• substring
• concat
• create / drop table

20
What is Adabas Parallel Services?

• A mechanism which allows for executing an Adabas
  nucleus on each processor of a multi-engine CPU.
• All nuclei share memory via a Global Buffer Pool
  and access the same physical files.

Operating system
Update
Update
Nuc
Nuc
Global Buffer Pool
Update
Update
Nuc
Nuc
Database Disks
21
Adabas Parallel Services
22
Adabas Parallel Services Architecture
ADACSH ASSO, DATA And Work blocks
Updated Block Buffer in ESA
Update Nucleus
Update Nucleus
Update nucleus
WORK
WORK
Work
PLOG
PLOG
DATA
ASSO
PPT in Asso
23
Adabas Parallel Services Implementation

• Adabas add-on product compatibility
• Adabas Online System
• Adabas Caching Facility
• Adabas Delta Save Facility
• Adabas FastPath
• Adabas Vista
• Adabas SAF Security

24
Adabas Parallel Services Implementation

• APF authorized libraries
• ADASVC/SVCCLU
• ADACOM
• ADARUN parameters
• CLUSTERno/sysplex/local
• NUCID0-65000
• CLOGMRGno/yes
• CLUGROUPNAME
• CLUCACHESIZE
• CLULOCKSIZE
• LRDPlfiop
• DIRRATIO
• ELEMENTRATIO
• User Exit 2/12
• ADARES PLCOPY/CLCOPY and MERGE

25
Adabas Parallel Services Advantages

• Users distributed and balanced across multiple
  processors
• Increased throughput
• Better response times for all users
• No need to buy a new machine to improve
  performance
• Maximum scalability
• No changes to applications
• Close to 24 X 7 without having to go to Parallel
  Sysplex

26
IBMs Parallel Sysplex
Coupling Facility
OS/390
OS/390
OS/390
27
Adabas Cluster Services
Timer
OS/390
OS/390
Update
Update
Coupling Facility
Asynchronous merge
Work
CLOG
Work
PLOG
PLOG
CLOG
CLOG
PLOG
Asso
Data
Read / Write
Read / Write
28
The Update Nucleus
OS/390
Local Buffer Pool
Read / Write
Update Nucleus
Vector
Buffer Pool Updated Blocks
User Locks
File Locks
ISN Hold Queue
Read
Write
Coupling Facility
ASSO
PLOG
DATA
29
Cluster Example
OS/390
OS/390
Plex SVC
Plex SVC
Command Manager
Nucleus
Command Manager
Nucleus
Coupling Facility
Nucleus
Nucleus
ADARES
OS/390
OS/390
Plex SVC
Plex SVC
Command Manager
Nucleus
Command Manager
30
Adabas v8.1.1

• Adabas New Features and Change Enhancements
• Lifting of MU/PE limits
• increase to 2 bytes - 191 to 65,000 occurrences!
• Increase no. of logical file extents
• Exact number based upon ASSO blocksize
• No. of ASSO/DATA physical extents up to 99
• Remove the five-extent limits for GCB to better
  support 24x7

31
Adabas v8.1.1

• Adabas New Features and Change Enhancements
• Dynamic allocation of variable-size TEMP and SORT
  datasets to improve usability
• Support for device independence user no longer
  has to specify the DEVICE parameter
• Multi-call support
• Most all User Exits will be enhanced
• LINK routine can detect and work with databases
  on multiple SVCs

32
Adabas v8.1.1

• Adabas New Features and Change Enhancements
• Data support enhancements
• Support Large Objects (LOBs)
• Spanned records
• Extend FDT
• New field types
• Date and Time
• Use of Edit Masks
• Time example hhmm, hhmmss, hhmmss.t
• Extend FCB
• Extended Adabas Control Block and Buffers

33
Adabas v8.1.1

• Adabas New Features and Change Enhancements
• Provide Performance related information for the
  online processes i.e. Online Re-order and Online
  Invert
• Implement Error exits (ESTAE) for all utilities
  for better cleanup (after unexpected errors) and
  to simplify any needed user/support response when
  it does happen

34
Adabas v8.1.1

• Adabas New Features and Change Enhancements
• Nucleus stuff.
• Improve nucleus performance
• UQ access structure, Memory pool management(e.g.
  CQE Selection)
• Dynamic buffer re-sizing (e.g. LWP, UQ)
• Field for recording last modification to a record
• Timestamp
• Userid
• Separate Checkpoint and ET data on Checkpoint
  file

35
Adabas v8.1.1

• Adabas New Features and Change Enhancements
• Adabas SQL Server
• Referential Integrity
• ANSI Level II/III support
• Performance
• Better integration with Adabas nucleus

36
Adabas v8.1.1

• Adabas New Features and Change Enhancements
• Adabas System Manager
• Web enablement of administrative functions
• Adabas Family of products
• AOS/Review/ASF
• Workload Manager Support?
• Wireless gateway
• Adabas Cluster Services
• Performance/Stability
• Batch/Online nuclei

37
Adabas v8.1.1

• Adabas New Features and Change Enhancements
• Miscellaneous New Features...
• Integrated SQL engine in Adabas 8
• Referential integrity
• Subtransactions supported
• Adabas Cluster Services capabilities
• Transaction partitioning - separation of
  batch/online transactions
• Replication services in Adabas nucleus (replacing
  ETP)

38
Adabas Review

• Review v4.2.2
• Released June 2001
• Zaps applied - maintenance release
• Performance enhancement - transport of Adabas
  data to REVHUB not via SVC, spaced switched PC
  routine
• Main menu no longer has DC and NM (no longer
  shares user profiling system or main menu)
• Review v4.3.2
• Released August 2003
• Pulse Reporting
• Nucleus statistical data created on interval
  basis
• Cluster Service Reporting
• Monitoring extended at nucleus level per cluster
  or entire cluster
• Summary Report Exit invoked at Interval or Close
  (SMF records)
• Function to display all DBIDs per defined SVC list

39
Adabas - The Big Picture
Application

• SQL Access
• SQL Server
• (JDBC ODBC)
• Native SQL

• Web Access
• Jadabas

• Administration
• Review
• Online System
• Statistics Facility
• Adabas Manager
• Adabas Utilities

• Distribution
• Vista
• Transaction Manager
• Entire Trans. Prop.

Adabas
Adabas

• Security
• SAF Security Interface
• Adabas Security

• Text Data Management
• Text Retrieval (TRS)

• ClusterSupport
• Cluster Services
• Parallel Services

VSAM

• Migration
• VSAM Bridge
• DL/I Bridge

• Optimizers
• Fastpath
• Caching Facility
• Delta Save
• Triggers Stored Procedures

Adabas
Adabas
Adabas
40
Roadmap Open Systems
Compatibility and Comfort
Enhancing existing Functionality
2005
Version 5 Feature Enhancements
2003
Version 3.3 SQL Support
Version 3.2 Feature Enhancements
41
Adabas Open Systems versions

• Adabas supported versions
• Adabas v3.1 Drops 3/2004
• Adabas v3.2.2 Drops 12/2003
• Adabas v3.3 ?

42
Adabas Version 3.2

• The new version for
• Unix
• Windows
• New Platform
• Linux (SuSe RedHat)
• September 2002
• General Availability
• June 2002
• ..\..\..\..\Adabas\Open Systems\ADabas_OpenSystems
  _Overview.xls

43
Adabas Open Systems Platforms-Current Versions

• Open VMS/VAX
• OpenVMS AXP 7.2/7.3 v4.1.1
• Sagbase v1.2.3.1
• OpenVMS VAX 7.2 v4.1.1
• OpenVMS AXP v4.1.1
• OpenVMS VAX v4.1.1

44
Version 3.2.2 - The Details

• Sun Solaris (SPARC/ULTRASPARC)
• 7 - 32-bit support
• 8 - 64-bit support
• AIX
• 4.3.3 - 32-bit support
• 5.1 - 64-bit support
• HP-UX
• 11.0 - 32-bit support
• 11.0 - 64-bit support
• 11i
• FCS Solaris
• 7 - Prime Power 32-bit
• 8 - Prime Power 64-bit

June 2002 availability
45
Version 3.2.2 - The Details

• Windows Platforms
• Windows NT
• Windows Advance 2000
• Windows Professional 2000
• Windows Server 2000
• Windows XP Pro 32

June 2002 availability
46
Version 3.2.2 - The Details

• True64 5.1
• SCO 7.1
• Reliant Unix 5/45B

July 2002 availability
47
Version 3.2 - The Details

• Improved Backup and Restore - ADABCK
• PARALLELMULTI_PROCESS
• Significant increase of performance by using
  multiple devices in parallel
• DIRECT_PIPE
• For DUMP and RESTORE
• Requires PARALLELMULTI_PROCESS
• Output of DUMP directly into RESTORE
• FMOVE
• Reallocates file rather than attempting to
  restore to original blocks
• IOSTAT
• Prints data transfer rate and I/O times
• KEEP_FILE_ALLOC
• Added to OVERLAY
• Keeps current allocations, not what was used at
  backup time

48
Version 3.2 - The Details

• Fast Copy Product support
• ADAOPR EXT_BACKUPprepare/continue
• PLOG Printout - ADAPLP
• NODECOMPRESSED
• If DECOMPRESSED is used, each selected DATA
  record from PLOG, one line per field is printed
  with field name and decompressed value (hex)
• NOFILETYPE
• Non-file record types will be displayed (ET/BT/)

49
Version 3.2 - The Details

• Installation
• Silent install for Windows NT
• kernel driver free installation on Unix
• Parallel operation of multiple Adabas versions
• IPC driver removed
• ADANUC
• BFIO_PARALLEL_LIMIT
• Limits number of parallel I/O requests during
  buffer flush
• Similar to ASYTVS/FMXIO on mainframe

50
Version 3.2 - The Details

• Improved regenerate - ADAREC
• Individual files can be regend without locking
  DB
• Improved unload - ADAULD
• NOLITERAL
• Controls leading blanks and lower case characters
• Modification of DBID
• ADADEV NEW_DBID

51
Version 3.2 - The Details

• ADADCU - Decompress support (MU/PE)
• MUPE_OCCURRENCES
• Prints list of all MU and PE together with
  maximum occurrence
• Adadcu field AA,PA1-4,PB1-4(1-8),MM1-12
• ADACMP
• RECORD_STRUCTURERDW
• Supports data transferred from an IBM host using
  FTP rdw

52
Version 3.2 - The Details

• ADATRT
• Supports use of plain text files as private code
  pages
• In addition to the existing DLLs that can be used
• ADATRT trt.dll
• ADATRT trt.txt
• WORK 1 / 2 Blocksizes
• Allows different block sizes for Work1 and WORK2

53
Version 3.2 - The Advantages

• Increased flexibility
• Improved handling
• Significant performance improvement in the area
  of Backup / Restore
• The next step into the future

54
Adabas v3.3

• Support of new Adabas SQL Server
• CREATE/DROP TABLE
• ADD/DROP COLUMN
• GET TABLE INFO
• Support of Windows Terminal Server
• Support of multi-threaded applications
• Increase in maximum number of records per file
• 4 billion ISNs per file (unsigned 4 byte integer)
• Buffer flush changes
• LP gt 64k
• External Backups with EMCs TimeFinder
• Support Complex Transactions
• License Key Support
• Released June 2003

55
Adabas v5.1

• Scheduled for 1st qtr 2005
• Similar features as Adabas v8 for mainframe
• Increase number of occurrences for MU and Pes
• Database and File extents no longer limited
• Referential Integrity
• Subtransactions
• Date/Time formats
• Long alpha fields (16k)
• Maxfiles increased from 5000
• Unicode support
• Non-descriptor search