2003 PRISM Conference

1
Public Retirement Information Systems Management
2009 PRISM Conference Portland Marriott Downtown
Waterfront Portland, Oregon 97201
Disaster Recovery Planning Business Continuity
Planning Session Leaders Lance Armstrong
LASERS Craig Lee San Francisco ERS Bob Woollen
- IMRF
2
Introduction
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Session Objectives
• General sharing of Business Continuity / Disaster
  Recovery status, successes and challenges
• Chance to benchmark your situation and possibly
  identify opportunities for improvement
• Agenda
• Brief review of their status, successes, and
  challenges Session Leaders
• Open discussion, questions, sharing successes and
  challenges All Attendees

3
Louisiana State Employees Retirement System
(LASERS)
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Independent, self-contained, stand-alone
  operation
• Active members 65,000
• Annuitants 35,000
• Employers 350
• Staff 141 / 23 in IT
• Facilities 1 main
• Contact Lance Armstrong, IT Director
  larmstro_at_lasersonline.org

4
LASERS Technology Infrastructure
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Data Center Centralized, raised floor,
  specialized fire detection / suppression,
  cooling, UPS (battery), generator backup
• Network Servers Core Pension Administration
  system
• IBM Blade Center Websites Internet/Intranet
• VMWare Other admin (Exchange, Office, etc)
• Windows Server 2003
• iSeries Midrange Imaging/Workflow (IBM Content
  Manager)
• JD Edwards ERP (Oracle)
• Storage 12 TB Storage Area Network
• Daily tape backups and off-site transfer
• Telecommunications Avaya Definity Prologic Switch
• Blackberry Enterprise Server

5
LASERS BC / DR Overview
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Formal Plans Business Continuity (obsolete)
• Disaster Recovery (current)
• Incident Response Summary (current)
• Recovery Site Contracted with SunGard
• - Recovery at Carlstadt, NJ or
• - Delivery of mobile data center and mobile
  office to location of our choosing depending
  on severity and expected duration of the
  outage
• Recovery Capability Recovery Time 24 - 48 hours
• (General) Data Loss up to 1 day
• Recovery Capability Recovery Time Dependent on
  3rd party providers
• (Investments) Data Loss None
• Records All documents (1 billion) imaged /
  backed up

6
LASERS Disaster Recovery Plan
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Owner IT Director
• Notable Contents Prioritized recovery steps
  for all platforms and applications
• Annual Testing 24 hour recovery drill
  (pre-planned)
• Payroll recovery
• Bi-Annual Testing Full recovery and key
  processing

7
LASERS Business Continuity Plan
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Owners Division Directors
• Notable Contents Key business processes and
  their recovery priority (obsolete)
• Annual Testing None

8
LASERS Incident Response Plan
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Owner Policy and Planning Section
• Notable Contents Formal response plan for
  incidents
• Detailed external crisis communications
  plan
• Specifies everyones role in detecting /
  reporting
• Annual Testing Annual review by Division
  Directors at beginning of hurricane season

9
LASERS Successes / Challenges
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Successes Disaster Recovery is a priority
• Crisis Communications Plan
• Successful yearly payroll recovery drills
• Challenges One day data loss risk
• Complex multiplatform environment
• Updating plans for new business, application,
  or technology changes
• No mandate for maintaining divisional
  continuity plans

10
San Francisco Employees Retirement System
(SFERS)
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Craig Lee
• Information Systems Manager
• craig.lee_at_sfgov.org
• 415-487-7016
• SFERS since April 2007
• Formed DR/BR committee November 2007
• Focus on basics

11
SFERS
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Oracle/PeopleSoft PenAdmin system
• Part of central IT Hot site recovery plan
• Local Apps
• For example, Document Management, Server
  applications and files, Internet applications via
  browser
• - NOT part of hot site recovery plan

12
SFERS DR/BR before
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• No evacuation procedures
• No coordinator
• Need clarification of roles/responsibilities
• Contact information out-of-date not shared
• Tapes being stored in local warehouse

13
SFERS DR/BR now
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Roles Responsibilities documented
• Scenarios documented
• Evacuation procedures practiced
• Local and out of area contacts collected and
  shared
• Phone tree created
• Offsite tape storage and regular cycle

14
Warm site
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• What about files and local systems needed for
  everyday use?
• Partnership with LACERS (Los Angeles City
  Employees Retirement System)
• IS Managers met at CALAPRS IT Roundtable
  September 2007

15
Disaster Recovery Planning Business Continuity
Planning
2009 Conference
16
Implementation
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Purchased duplicate equipment
• Providing Rack, UPS, Switch, VPN for each other
• Network design and testing
• MOU drafted and signed
• SF equipment installed March 24th
• LA equipment May or June, 2009

17
Implementation
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Initial data load at home
• Drive servers to warm site
• Nightly incremental updates
• Phase I office space for staff
• Phase II remote access from anywhere

18
SFERS future
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Business continuity procedures documented for
  each division
• Procedures practiced
• All divisions in synch
• Able to recover all business operations via Hot
  site and Warm site

19
SFERS Successes / Challenges
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Successes
• Committee formed with Senior Staff
• Many practice opportunities
• Warm site agreement and set up
• Challenges
• Business Continuity plans are low priority for
  business units

20
Open Discussion Time
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Questions / comments on presentations
• Share your successes so we can all learn
• Share your challenges perhaps someone here has
  an idea
• Find systems with similar challenges for later
  follow-up

21
Contact Information
Disaster Recovery Planning Business Continuity
Planning
2009 Conference

• Lance Armstrong - LASERS
• LARMSTRO_at_LASERSONLINE.ORG
• 225-922-2563
• Craig Lee SFERS
• CRAIG.LEE_at_SFGOV.ORG
• 415-487-7016
• Bob Woollen IMRF
• RWOOLLEN_at_IMRF.ORG
• 630-706-4251