Title: Status of CDX Operations and Network Support
1Status of CDX Operations and Network Support
For the Region III State/EPA Meeting
- Connie Dwyer
- Office of Information Collection
- October 4, 2005
2Agenda
- CDX Overview
- The Exchange Network
- CDX and the Exchange Network
- New Functionalities in CDX
- Discussion
3CDX Overview
4The Central Data Exchange (CDX) Concept
- CDX was created to enable fast, efficient, and
more accurate environmental data submissions from
state and local governments, industries, and
tribes to the EPA - CDX is also the Agencys point of entry on the
Exchange Network - CDX enables EPA and other environmental
stakeholders to reduce time and money spent on
environmental reporting by providing the ability
to - Submit environmental data to EPA or other
Exchange Network stakeholders using one
centralized access point - Retrieve or exchange environmental data on a
pre-scheduled or ad hoc basis
with either EPA or other stakeholders
5CDX Exchange Mechanisms
- CDX Web EPAs site for submitting environmental
information via standard Web browsers - Users submit data via
- Web-based forms, file uploads (flat file, XML
file) - Users receive submission confirmation/processing
reports - CDX Node - EPAs Web services infrastructure on
the Exchange Network - Supports machine-to-machine data exchanges
- Standardized Web service protocols and XML
schemas used - Users are considered partners on the Exchange
Network
6Functions and Services Provided by CDX
- Registers individual users
- Provides multiple ways to register
- Supports users through a Help Desk
- Houses documentation
User Registration and Support
- Receives official copy
- Supports additional archives as needed
- Includes log of transaction
Data Archival
Submit Web Forms
Translate or Edit
Submit Web Services
Distribute
Authenticate Authorize
Validate
Receive
- Confirm Origin
- of Submission
- Supports digital signature
- Utilizes, Server Certificates or GSA Access
Certificates for Electronic Submissions (ACES)
- Translate and/or
- Edit Data
- Converts format (XML ? Flat File)
- Performs simple or complex edit checks on files
- Creates multiple / different copies
- Provides copies of record to submitter
- Capture and Log Submission Data
- Establish audit trail
- Provides receipt
- Scan for viruses
- Distribute Data to
- Target Systems
- Uses push or pull technologies
- Provides a variety of connections (e.g., VPN)
- Sends return messages and error notifications to
users at several points
EPA and Other Systems
- Perform Identity Management
- Provides access to EPA Node or Web CDX services
- Enables users to push files or CDX can pull
through Web services
Submit XML, Binary, or Flat Files
7CDX Core Services
- Basic Web Data Exchange
- Transaction Logging
- Error Handling
- Naming Directory Services
- Security/Access Controls
- Backup/recovery
- Email/notification
- Customization of My CDX Inbox
- Legacy Application Integration
- Transaction Logging
- Error Handling
- Security/Access Controls
- Data Translation
- Backup/recovery
- ID Management
- Registration
- Authentication
- Authorization
- PKI/Signature Validation
- Basic Node Data Exchange
- Transaction Logging
- Error Handling
- Naming Directory Services
- Validation
- Data Translation
- Backup/recovery
- Web Services
- Security/Access Controls
- Data Exchange
- Client
- Support Services
- Hotline technical support
- Customer service tracking and reporting
- User guides
- Training and Outreach on the CDX System
- Customer surveys
- Client support metrics
- Document Services
- Document Collection
- Data Entry/Data Capture
- Paper Diskette Processing
- Data Validation, Error Check, Reconciliation
- Data Filing/Storage
- CDX Development Services
- Flow Development Support
- - System requirements
- - XML Schema
- - Network Standards
- - Web Services
- - Test plans and test
- results
- - Flow Assessments
- Transition Planning Management
- Implementation, Operations Maintenance
- CDX Security Planning
8CDX Highights
- CDX now has a community of nearly 44,500
registered users. - Nearly 70,000 files have been submitted to CDX
over the past 12 months - Forty-nine states and nine tribes use CDX to file
environmental reports - Twenty-two data systems in Production Thirteen
others in varying stages of design, development,
or test
9Current CDX / EPA Partners
- Office of Air and Radiation (OAR)
- Office of Administration and Resource Management
(OARM) - Office of Enforcement and Compliance (OECA)
- Office of Environmental Information (OEI)
- Office of Prevention, Pesticides, and Toxic
Substances (OPPTS) - Office of Solid Waste and Emergency Response
(OSWER) - Office of Water (OW)
10Status of Systems Using CDX
- 22 data flows have been successfully implemented
- Air Quality System (AQS) (Web Submission and
Publishing, Node Submission and Publishing) - DC Fuel
- eBeaches (File Transfer, Network Exchange)
- Electronic Discharge Monitoring Report (eDMR)
- EnviroFlash
- Facility Registry System (FRS)
- Grants.gov/IGMS
- Institutional Controls Tracking System (ICTS)
(File Transfer) - Lead Notifications
- Lead Certifications with Pay.gov
- National Emission Inventory (File Transfer,
Network Exchange) - Permit Compliance System-Interim Data Exchange
Format (PCS IDEF, Pass-Through)
11Status of Systems Using CDX (contd)
- Radionuclide NESHAPS (National Emissions
Standards for Hazardous Pollutants) - Resource Conservation and Recovery Act
Information System (RCRAInfo File Transfer and
Handler Node Exchange) - Risk Management Plan Web Reporting Center
(RMPWebRC) - Safe Drinking Water Access and Review
System/Unregulated Contaminant Monitoring
Regulation (SDWARS/UCMR) - Safe Drinking Water Information System (SDWIS DTF
File Transfer and Network
Exchange) - Substance Registry System (SRS)
- Stormwater Electronic Notice of Intent
(eNOI)/Electronic Notices of
Termination (eNOT) - Toxics Release Inventory (TRI-ME, State Data
Exchange) - Toxic Substances Control Act Health and Safety
Data (TSCA HaSD) - Vehicle Environmental Reporting for You (Verify
MC/ATV)
12Status of Systems Using CDX
- 12 data flows are in Development, Test, or Design
- Automated Registration
- Electronic Inventory Update Rule (eIUR)
- Geo-Exchange (geospatial data)
- Great Lakes Node
- ICTS (Network Exchange)
- RCRA XML for permitting through CDX Web and Node
- Region 4 Data Integration with CAFO
- SDWARS/UCMR II
- SDWIS (node multi-user notifications, ODS file
request) - Water Quality Monitoring (OWWQX)
- WCIT (Water Contamination Information Tool)
- Verify HD Gas Cert
13Example of Simple CDX Web Collection Process
Central Data Exchange
NCC
External
MyCDX
Testing Labs
Collect Meta Data
CDX Firewall
Agency Firewall
HTTPS
State System
Upload
QA/Rename
Internet
CDX Login
Data from the States
Archive
State CDX Users
Federal System
FTP/SSH
Transfer
SQL
Inbox Update
SMTP E-mail
Notification
14The Exchange Network
15What is the Exchange Network?
An Internet and standards-based method for
exchanging environmental information between
partners
16What is the Exchange Network?
An Internet and standards-based method for
exchanging environmental information between
partners
- Consists of data exchanges between nodes
maintained individually by partners - Supports Internet and standards based data
exchanges between partners - Secure real-time access
- Electronic collection and storage of accurate
information - Utilizes Web Services to achieve business
objectives - More timely information
- Increased availability and flexibility
- Greater efficiency through automation
17Data Standardization is a Key to
Effective Data Exchange
- The Exchange Network publishes XML schema
standards for each exchange - Schema are developed for each exchange type
(e.g., Discharge Monitoring Report DMR data) - Schemas become part of a Data Exchange Template
- Data Exchange Templates
- Describe format of data being exchanged
- Consist of XML schema
- Draw upon industry data standards (e.g.,
Geospatial) - Reuse existing XML schema modules where possible
- Identify services to be used
- Provide exchange scheduling guidelines
18The Exchange Network Today
19Exchange Network Support
- 38 State Nodes
- 1 Tribal Node
- EPA Node Exchanges
- AQS
- E-Beaches
- EDMR
- FRS
- NEI
- PCS-IDEF
- RCRA
- SDWIS
- SRS
- TRI
20CDX and the Exchange Network
21CDXs Role in the Exchange Network
- CDX is EPAs Node on the Exchange Network
- Both a Service Provider and a Consumer
- Exchange Network Integrator
- Responsible for various integration toolkits
- Test tools
- Network Authentication and Authorization Services
(NAAS) - NAAS provides all Exchange Network Security
Services - Quality Assurance (QA) Services
- QA services include
- Data validation on received payloads
- Provides validation services for partners
22CDX Exchange Network Support
- Web services technology evaluation and
implementation - Web services are information sources and
application components that are exposed to
consumers via standards based messaging
technologies - In contrast to web sites, web services are
services offered computer-to-computer, via
defined formats and protocols, in a
platform-independent and language-neutral manner - Supports integration with internal systems and
partners - Heterogeneous systems within the agency
- Coordination with many EPA and State
partners/contractors - Exchange Network Help Desk
23CDX and Exchange Network Web Services
- CDX and the Exchange Network employ a set of
standardized services to facilitate communication
over the network - Services are documented in the Exchange Network
Specification - Authenticate, Submit, Query, GetStatus, Notify,
Solicit, Download, NodePing, GetServices - CDX and the Exchange Network also employ a
universal description, discovery and integration
(UDDI) registry service for managing CDX and
Exchange Network services - UDDI registry service manages information about
service providers, service implementations, and
service metadata - CDX and other Exchange Network Stakeholders can
use the UDDI service to
advertise the services they offer, and to
discover services offered by other partners
24CDX - Service Oriented Architecture (SOA)
- Centralized, Shareable Web Service Components
whenever possible (to reduce development and
maintenance cost) - Authentication and Authorization Services (NAAS)
- Description and Discovery Services (UDDI)
- XML Encryption/Signature Support
- Message Security (XML Gateway)
- Data Publishing/Reporting
- Quality Assurance Services
- Secure Document Exchanges (SSL)
- Web Service Management (Monitor Services)
- Internal Services Archiving, Logging, Routing,
etc. - Backend Web Service Integration Interface with
and between EPA
database systems on various platforms
25Service Oriented Architecture
Web Service Cluster Shared Services
Network Authn/Authz
Policy Management
Web Services Management
Quality Assurance
UDDI Services
E-Auth Adapter
SAML Services
Identity Management
Web Service Bus
SOAP Request
Data Validation
Node Client Component
Distribution
Service Security
Flow Dispatch
CDX Node
Workflow Management (BPEL Engine)
Task Management
Archive
Transform
26New Functionalities in CDX
27EnviroFlash
- Allows Local Air Authority Administrators to send
email alerts on Air Action Days to subscribers - Subscribers can choose to receive an Air Quality
Forecast if the Air Quality Index (AQI) goes
above a subscriber designated level - Subscribers can also choose to receive a short or
regular format email - Short format allows for easy rendering in cell
phones, pagers, or PDAs - Future Implementation will allow the reporting of
Ultraviolet Light (UV) Indices and Alerts
28EnviroFlash Local Air Authority Administrator
29EnviroFlash Notification Service Subscription
30EnviroFlash AQI Trigger Selection
31EnviroFlash E-Mail Notification
32SDWIS Reporting Services (SDWIS RS)
- Allows EPA HQ, Regions, and states access SDWIS
Fed Data - Reduced sign on functionality
- Using the NAAS and Web Services, eliminate
multiple logins between CDX and SDWIS reporting. - Establishing shared security trusts between CDX
and SDWIS.
33SDWIS Reduced Sign On
34TRI State Data Exchange
- TRI State Data Exchange meets the requirement for
dual reporting of TRI data to EPA and State
Agencies - TRI-ME electronic submissions are converted from
ASCII Flat Files to XML and then sent to
participating states via CDX Node as well as to
the EPA database
35TRI Outnode Flow Process
36For More Information
Connie Dwyer U.S. EPA - Office of Environmental
Information (202) 566-1691 dwyer.connie_at_epa.gov
www.epa.gov/cdx www.exchangenetwork.net