Contamination Assessment and Reduction Program

1
Contamination Assessment andReduction Program

• DATA MANAGEMENT PLANNING
• October 6, 1997

2
CARP Data Management Plan Outline
SAMPLING LOGISTICS SUPPORT PROJECT
COMMUNICATIONS SYSTEM INTEGRATION NETWORKING
DATA VALIDATION IMPLEMENTATION SCHEDULE
RESOURCE PLAN
3
CARP Data Management Plan Goals
LOGISTICS Ensure integrity of samples/episodes,
capture all samples in DB/GIS COMMUNICATIONS
Provide PIs ready access to data knowledge of
issues INTEGRATION Make best use of
constituents existing computer
resources VALIDATION Ensure integrity,
accuracy and precision of monitoring
results PLANNING Keep data management
responsive to CARP needs
4
CARP Data Management Plan Interview
Questions
ROLES RESPONSIBILITIES SYSTEM RESOURCES DATA
RESOURCES CRITICAL SUCCESS FACTORS VALIDATION
EXPECTATIONS PROJECT MANAGEMENT PREFERENCES
5
CARP Data Management Plan Constituents
Reviewed
6
CARP Data Types
deposition
blood feathers reproductive
wet dry
5 media gt20 types 6 levels
zoo phytoplankton
whole fillets liver size
discrete TOPS xad
whole edible hepatopancreas muscle
PISCES
whole size
surficial cores physical
coefficients whole
2/97
7
CARP Data Management Planning
Goals
1. Organize compilation 2. Keep workgroup
informed 3. Ensure integrity quality 4.
Enable use access
2/97
8
CARP Logistics
Data Flow
DEC Labs 3rd?
COE DEC HEP NJ? NYC SDMTI
DEC NJ? NYC ReMAP
COE DEC HRF MC NJ?
Validation
Site Data
Analyses
GIS(es)
Database(s)
DEC 3Labs NJ? NYC
Lab Data
Modeling
Univ. USGS
MC SDMTI SUNY
in situ Data
CARP COE DEC NJ? ReMAP TAMS ?
HEP HRF NJ? Public
Publication
DEC
9
CARP Logistics
Sample Tracking
Sampling Plan SOPs
CARP Workplans
CARP names codes
Field Sampling Chain of Custody
Lab Analyses Archival
10
CARP Logistics
Chain of Custody
11
CARP Logistics
Required(?) Data to Capture
For Data Analyses Point of contact Sampling
conditions... Collection method XY
method Sample characteristics... Prep/Analysis
methods... Detection levels Replication Result
Validation findings Pertinent SOPs
For Data Integration Date Time XY Station/Tra
nsect Depth Duration Media attributes... Compo
siting Splitting
Conclusion SOPs, forms or entry screens
12
CARP Logistics
Data Flow
Validation
checks flags
Site Data
Analyses
entry forms
GIS(es)
Database(s)
auto load
Lab Data
Modeling
custom s/w
in situ Data
Publication
13
CARP Logistics Reporting
Formats
Conclusion savings, lab selection, DB
validation sites
14
CARP Logistics
Project Management
Validation
Site Data
Analyses
GIS
Central Database Server
Lab Data
Modeling
in situ Data
Publication
15
CARP Logistics Project Management
Project Management
Validation
Site Data
Analyses
GIS(s)
Database(s)
Lab Data
Modeling
in situ Data
Publication
What info needed?
Planned Collected Shipped Named Methods
Received Reported Insufficient Lost
SDG status Available Draft Final Deviations Proble
ms
Results Maps Tables Data exports
16
CARP Project Management Delivery Options
OPTION FREQ. EXCLUDES REQUIRES SAVES Conference
Calls weekly details patience travel Meetings
bimonthly breadth time, none Faxes anytime
files fax Email anytime none account,
EDI time, Website anytime feedback browser,pr
ogg time, distr. Groupware anytime none softwar
e, progg time
( significant issue)
Conclusion hybrid, selective approach
17
CARP Data Validation
Overview
Levels of Validation
18
CARP Data Validation
Validation Factors
Subjective 40
Quantitative 60
19
CARP Data Validation
Feasibility
Available in Electronic Deliverables? Quickly and
within costs? Value of automating checks vs
reporting costs Validation elements not subject
to automation Role of third party in
validation? Value of accelerated validation via
automation Should be driven by DQOs How will
workgroup decide?
Conclusion invest in upfront EDD hybrid,
selective approach
20
CARP System Integration DB
Structure Options
Wide
Normalized
Sta Date CL208 CL318 ppDDT opDDT HR1 10/7
0.21 0.44 U 1.8J HR1 12/1 0.08
0.78 0.23 2.9 HR2 10/7 U
U U U HR3...
ID Par Val Qual DL S1 cl208 0.21
0.1 S1 cl318 0.44 0.1 S1 ppddt U
0.2 S1 opddt 1.8 J 0.9 S2 cl208 0.08
0.1 S2 cl318 0.78 0.1 S2 ppddt 0.23
0.2 S2 opddt 2.9 0.9 S3 cl208
U 0.1 S3 cl318 U 0.1 S3 ppddt
U 0.2 S3 opddt U 0.9 S4...
Appendices
April 5, 1998 Striped Bass Hudson River
Sta1 Sta2 Sta3 CL208 .21 ND
... CL318 .44 ND ppDDT ND
ND opDDT 1.8J ND
December 1, 1997 Striped Bass Hudson River
Sta1 Sta2 Sta3 CL208 .21 ND
... CL318 .44 ND ppDDT ND
ND opDDT 1.8J ND
October 7, 1997 Striped Bass Hudson River
Sta1 Sta2 Sta3 CL208 .21 ND
... CL318 .44 ND ppDDT ND
ND opDDT 1.8J ND
21
CARP System Integration DB
Structures in Use
DEC
MC
NJDG
NYC
HRF
SDMTI
COE
DEP,MR
ReMAP
HEP
22
CARP System Integration
Example Interface
23
CARP System Integration Data Models
Tradeoffs
lots of records retrievals tough illegible
listings codes to plan 90º diff. from
lab computer-ish
strict sequence preset analytes few ancillary
data finite width searches tough
scattered inconsistent uncontrolled versions links
tough only local
24
CARP System Integration Architecture
Constraints
Layers of Open Systems Integration Model
DB Interfaces, Desktop GIS, HTML Browsers
Spr, DB, Servers, GIS, Stats, WP, Models. Programs
Windows, UNIX, Mac, VMS
Win95, NT, UNIX, SunOS, AppleTalk?
TCP
IP
Ethernet
25
CARP Data Management Plan Data Exchange
Options
STATIC periodic submittals desktop software
needed shipped via web or as CD NEEDS data
processing software at users meta data time
DYNAMIC remote access middleware
interfaces servers NEEDS programming networking
security flexible

Conclusion invest in access tools and data
organization
26
CARP Data Management Plan Pending
Questions
1. Can field teams incorporate CARP codes,
labels, forms? 2. What are labs capabilities and
costs to prepare electronic deliverables? 3. How
often do workgroup,PIs, public need to exchange
results? 4. Is website distribution vehicle
warranted or would static CDs suffice? 5. What
level of validation is pursuant to DQOs? Is 3rd
party necessary? 6. Which historical data sets
will be needed by investigators and modeling? 7.
Are any constituents considering new DBMS/GIS
system during CARP? 8. Which CARP products will
be distributed early, ongoing, and later? 9...