Prepared for

1
Learner Assessment Data Model and Authoring Tools
for Tactical Combat Casualty Care(LADMAT)
In-Process Review 1
Prepared for Joint-ADL Co Lab 16 February 2007
2
Agenda
3
Project Goals

• Create a set of data models, software components,
  and utilities that provide a standardized
  mechanism for learner assessment across a range
  of training/simulation systems.

4
Project Overview

• Specifics
• Data Models
• Event Data Schema (what)
• Event Data Protocol (how)
• Assessment Model (rules, tasks, objectives)
• Results Data Schema
• Results Data Protocol

5
Project Overview

• Specifics
• Software Components
• Simulation Interface
• Real-time
• Post-processing
• Assessment Engine
• Define rules, tasks, and learning objectives
• Define assessment logic
• Training System Interface
• LMS, AAR, other
• Real-time
• Post-processing

6
Project Overview

• Demonstration Prototypes
• Real-Time Assessment Prototype
• Based on TC3 simulation
• Deliver track simulation via LMS
• Assess performance in real-time
• Post-Processing Assessment Prototype
• Based on TC3 simulation integrated into the
  OneTESS live training system
• Disconnected training environment
• Assess performance after-the-fact

7
Existing Assessment Technologies
Simulation
Assessment
Results
LMS / AAR
8
Existing Assessment Technologies
Simulation
Simulation
Assessment
OR
Results
Evidence
LMS / AAR
LMS / AAR
Assessment
9
Challenges
Problems with existing approaches

• Tied to a specific simulation / training system
• Requires a programmer to create and update
  assessment logic
• Not adaptable to various learning environments
• Live vs. Simulated
• Real-time vs. Post-processing

10
IEEE / SISO Mickey Mouse Model
Simulation
Assessment Engine
Evidence
Results
Configure Launch
Training System (LMS / AAR)
11
LADMAT Project Components
Simulation
Assessment Engine
Event Data Schema
Event Data Schema
Configure Launch
Training System (LMS / AAR)
12
LADMAT Project Components
Simulation
Assessment Engine
Event Data Schema
Event Data Schema
Assessment Logic
Results Data Schema
Configure Launch
Training System (LMS / AAR)
13
LADMAT Project Components
Simulation
Assessment Engine
Event Data Protocol
Event Data Schema
Event Data Schema
Assessment Logic
Results Data Schema
Results Data Protocol
Configure Launch
Training System (LMS / AAR)
14
LADMAT Project Components
Simulation
Assessment Engine
Event Data Protocol
Event Data Schema
Event Data Schema
Assessment Logic
Simulation Assessment Component
Results Data Schema
Results Data Protocol
Configure Launch
Training System (LMS / AAR)
LMS/AAR Assessment Component
15
LADMAT Project Components
Simulation
Assessment Engine
Event Data Protocol
Event Data Schema
Event Data Schema
Assessment Logic
Simulation Assessment Component
Assessment Modeling Tool
Results Data Schema
Results Data Protocol
Configure Launch
Training System (LMS / AAR)
LMS/AAR Assessment Component
16
Project Schedule
17
Procedural Accomplishments

• Conducted research into existing data formats,
  standards, and technologies
• SCORM (Shareable Content Object Reference Model)
• RDF (Resource Description Framework)
• OWL (Web Ontology Language...no, not a typo!)
• XML Schema
• HLA / DIS
• Developed and delivered requirements document
  (SRD) 10/17/07

18
Technical Accomplishments

• Data Models
• Event data schema
• Event data messaging protocol
• Assessment model schema
• Software Components
• Assessment engine library
• Assessment modeling tool (GUI)
• Assessment engine client (test-bed)

19
Proto-type Demonstration
20
Upcoming Tasks

• Procedural
• Draft Software Design Document (SDD) (2/07),
  Final SDD (3/07)
• Monthly reports
• IPR 2 (7/07)
• Computer Software Product End Items (8/07)
• Final report (8/07)

21
Upcoming Tasks

• Technical
• Data Models
• Results data models
• Real-time
• Post-processing
• Software Components
• Assessment Engine
• Enhance assessment logic
• scored, state-based, switch task conditions
• Support other languages (Java, C)
• Results Interfaces
• LMS, AAR, other training systems

22
Upcoming Tasks

• Technical (cont.)
• Demonstration Prototypes
• TC3 (real-time via LMS)
• OneTESS/TC3 (post-processing via data-store)

23
CDRL Status
24

• Questions