TP1

1
Prototype of Cyber Teaching Assistant
Prototype of
Cyber Teaching Assistant
Yoshiaki Shindo, Hiroshi Matsuda
Nippon Institute of Technology, Japan
2
Computer Room
Teachers Cockpit
Students Workstation
Nippon Institute of Technology
Constructed by Japan Information Processing
Service Co. Ltd.
3
System Outline of CTA
Student's PC
File Server
Teacher's PC
Voice Speaking
Scenario Database
Remote Control

CTA
Local Area Network
Start CTA in student's PC with specified
scenario by remote control.
4
Cyber Teaching Assistant (CTA)
Voice speaking by Voice Synthesizer
Subtitles are displayed.
Installed in each Students PC
5
Voice Speaking
ltSPEECHgt Speech Text lt/SPEECHgt
Format
Cyber Person reads aloud the Speech Text by Voice.
Function
Examples and Tag Option Switches
ltSPEECHgtHello Everyone.lt/SPEECHgt
ltSPEECH PersonNana ScriptONgtHello
Everyone.lt/SPEECHgt
ltSCRIPT Time50gtThis is only a Caption
Text.lt/SCRIPTgt
6
Facial Expression
ltFACEgt Lyric Word lt/FACEgt
Format
Cyber Person changes the Facial Expression.
Function
Examples and Tag Option Switches
ltFACEgtHappylt/FACEgt
ltFACE TTC0,10,100,5,100,0gtAngrylt/FACEgt
ltFACE NotifySYNC TimingeStablegtAngrylt/FA
CEgt
ltFACE Gain80,30gtSurpriselt/FACEgt
7
Data Flow of Facial Expression
AU Action Unit TTCTime Transition Code
AU 60,120,260
Facial Expression Name
FEN Smile
Lyric Word Happy
8
FACS-Action Unit and TTC
Examples of FACS-AU
TTC ( Time Transition Code )
59 codes of AU are defined now.
Examples of Facial Expression
Unit of Time is 100mS
GT Gate Time TT Transition Time ST Stable
Time RT Release Time
EG Expression Gain() RG Remain Gain()



Smile Angry Sad
FACS-AU is based on the FACS by P.K.Ekmans
research.
9
Voice Speaking with Facial Expression
ltTALKgt Speech Text lt/TALKgt
Format
Cyber Person reads aloud the Speech Text by Voice
and changes the facial expression automatically
by detecting the lyric words.
Function
Examples and Tag Option Switches
Those are the same.
ltTALKgtI am very happy today.lt/TALKgt
ltSPEECHgt I am very happyltFACEgtSmilelt/FACEgt today.
lt/SPEECHgt
Option Switches of ltTALKgt are the same as one of
ltSPEECHgt
10
Body Action by BACS-AU
ltACTIONgt Action Word lt/ACTIONgt
Format
Cyber Person plays specified Body Action.
Function
Examples and Tag Option Switches
ltACTION Gain80,30gtLift up R.arm in
Frontlt/ACTIONgt
ltACTION TTC0,10,100,5,100,0gtBend R.knee
lt/ACTIONgt
ltACTION NotifySYNC TimingeTransitgt Bend
Ankles Outward lt/ACTIONgt
11
Data Flow of Body Action
BACS-AU Action Unit TTCTime Transition Code
AU 1470
Body Performance Name
(BPN)
Action Word Bend Ankles Outward
12
Body Action Coding System ( BACS )
Examples of BACS-AU
91 codes of BACS-AU are defined now.
ltACTION Gain"50,50"gtRotate Body to the
Leftlt/ACTIONgt ltACTION Gain"85,85"gtRaise Left
Arm to the Frontlt/ACTIONgt ltACTIONgtRotate Rotate
Face to the Rightlt/ACTIONgt ltACTION
Gain"35,35gtRaise Left Forearm to the
Frontlt/ACTIONgt
13
Body Action by Motion Capture
ltMOTIONgt Action Word lt/MOTIONgt
Format
Cyber Person plays specified Motion Capture data.
Function
Examples and Tag Option Switches
ltMOTIONgtBOWING lt/MOTIONgt
ltMOTION PersonEmi Repeat10gtWALKING
lt/MOTIONgt
ltMOTION NotifySYNC Rate4gtBOWING
lt/MOTIONgt
ltMOTION NotifyASYNC Rate6gtBOWING
lt/MOTIONgt
ltMOTION NotifyABORT Rate8gtBOWING
lt/MOTIONgt
14
Data Flow of Motion Capture
Motion Capture Filename
Filename Walking.csv
Body Performance Name
BPN Walking
Action Word WALKING
15
BPN Encoder
Motion Capture Data is made and edited by BPN
Encoder and data is saved in Network File Server
as a CSV format file.
Motion Capture Data CSV format File
Action Word Database
BPN Encoder
It captures the body action of human being and
edits the captured data by mouse operation.
Sophisticated body action can be played.
16
Block Notification
Unit of value is 100mS
Block Notification defines the system behavior
when CPSL browser encounters the lt/TAGgt .
17
Option Switches and State Variables
State Variables are set by Tag-Option Switches.
Scope of Variables
Value of State Variables are kept in the Block
defined by ltTAGgt and lt/TAGgt.
18
Creating Stage
ltSTAGEgt
Format
ltStagegt creates the background stage.
Function
ltSTAGE TDM_FILE"CompEr1.tdm
POSITION"600.0, -1300.0, -2200.0
ROTATION"0.0, 0.0, 0.0 SCALE"5.5, 5.5, 1.0
gt
Stage is 3D-CG model made by Modeling Tool.
3D-CG Modeling Tool
19
Texture Mapped Billboard
Rectangle of Billboard
Rotate to Face the Camera Automatically.
Axis of rotation
Mapping
Photograph, Picture or Image data of Screen
Capture.
Background Color is converted to Transparent
Pixel.
Eye(Camera) Position
Sideline of Rectangle and Axis of Rotation are
Invisible.
Easy way to create the stage .
20
Creating Cyber Person
ltPERSON Option Switches gt
3D-CG Modeling Tool
ltPERSONgt creates the Cyber Person. More than one
person can be defined. Required parameters must
be specified by Option Switches.
21
The other TAG commands
22
Scenario Database for CTA
For computer literacy course
(1)  How to use the keyboard and Mouse. (2)  How
to operate the tool bar of Word Processor. (3)
How to edit the Document (4) How to print the
document
For computer programming course

• How to use the Text Editor.
• How to edit the compile errors.
• How to edit the link errors.
• How to set the break point.

23
Conclusions

• Cyber Teaching Assistant is a self-standing 3D-CG
  Real-Time Animation Software installed in each
  students PC.
• Cyber Teaching Assistant is a Cyber Person who
  plays specified Scenario saved in the Network
  File Server.
• Scenarios are written in CPSL ( Cyber Person
  Scenario Language), which is a TAG based Script
  Language.
• Teacher can start any CTA from Teachers Cockpit
  by Remote CTA Starter.

24
Demonstration of Cyber Teaching
Assistant
Scene 1. Explains the Error Message.
Scene 2. Shows the Cause of Error.
Scene 3. Show the solution to the problem.
25
CTA Remote Starter
CTA Starter
Start Command with Scenario File Name
Cyber Teaching Assistant
Teachers Cockpit
Scenario File
Students PC
Network File Server