TimeML Annotation Tool Suite Tutorial

1
TimeML Annotation Tool Suite Tutorial

• Using Callisto and Tango for TimeML Annotation
• 10/26/04

2
The TimeML Tool Suite

• There are two tools useful for TimeML annotation
• Callisto and Tango
• Callisto
• A general annotation tool that includes a task
  for annotating time expressions, events and event
  instances, and signals
• Tango
• Specifically designed for graphical annotation of
  TimeML links

3
Installing Callisto Tango

• Callisto
• Download the file Callisto.zip
• Use java -jar to run Callisto.jar
• java -jar Callisto.jar
• You may need to do some searching to discover the
  correct path for java on the machine you are
  using

• Tango
• Download the file tango.zip
• Use java -jar to run tango-20040912.jar
• java -jar
• tango-20040912.jar

4
Opening a Document in Callisto

• To do a TimeML annotation in Callisto, we have to
  import the document
• File --gt Import
• Tango TimeML must be selected under Available
  Importers
• Once you have chosen the document you want to
  annotate, click Import

Note Simply opening a document in Callisto
doesnt allow you to do a TimeML annotation
5
Callistos Workspace

• Main Window
• Text to be annotated
• Tables for each TimeML Tag
• Switch tag tables by clicking on the name of the
  tag
• Create a new window for a tag table by clicking
  on the window icon next to the tags name
• Available Actions Panel (AAP)
• Edit -gt Show Available Actions
• Displays a new window for adding tags and
  modifying existing tags

6
Adding TimeML Tags

• Select the tags button from the AAP
• Select the button next to the name of the tag,
  not the name itself
• Switch to the correct tag table in the main
  window
• Select the text you want to annotate
• Click the name of tag in the AAP to add the tag
• Add any necessary information in the tag table

7
Creating Instances

• When you add an event, an instance of that event
  is automatically added to the MAKEINSTANCE table
• It is a good idea to add the necessary
  information to the MAKEINSTANCE table immediately
  after adding an EVENT
• Hint Open the MAKEINSTANCE table in a new window
  so you have access to it and the EVENT table at
  the same time

8
Additional Callisto Information

• Adding info to the table
• If you make a mistake when typing into a table,
  click in the box where you are typing before
  pressing delete (if you dont see the blinking
  cursor, you might accidentally erase the tag)
• Some attributes in the tag tables have drop down
  menus for their value if there is no menu, you
  must type in the correct value

• Non-tag Available Actions
• Modify Extent
• Select this button if you want to change the
  extent of a tag youve already added
• Create Instance
• Use this button to add an additional instance of
  an event

9
Leaving Callisto

• Once you are ready to add links to your
  annotation, you must export the file from
  Callisto to save your work
• Again, simply saving will not save the TimeML
  annotation
• An exported Callisto file can be opened in Tango
  to complete the TimeML annotation

10
Working in Tango

• Tango is used only to add TLINKs, SLINKs, and
  ALINKs to a document
• The values for the LINK (ex. TIMEX3, event
  instance) must be added first in Callisto
• Opening and Saving work normally in Tango
• Get started by opening your exported Callisto
  document

11
Tangos Workspace
This is the annotation from Callisto
This toolbar shows what you can do
TIMEX3s are already added and ordered for you
Unused event instances and signals appear here in
the Pending List
Draw LINKs here in the Graph Area
12
Adding Links

• Begin your annotation by moving event instances
  and/or signals to the graph area
• Use the button marked gt
• Once the tags are in the graph area, you can move
  them around the area with the Select Button
• Select the type of link from the toolbar and draw
  it in the graph area

13
Details on Adding Links

• When you draw a link, a box pops up asking for
  the specification of the link
• You only need to worry about the signalID and
  relType in this box
• If a link requires a SIGNAL, it must already be
  in the graph area to be added
• Any signals that are in this area will appear as
  choices in the signalID drop down
• Once a signal is added, it goes back to the
  pending list so it can be used again

14
Using SmartLink

• Sometimes, one event instance or TIMEX3 has a lot
  of TLINKs associated with it
• SmartLink is used to draw these TLINKs with more
  ease
• Start by moving all the tags including the focus
  tag to the graph area
• Select the SmartLink button in the toolbar and
  ctrl-click on the focus tag
• Now, simply drag other tags to the left or right
  of the focus
• Left -- BEFORE relType, Right -- AFTER relType
• If you drop a tag under the focus, the
  specification box will pop up to ask you for the
  relType you want

15
Additional Tango Features

• Many annotators arrange their graph in their own
  way while theyre working
• The arrange feature also temporally orders the
  graph based on the links you add
• It is helpful to use this feature to check on
  your annotation -- if it looks funny, you might
  have added an incorrect link

• You can hide links using the Hide/Show buttons on
  the top of the toolbar
• This helps clean up the screen while you work
• You can also use this to examine just those links
  that include particular tags by hiding all links
  and then selecting the tags you care about in the
  graph area

16
Tango Final Thoughts

• Extra Buttons
• Score -- used for inter-annotator agreement
  studies
• You should have no need of this feature in this
  assignment
• Closure -- Marcs closure algorithm integrated in
  Tango
• Again, this feature isnt required, but is pretty
  cool to look at when youre done
• GrappaView -- additional way of viewing the graph
• Requires additional software and is not needed
  for this assignment
• Save often!
• Tango can be a bit temperamental its a good
  idea to save your work often
• If you start to notice weird happenings, close
  Tango and reopen the document

17
Back to Callisto

• If you import a document that contains links from
  Tango into Callisto, the LINK tables show these
  links
• This is another way to check your work
• You cant make any changes to the links in
  Callisto, but you might notice if you made a
  mistake
• Remember import/export in Callisto, open/save in
  Tango

Good Luck!