Information Extraction from Scientific Texts

1
Information ExtractionfromScientific Texts

• Junichi Tsujii
• Graduate School of Science
• University of Tokyo
• Japan

2
Texts are one of the major sources of information
and knowledge.
However, they are not transparent. They have to
be systematically integrated with the other
sources like data bases, numerical data, etc.
Natural Language Processing--IE
3
Overview of GENIA System
MEDLINE
Corpus Module

• Markup generation / compilation
• Annotated corpus construction

• User
• IR Request
• Abstract
• Full Paper

Security
Database Module
Concept Module

• DB design / access / management
• DB construction

• BK design / construction / compilation

4
Plan

• What is IE ?
• General Framework of NLP
• Basic IE techniques
• IE in Biology

Automatic Term Recognition (S. Ananiadou)
5
What is IE ?
6
Application Tasks of NLP
(1)Information Retrieval/Detection
To search and retrieve documents in response to
queries for information
(2)Passage Retrieval
To search and retrieve part of documents in
response to queries for information
(3)Information Extraction
To extract information that fits pre-defined
database schemas or templates, specifying the
output formats
(4) Question/Answering Tasks
To answer general questions by using texts as
knowledge base Fact retrieval, combination of IR
and IE
(5)Text Understanding
To understand texts as people do Artificial
Intelligence
7
Ranges of Queries
(1)Information Retrieval/Detection
(2)Passage Retrieval

Pre-Defined Fixed aspects of information carried
in texts
(3)Information Extraction
(4) Question/Answering Tasks
(5)Text Understanding
8
Example of IE FASTUS(1993)
9
Example of IE FASTUS(1993)
10
Example of IE FASTUS(1993)
11
Example of IE FASTUS(1993)
12
Example of IE FASTUS(1993)
13
FASTUS
Based on finite states automata (FSA)
1.Complex Words Recognition of multi-words and
proper names
set up new Twaiwan dallors
2.Basic Phrases Simple noun groups, verb groups
and particles
a Japanese trading house had set up
3.Complex phrases Complex noun groups and verb
groups
4.Domain Events Patterns for events of interest
to the application Basic templates are to be
built.
5. Merging Structures Templates from different
parts of the texts are merged if they provide
information about the same entity or event.
14
Example of IE FASTUS(1993)
15
Information Extraction
. Jurgen Pfrang, 51, reportedly stumbled upon
the robbers on the second floor of his Nanjing
home early on Sunday. The deputy general manager
of Yaxing Benz, a Sino-German joint venture that
makes buses and bus chassis in nearby
Yangzhou, was hacked to death with 45 cm
watermelon knives. .
Name of the Venture Yaxing Benz Products
buses and bus chassis Location
Yangzhou,China Companies involved
(1)Name X?
Country German
(2)Name Y?
Country China

16
Information Extraction
A German vehicle-firm executive was stabbed to
death . . Jurgen Pfrang, 51, reportedly
stumbled upon the robbers on the second floor of
his Nanjing home early on Sunday. The deputy
general manager of Yaxing Benz, a Sino-German
joint venture that makes buses and bus chassis
in nearby Yangzhou, was hacked to death with 45
cm watermelon knives. .
Crime-Type Murder Type
Stabbing The killed Name Jurgen Pfrang
Age 51
Profession Deputy general
manager Location Nanjing, China

Different template for crimes
17
Interpretation of Texts
(1)Information Retrieval/Detection
(2)Passage Retrieval

(3)Information Extraction
(4) Question/Answering Tasks
(5)Text Understanding
18
IR System
Collection of Texts
19
IR System
Collection of Texts
20
Passage IR System
Collection of Texts
21
Passage IR System
IE System
Collection of Texts
Texts
22
IE System
Templates
Texts
23
IE as compromise NLP
Interpretation
IE System
Templates
Texts
Predefined
24
Performance Evaluation
(1)Information Retrieval/Detection
(2)Passage Retrieval

(3)Information Extraction
(4) Question/Answering Tasks
(5)Text Understanding
25
Collection of Documents
26
Collection of Documents
More complicated due to partially filled
templates
27
General Framework of NLP
28
General Framework of NLP
John runs.
Morphological and Lexical Processing
Syntactic Analysis
Semantic Analysis
Context processing Interpretation
29
General Framework of NLP
John runs.
Morphological and Lexical Processing
John runs. P-N V 3-pre N
plu
Syntactic Analysis
Semantic Analysis
Context processing Interpretation
30
General Framework of NLP
John runs.
Morphological and Lexical Processing
John runs. P-N V 3-pre N
plu
S
Syntactic Analysis
NP
VP
P-N
V
Semantic Analysis
John
run
Context processing Interpretation
31
General Framework of NLP
John runs.
Morphological and Lexical Processing
John runs. P-N V 3-pre N
plu
S
Syntactic Analysis
NP
VP
P-N
V
Semantic Analysis
John
run
Context processing Interpretation
32
General Framework of NLP
John runs.
Morphological and Lexical Processing
John runs. P-N V 3-pre N
plu
S
Syntactic Analysis
NP
VP
P-N
V
Semantic Analysis
John
run
Context processing Interpretation
John is a student. He runs.
33
General Framework of NLP
Tokenization
Morphological and Lexical Processing
Part of Speech Tagging
Inflection/Derivation
Compounding
Syntactic Analysis
Term recognition (Ananiadou)
Semantic Analysis
Context processing Interpretation
Domain Analysis Appelt1999
34
Difficulties of NLP
General Framework of NLP
(1) Robustness Incomplete Knowledge
Morphological and Lexical Processing
Syntactic Analysis
Semantic Analysis
Context processing Interpretation
35
Difficulties of NLP
General Framework of NLP
(1) Robustness Incomplete Knowledge
Incomplete Lexicons Open class words
Terms Term recognition Named Entities Company
names Locations Numerical expressions
Morphological and Lexical Processing
Syntactic Analysis
Semantic Analysis
Context processing Interpretation
36
Difficulties of NLP
General Framework of NLP
(1) Robustness Incomplete Knowledge
Morphological and Lexical Processing
Incomplete Grammar Syntactic Coverage
Domain Specific Constructions
Ungrammatical Constructions
Syntactic Analysis
Semantic Analysis
Context processing Interpretation
37
Difficulties of NLP
General Framework of NLP
(1) Robustness Incomplete Knowledge
Morphological and Lexical Processing
Syntactic Analysis
Semantic Analysis
Incomplete Domain Knowledge Interpretation
Rules
Context processing Interpretation
38
Difficulties of NLP
General Framework of NLP
(1) Robustness Incomplete Knowledge
Morphological and Lexical Processing
(2) Ambiguities Combinatorial Explosion
Syntactic Analysis
Semantic Analysis
Context processing Interpretation
39
Difficulties of NLP
General Framework of NLP
(1) Robustness Incomplete Knowledge
Most words in English are ambiguous in terms of
their part of speeches. runs v/3pre, n/plu
clubs v/3pre, n/plu and two meanings
Morphological and Lexical Processing
(2) Ambiguities Combinatorial Explosion
Syntactic Analysis
Semantic Analysis
Context processing Interpretation
40
Difficulties of NLP
General Framework of NLP
(1) Robustness Incomplete Knowledge
Morphological and Lexical Processing
(2) Ambiguities Combinatorial Explosion
Syntactic Analysis
Structural Ambiguities
Predicate-argument Ambiguities
Semantic Analysis
Context processing Interpretation
41
Structural Ambiguities
(1)Attachment Ambiguities John
bought a car with large seats. John bought
a car with 3000.
The manager of Yaxing Benz, a Sino-German joint
venture The manager of Yaxing Benz, Mr. John Smith
(2) Scope Ambiguities young women and men in
the room
(3)Analytical Ambiguities Visiting
relatives can be boring.
42
Difficulties of NLP
General Framework of NLP
(1) Robustness Incomplete Knowledge
Morphological and Lexical Processing
(2) Ambiguities Combinatorial Explosion
Syntactic Analysis
Structural Ambiguities
Predicate-argument Ambiguities
Semantic Analysis
Context processing Interpretation
43
Note Ambiguities vs Robustness
More comprehensive knowledge More Robust big
dictionaries comprehensive grammar
More comprehensive knowledge More ambiguities
Adaptability Tuning, Learning
44
Framework of IE
IE as compromise NLP
45
Difficulties of NLP
General Framework of NLP
(1) Robustness Incomplete Knowledge
Morphological and Lexical Processing
Syntactic Analysis
Semantic Analysis
Incomplete Domain Knowledge Interpretation
Rules
Context processing Interpretation
46
Difficulties of NLP
General Framework of NLP
(1) Robustness Incomplete Knowledge
Morphological and Lexical Processing
Syntactic Analysis
Semantic Analysis
Incomplete Domain Knowledge Interpretation
Rules
Context processing Interpretation
47
Techniques in IE
(1) Domain Specific Partial Knowledge
Knowledge relevant to information to be extracted
(2) Ambiguities Ignoring irrelevant
ambiguities Simpler NLP techniques
(3) Robustness Coping with Incomplete
dictionaries (open
class words) Ignoring irrelevant parts of
sentences
(4) Adaptation Techniques Machine
Learning, Trainable systems
48
General Framework of NLP
Open class words Named entity recognition
(ex) Locations Persons
Companies Organizations
Position names
Morphological and Lexical Processing
Syntactic Analysis
Semantic Anaysis
Domain specific rules ltWordgtltWordgt, Inc.
Mr. ltCpt-Lgt. ltWordgt Machine Learning
HMM, Decision Trees Rules Machine Learning
Context processing Interpretation
49
FASTUS
General Framework of NLP
Based on finite states automata (FSA)
1.Complex Words Recognition of multi-words and
proper names
Morphological and Lexical Processing
2.Basic Phrases Simple noun groups, verb groups
and particles
Syntactic Analysis
3.Complex phrases Complex noun groups and verb
groups
4.Domain Events Patterns for events of interest
to the application Basic templates are to be
built.
Semantic Anaysis
Context processing Interpretation
5. Merging Structures Templates from different
parts of the texts are merged if they provide
information about the same entity or event.
50
FASTUS
General Framework of NLP
Based on finite states automata (FSA)
1.Complex Words Recognition of multi-words and
proper names
Morphological and Lexical Processing
2.Basic Phrases Simple noun groups, verb groups
and particles
Syntactic Analysis
3.Complex phrases Complex noun groups and verb
groups
4.Domain Events Patterns for events of interest
to the application Basic templates are to be
built.
Semantic Anaysis
Context processing Interpretation
5. Merging Structures Templates from different
parts of the texts are merged if they provide
information about the same entity or event.
51
FASTUS
General Framework of NLP
Based on finite states automata (FSA)
1.Complex Words Recognition of multi-words and
proper names
Morphological and Lexical Processing
2.Basic Phrases Simple noun groups, verb groups
and particles
Syntactic Analysis
3.Complex phrases Complex noun groups and verb
groups
4.Domain Events Patterns for events of interest
to the application Basic templates are to be
built.
Semantic Analysis
Context processing Interpretation
5. Merging Structures Templates from different
parts of the texts are merged if they provide
information about the same entity or event.
52
Chomsky Hierarchy Hierarchy of
Grammar of Automata Regular
Grammar Finite State
Automata Context Free Grammar
Push Down Automata Context Sensitive Grammar
Linear Bounded Automata Type 0
Grammar Turing
Machine
53
Chomsky Hierarchy Hierarchy of
Grammar of Automata Regular
Grammar Finite State
Automata Context Free Grammar Push
Down Automata Context Sensitive Grammar
Linear Bounded Automata Type 0 Grammar
Turing Machine
54
1
s
PN
Art
2
0
ADJ
N
Art
s
3
Johns interesting book with a nice cover
P
4
PN
55
1
s
PN
Art
2
0
ADJ
N
Art
s
3
Johns interesting book with a nice cover
P
4
PN
56
1
s
PN
Art
2
0
ADJ
N
Art
s
3
Johns interesting book with a nice cover
P
4
PN
57
1
s
PN
Art
2
0
ADJ
N
Art
s
3
Johns interesting book with a nice cover
P
4
PN
58
1
s
PN
Art
2
0
ADJ
N
Art
s
3
Johns interesting book with a nice cover
P
4
PN
59
1
s
PN
Art
2
0
ADJ
N
Art
s
3
Johns interesting book with a nice cover
P
4
PN
60
1
s
PN
Art
2
0
ADJ
N
Art
s
3
Johns interesting book with a nice cover
P
4
PN
61
1
s
PN
Art
2
0
ADJ
N
Art
s
3
Johns interesting book with a nice cover
P
4
PN
62
1
s
PN
Art
2
0
ADJ
N
Art
s
3
Johns interesting book with a nice cover
P
4
PN
63
1
s
PN
Art
2
0
ADJ
N
Art
s
3
Johns interesting book with a nice cover
P
4
PN
64
Pattern-maching PN s (ADJ) N P Art (ADJ) N
PN s/ Art(ADJ) N(P Art (ADJ) N)
1
s
PN
Art
2
0
ADJ
N
Art
s
3
Johns interesting book with a nice cover
P
4
PN
65
FASTUS
General Framework of NLP
Based on finite states automata (FSA)
1.Complex Words Recognition of multi-words and
proper names
Morphological and Lexical Processing
2.Basic Phrases Simple noun groups, verb groups
and particles
Syntactic Analysis
3.Complex phrases Complex noun groups and verb
groups
4.Domain Events Patterns for events of interest
to the application Basic templates are to be
built.
Semantic Analysis
Context processing Interpretation
5. Merging Structures Templates from different
parts of the texts are merged if they provide
information about the same entity or event.
66
Example of IE FASTUS(1993)
1.Complex words
2.Basic Phrases Bridgestone Sports Co.
Company name said
Verb Group Friday
Noun Group it
Noun Group had set up
Verb Group a joint venture
Noun Group in
Preposition Taiwan
Location
67
Example of IE FASTUS(1993)


1.Complex words
2.Basic Phrases Bridgestone Sports Co.
Company name said
Verb Group Friday
Noun Group it
Noun Group had set up
Verb Group a joint venture
Noun Group in
Preposition Taiwan
Location
a Japanese tea house a Japanese tea house a
Japanese tea house
68
Example of IE FASTUS(1993)
1.Complex words
2.Basic Phrases Bridgestone Sports Co.
Company name said
Verb Group Friday
Noun Group it
Noun Group had set up
Verb Group a joint venture
Noun Group in
Preposition Taiwan
Location
69
Example of IE FASTUS(1993)
3.Complex Phrases
2.Basic Phrases Bridgestone Sports Co.
Company name said
Verb Group Friday
Noun Group it
Noun Group had set up
Verb Group a joint venture
Noun Group in
Preposition Taiwan
Location
70
Example of IE FASTUS(1993)
3.Complex Phrases
2.Basic Phrases Bridgestone Sports Co.
Company name said
Verb Group Friday
Noun Group it
Noun Group had set up
Verb Group a joint venture
Noun Group in
Preposition Taiwan
Location
Some syntactic structures like
71
Example of IE FASTUS(1993)
3.Complex Phrases
2.Basic Phrases Bridgestone Sports Co.
Company name said
Verb Group Friday
Noun Group it
Noun Group had set up
Verb Group a joint venture
Noun Group in
Preposition Taiwan
Location
Syntactic structures relevant to information to
be extracted are dealt with.
72
Syntactic variations
GM set up a joint venture with Toyota. GM
announced it was setting up a joint venture with
Toyota. GM signed an agreement setting up a joint
venture with Toyota. GM announced it was signing
an agreement to set up a joint venture with
Toyota.
73
Syntactic variations
GM set up a joint venture with Toyota. GM
announced it was setting up a joint venture with
Toyota. GM signed an agreement setting up a joint
venture with Toyota. GM announced it was signing
an agreement to set up a joint venture with
Toyota.
GM plans to set up a joint venture with
Toyota. GM expects to set up a joint venture with
Toyota.
74
Syntactic variations
GM set up a joint venture with Toyota. GM
announced it was setting up a joint venture with
Toyota. GM signed an agreement setting up a joint
venture with Toyota. GM announced it was signing
an agreement to set up a joint venture with
Toyota.
S
NP
VP
GM
V
set up
GM plans to set up a joint venture with
Toyota. GM expects to set up a joint venture with
Toyota.
75
Example of IE FASTUS(1993)
3.Complex Phrases 4.Domain Events COMPANYSET-U
PJOINT-VENTUREwithCOMPNY COMPANYSET-UPJO
INT-VENTURE (others) withCOMPNY
76
Complications caused by syntactic variations
Relative clause The mayor, who was kidnapped
yesterday, was found dead today.
NG Relpro NG/others VG NG/othersVG N
G Relpro NG/others VG
77
Complications caused by syntactic variations
Relative clause The mayor, who was kidnapped
yesterday, was found dead today.
NG Relpro NG/others VG NG/othersVG N
G Relpro NG/others VG
78
Complications caused by syntactic variations
Relative clause The mayor, who was kidnapped
yesterday, was found dead today.
NG Relpro NG/others VG NG/othersVG N
G Relpro NG/others VG
79
FASTUS
Based on finite states automata (FSA)
NP, who was kidnapped, was found.
1.Complex Words
2.Basic Phrases
3.Complex phrases
4.Domain Events Patterns for events of interest
to the application Basic templates are to be
built.
5. Merging Structures Templates from different
parts of the texts are merged if they provide
information about the same entity or event.
80
FASTUS
Based on finite states automata (FSA)
NP, who was kidnapped, was found.
1.Complex Words
2.Basic Phrases
3.Complex phrases
4.Domain Events Patterns for events of interest
to the application Basic templates are to be
built.
Piece-wise recognition of basic templates
5. Merging Structures Templates from different
parts of the texts are merged if they provide
information about the same entity or event.
Reconstructing information carried via syntactic
structures by merging basic templates
81
FASTUS
Based on finite states automata (FSA)
NP, who was kidnapped, was found.
1.Complex Words
2.Basic Phrases
3.Complex phrases
4.Domain Events Patterns for events of interest
to the application Basic templates are to be
built.
Piece-wise recognition of basic templates
5. Merging Structures Templates from different
parts of the texts are merged if they provide
information about the same entity or event.
Reconstructing information carried via syntactic
structures by merging basic templates
82
Current state of the arts of IE

• Carefully constructed IE systems
• F-60 level (interannotater agreement
  60-80)
• Domain telegraphic messages about naval
  operation
• (MUC-187, MUC-289)
• news articles and
  transcriptions of radio broadcasts
• Latin American terrorism
  (MUC-391, MUC-41992)
• News articles about joint
  ventures (MUC-5, 93)
• News articles about
  management changes (MUC-6, 95)
• News articles about space
  vehicle (MUC-7, 97)
• Handcrafted rules (named entity recognition,
  domain events, etc)

Automatic learning from texts Supervised
learning corpus preparation
Non-supervised, or controlled learning
83
IE in Biology
84
CSNDB(National Institute of Health Sciences)

• A data- and knowledge- base for signaling
  pathways of human cells.
• It compiles the information on biological
  molecules, sequences, structures, functions, and
  biological reactions which transfer the cellular
  signals.
• Signaling pathways are compiled as binary
  relationships of biomolecules and represented by
  graphs drawn automatically.
• CSNDB is constructed on ACEDB and inference
  engine CLIPS, and has a linkage to TRANSFAC.
• Final goal is to make a computerized model for
  various biological phenomena.

85
Example. 1

• A Standard Reaction

Excerpted _at_Takai98

• Signal_Reaction
• EGF receptor ? Grb2
• From_molecule EGF receptor
• To_molecule Grb2
• Tissue liver
• Effect activation
• Interaction
• SH2phosphorylated Tyr
• Reference Yamauchi_1997

86
Example. 3

• A Polymerization Reaction

Excerpted _at_Takai98

• Signal_Reaction
• Ah receptor HSP90 ?
• Component Ah receptor HSP90
• Effect activation dissociation
• Interaction
• PAS domain
• of Ah receptor
• Activity
• inactivation of Ah receptor
• Reference Powell-Coffman_1998

87
FASTUS
Based on finite states automata (FSA)
1.Complex Words Recognition of multi-words and
proper names
2.Basic Phrases Simple noun groups, verb groups
and particles
3.Complex phrases Complex noun groups and verb
groups
4.Domain Events Patterns for events of interest
to the application Basic templates are to be
built.
5. Merging Structures Templates from different
parts of the texts are merged if they provide
information about the same entity or event.
88
FASTUS
Based on finite states automata (FSA)
Is separation of stages possible ?
1.Complex Words Recognition of multi-words and
proper names
2.Basic Phrases Simple noun groups, verb groups
and particles
3.Complex phrases Complex noun groups and verb
groups
4.Domain Events Patterns for events of interest
to the application Basic templates are to be
built.
5. Merging Structures Templates from different
parts of the texts are merged if they provide
information about the same entity or event.
89
FASTUS
Based on finite states automata (FSA)
Is separation of stages possible ?
1.Complex Words Recognition of multi-words and
proper names
Open word classes techical terms very
long specific formation rules many semantic
classes acronyms variants fairly
ambiguous Term recognition Coordination
across word formation A or B and C D
2.Basic Phrases Simple noun groups, verb groups
and particles
3.Complex phrases Complex noun groups and verb
groups
4.Domain Events Patterns for events of interest
to the application Basic templates are to be
built.
5. Merging Structures Templates from different
parts of the texts are merged if they provide
information about the same entity or event.
90
FASTUS
Based on finite states automata (FSA)
Is separation of stages possible ?
1.Complex Words Recognition of multi-words and
proper names
2.Basic Phrases Simple noun groups, verb groups
and particles
3.Complex phrases Complex noun groups and verb
groups
4.Domain Events Patterns for events of interest
to the application Basic templates are to be
built.
5. Merging Structures Templates from different
parts of the texts are merged if they provide
information about the same entity or event.
91
Syntax/Semantics
An active phorbol ester must therefore,
presumably by activation of protein kinase C,
cause dissociation of a cytoplasmic complex of
NF-kappa B and I kappa B by modifying I kappa B.
E1 An active phorbol ester activates protein
kinase C.
92
Syntax/Semantics
An active phorbol ester must therefore,
presumably by activation of protein kinase C,
cause dissociation of a cytoplasmic complex of
NF-kappa B and I kappa B by modifying I kappa B.
E1 An active phorbol ester activates protein
kinase C.
E2 The active phorbol ester modifies I kappa B.
93
Syntax/Semantics
An active phorbol ester must therefore,
presumably by activation of protein kinase C,
cause dissociation of a cytoplasmic complex of
NF-kappa B and I kappa B by modifying I kappa B.
E1 An active phorbol ester activates protein
kinase C.
E2 The active phorbol ester modifies I kappa B.
E3 It dissociates a cytoplasmic complex of
NF-kappa B and I kappa B.
94
Syntax/Semantics
An active phorbol ester must therefore,
presumably by activation of protein kinase C,
cause dissociation of a cytoplasmic complex of
NF-kappa B and I kappa B by modifying I kappa B.
E1 An active phorbol ester activates protein
kinase C.
E2 The active phorbol ester modifies I kappa B.
E3 It dissociates a cytoplasmic complex of
NF-kappa B and I kappa B.
Part-Whole
95
Full parser based on good grammar formalisms

• Several attempts of using full parsers
• To improve the Precision
• Systematic treatment of interaction of the
• different phases
• Unification-based grammar formalisms
• The two papers in the NLP session of PSB 2001

96
Experiment (A.Yakushiji et.al, PSB2001)
XHPSG HPSG-like Grammar translated from
XTAG of U-Penn (Y.Tateishi, TAG
workshop 98) Terms (Compound nouns) are chunked
beforehand.
Automatic conversion Detailed, empirical
comparison of grammars of
different formalisms (LFG)
97
Argument Frame Extractor
133 argument structures, marked by a domain
specialist in 97 sentences among the 180
sentences
Extracted Uniquely
31
Extracted with ambiguity
32
Extractable from pps
26
Parsing Failures
Not extractable
27
Memory limitation,etc
17
98
Ontology Knowledge of the Domain
More refined semantic classes with
part-whole relationships, properties, Etc.
Acronyms, variants, Etc.
99
Ontology Knowledge of the Domain
More refined semantic classes with
part-whole relationships, properties, Etc.
Acronyms, variants, Etc.
100
Biological ontology committee Japan organized
by T. Takagi and T. Takai, U.Tokyo in
Genome Projects of MESSC (2000.42005.3)
Bio Term Bank

• A database for all sort of biological terms
  collected from genome databases and biological
  texts.
• It will contain 2 million terms in 2001 and 5
  million terms until 2005.
• Terms are classified by biochemical and
  terminological attributes, grounded on their
  resources.

101
Ontology Knowledge of the Domain
More refined semantic classes with
part-whole relationships, properties, Etc.
Acronyms, variants, Etc.
102
GENIA ontology (current version)
-name--source--natural--organism--multi-cell
organism
-mono-cell organism
-virus
-tissue -cell type
-sub-location of cells
-artificial--cell line
-substance--compound--organic--amino-
-protein--protein family or group

-protein complex
-individual protein
molecule
-subunit of protein complex

-substructure of protein
-domain
or region of protein
-peptide
-amino acid
monomer

-nucleic--DNA--DNA family or group

-individual DNA molecule
-domain or
region of DNA

-RNA--RNA family or group

-individual RNA molecule
-domain or
region of RNA
103
Expansion of GENIA Ontology

• Try to tag all NPs in some MEDLINE abstracts and
  find the classes that appears in abstracts but
  not in current ontology
• Find frequent verbs and what class of arguments
  they take

104
Expansion of GENIA Ontology

• Chemical class of substance and their
  substrucutres
• Sources
• Biological role, or function, of substances
• Reaction
• Biological reaction
• Pathway
• Disease
• Structure themselves
• Experiment , experimental results, and
  researchers
• Measure

105
Example of Entities in Expanded

• Biological role, or function, of substances
• receptor, inhibitor,
• Biological reaction
• activation, binding, inhibition, apoptosis, G2
  arrest
• pathway, signal
• immune dysfunction, Ataxia telangiectasia (AT)
• Structure themselves
• alpha-helix,
• Experiment, experimental results, researchers
• our results, these studies, we

106
Verbs Related to Biological EventsFrequent Verbs
in 100 MEDLINE Abstracts
107
Verbs Related to Biological EventsVerbs that
take biological entities as arguments

• induce
• noun BE INDUCED BY noun activation of these
  PROTEIN was induced by PROTEIN
• noun INDUCE noun PROTEIN induced the
  tyrosine phosphorylation
• bind
• noun BIND TO noun the drugs bind to two
  different PROTEIN
• noun BIND noun motifs
  previously found to bind the cellular factors
• noun BINDING noun the
  TATA-box binding protein
• the BINDING of noun the
  binding of PROTEIN

semantic class substance structure source
experiment fact reaction
108
Verbs Related to Biological EventsVerbs that
take description entities

• report
• noun REPORT that-clause we report here that
  PROTEIN is activated by PROTEIN
• noun REPORT noun we report the
  characterization of PROTEIN
• noun REPORT noun we report a
  novel structure of PROTEIN

semantic class substance structure source
experiment fact reaction
109
Verbs Related to Biological EventsVerbs whose
arguments depend on syntactic patterns

• show
• noun BE SHOWN to-infinitive PROTEIN has been
  shown to trigger cellular PROTEIN activity
• noun SHOW that-clause the data show that
  PROTEIN stimulation is also not sufficient
• noun SHOW noun SOURCE showed a
  dose-dependent inhibition of PROTEIN activity

semantic class substance source experiment fact
110
Verbs Related to Biological EventsVerbs that
take both entities

• indicate
• noun INDICATE that-clause the data indicate
  that PROTEIN is required in CELL prolifiration
• noun INDICATE noun these findings indicate
  an unexpected role of DNA
• noun INDICATE that-clause the structure
  indicates that it represents a unique class of
  PROTEIN
• noun INDICATE noun the structure
  indicates mechanisms for allosteric effector
  action

semantic class substance structure source
experiment fact reaction role
111
Example of NE Annotation

• UI - 85146267
• TI - Characterization of ltNE ti"3"
  class"protein" nm"aldosterone binding site"
  mt"SV" subclass"family_or_group" unsure"Class"
  cmt""gtaldosterone binding siteslt/NE ti"3"gt in
  circulating ltNE ti"2" class"cell_type"
  nm"human mononuclear leukocyte" mt"SV"
  unsure"OK" cmt""gthuman mononuclear
  leukocyteslt/NE ti"2"gt.
• AB - ltNE ti"4" class"protein" nm"Aldosterone
  binding sites" mt"SV" subclass"family_or_group"
  unsure"Class" cmt""gtAldosterone binding
  siteslt/NE ti"4"gt in ltNE ti"1" class"cell_type"
  nm"human mononuclear leukocyte" mt"SV"
  unsure"OK" cmt""gthuman mononuclear
  leukocyteslt/NE ti"1"gt were characterized after
  separation of cells from blood by a Percoll
  gradient. After washing and resuspension in ltNE
  ti"5" class"other_organic_compounds"
  nm"RPMI-1640 medium" mt"SV" unsure"OK"
  cmt""gtRPMI-1640 mediumlt/NE ti"5"gt, cells were
  incubated at 37 degrees C for 1 h with different
  concentrations of ltNE ti"6" class"other_organic_
  compounds" nm"3Haldosterone" mt"SV"
  unsure"OK" cmt""gt3Haldosteronelt/NE ti"6"gt
  plus a 100-fold concentration of ltNE ti"7"
  class"other_organic_compounds" nm"RU-26988"
  mt"SV" unsure"OK" cmt""gtRU-26988 lt/NE
  ti"7"gt(ltNE ti17" class"other_organic_compounds
  " nm"11 alpha, 17 alpha-dihydroxy-17
  beta-propynylandrost-1,4,6-trien-3-one" mt"SV"
  unsure"OK" cmt""gt11 alpha, 17
  alpha-dihydroxy-17 beta-propynylandrost-1,4,6-trie
  n-3-onelt/NE ti17"gt), with or without an excess
  of unlabeled ltNE ti"8" class"other_organic_compo
  unds" nm"aldosterone" mt"SV" unsure"OK"
  cmt""gtaldosteronelt/NE ti"8"gt. ltNE ti"9"
  class"other_organic_compounds" nm"Aldosterone"
  mt"SV" unsure"OK" cmt""gtAldosteronelt/NE
  ti"9"gt binds to a single class of ltNE ti"10"
  class"protein" nm"receptor" mt"SV"
  subclass"family_or_group" unsure"OK"
  cmt""gtreceptorslt/NE ti"10"gt with an affinity of
  2.7 /- 0.5 nM (means /- SD, n 14) and a
  capacity of 290 /- 108 sites/cell (n 14). The
  specificity data show a hierarchy of affinity of
  ltNE ti"11" class"other_organic_compounds"
  nm"desoxycorticosterone" mt"SV" unsure"OK"
  cmt""gtdesoxycorticosteronelt/NE ti"11"gt ltNE
  ti"12" class"other_organic_compounds"
  nm"corticosterone" mt"SV" unsure"OK"
  cmt""gtcorticosteronelt/NE ti"12"gt ltNE ti"13"
  class"other_organic_compounds" nm"aldosterone"
  mt"SV" unsure"OK" cmt""gtaldosteronelt/NE
  ti"13"gt greater than ltNE ti"14"
  class"other_organic_compounds"
  nm"hydrocortisone" mt"SV" unsure"OK"
  cmt""gthydrocortisonelt/NE ti"14"gt greater than
  ltNE ti"15" class"other_organic_compounds"
  nm"dexamethasone" mt"SV" unsure"OK"
  cmt""gtdexamethasonelt/NE ti"15"gt. The results
  indicate that ltNE ti"17" class"cell_type"
  nm"mononuclear leukocyte" mt"SV" unsure"OK"
  cmt""gtmononuclear leukocyteslt/NE ti"17"gt could
  be useful for studying the physiological
  significance of these ltNE ti"16" class"protein"
  nm"mineralocorticoid receptor" mt"SV"
  subclass"family_or_group" unsure"OK"
  cmt""gtmineralocorticoid receptorslt/NE ti"16"gt
  and their regulation in humans.

112
Available from our website Definition of
ontological classes Manual of GMPL extention
of XML to annonate texts Manual of Text
Annotation Soon Annotated texts (1000
abstracts) by the end of March
113

• IE can contribute to Bio-informatics
  significantly.

2. However, the domains in Bio-chemistry seem
more structurally rich than the domains we have
dealt with so far. Term formation, rich
ontologies, complex syntactic structures.
3. It requires substantial efforts in resource
building.
4. However, those resources can contribute to
other applications Knowledge sharing,
Intelligent IR, Knowledge discovery
One of the crucial techniques is ATR .
114
Overview of GENIA System
MEDLINE
Corpus Module

• Markup generation / compilation
• Annotated corpus construction

• User
• IR Request
• Abstract
• Full Paper

Security
Database Module
Concept Module

• DB design / access / management
• DB construction

• BK design / construction / compilation