Other Media

1
Other Media

• Challenges for document IR, where document is
  broadly defined and can be text, video, audio,
  etc.
• My aim in attending this w/shop inject IR on
  other media, esp video, into the agenda
• Of all James topic groupings, UM and
  Summarisation are most obviously closest or have
  most relevance to other media, but everywhere (as
  in any topic grouping) one can insert other
  media
• Image processing work -gt compression. Solved
  problem !
• Two important areas
• Video, and audio, are especially appropriate for
  summarisation ... because they are temporal
• Also, video is especially appropriate for the
  combination of search/browse, with emphasis on
  browse, and this is moreso than for text IR
  applications

2

Other Media

• For me, the grand challenges 10 years ...
• Video summarisation - all Dragomirs and Wessels
  issues for documents are also valid for video -
  it may be easier to do video summarisation cos
  there are more features which can be extracted
  from video, or it may be more difficult, but it
  is certainly different from text, and it is IR.
  There will be demand, and it may also use
  language modelling.
• Video search/browse this is the second of my
  long-term grand challenges which will be similar
  to, but different from, text IR. The big
  difference is that it will be easier to do
  automatic link creation among video segments,
  because it will be possible to extract far more
  features and objects from video, and this
  richer data set will be the basis for more
  sophisticated content operations.
• Other IR applications on video - QA, filtering,
  classification, testbeds, evaluation,
  cross-lingual, etc.