Semantic Video indexing

1
????????????

• ???????

2
???????

• ???708?
• ????
• ?????
• ????
• ????
• ?????????

3
Semantic Video indexing

• ??

???????????,??????,??????????????????,????
????????,?????????????????????????????????Content?

4
????
Affine Transformation
Parameter Classifier
Motion Estimation
Image frame
Knowledge Database(Bayesian Network)
Low Level Feature Detection
Semantic representation
Frame-Based Maker
5
??

• ???????????????(Object)???(Background)????????(Sem
  antic)?????,???????????(Low level feature) ?
• ?????????(Bayesian Network)????????????????,????(T
  raining)?????????????????,????????????????,???????
  ???????????(Inferring)???????????
• ??????????????

6
FGS-based scalable video coding with drift
control and selective enhancement

• MPEG-4???FGS?????????,??????????????,????Drift???,
  FGS?enhancement layer???motion prediction,????????
  ????????????????Drift???,?enhancement
  layer?????motion prediction????????
• ????,??????????????,????????temporal enhancement
  layer,??????????????

7
FGS structure

• Base layer Intra-coding
• Enhancement layer Inter-coding

8
Temporal-Scalable Coding Based on Image Content
9
Clock Synchronization for Fractal Modulation

• Fractal Modulation ????????multi-rate???,?????????
  ????????????,??wavelet transform
  ???????,??????????????????Fractal
  Modulation??????,????????????????
• ????,???????wavelet transform?????,?????????,??mul
  ti-rate system???,???????

10
Fractal Modulation

• Time and frequency diversity and multi-rate
  system
• Time-frequency portrait

11
Synchronization Technique and System Model
12
Multiple Description Coding for Wireless Image
Transmission using Multiple Antennas

• ???????multiple description coding(MDC)???????????
  ????descriptions(??transform based??????),???chann
  el coding (??error detection and correction
  code),??space-time block coding,????transmit
  antennas?????coding???descriptions?????Channel????
  ?AWGN channel??Jakes model???????????????????????
  descriptions?????Fig 1.??????????

13

• ????????descriptions??????,decoder
  output???????????????????descriptions?????channel?
  ?????descriptions ???????error??,???????multiple
  description???,???????????description???????????de
  scription,decoder output??????????????????????????
  ????????JSCC using layered coding??????,??????????
  ?

14
System Description
Channel
Tx1
Rx1
Channel Encoder
Space Time Block Encoder
Space Time Block Decoder Channel Decoder
MD Encoder
Tx2
Rx2
Source
MD Decoder
Channel Encoder
Fig 1. The system structure of multiple
description coding for wireless image transmission
using multiple antennas.
15
A Real-Time Model-Based Human Behavior Analysis
for Automatic Security Surveillance System

• ????????????(multiple views)??????????????????????
  ??????????????????????,???????????????????????????
  ????????????????????????????????????,?????????????
  ,???????????????

16
(No Transcript)
17
(No Transcript)
18
Layered FEC on multicast Network for Scalable
Video Transmission

• ?????(multicast)??????,??????????????????????,????
  ???????????,?????????????????????
• ??????????,????????(unicast)???,??????????
• ??,?????? Layered FEC multicast scheme???scalable
  video, ?????????????QoS(Quality of Service)???

19
System Block Diagram
Server
Scalable Video Source
Video Layer3
Receiver 1
Video Layer2
Layered Multicast Group
Internet
Video Layer1
MDS Code Generator
Receiver n
FEC Layer2
FEC Layer1
20
????

• ?????????,????????????????????????,??????????,????
  ????????????????,?????????,????????????????,??????
  ???????