SHF Project meeting 20050318 WP2Indexing

1
SHFProject meeting (2005/03/18)WP2-Indexing

• Geoffroy Peeters (peeters_at_ircam.fr)

2
WP2 Indexing

• Plan
• WP2.1. Audio segmentation / summary
• M1 structure
• M2 micro-structure (notes, rhythm, pattern)
• M3 audio summary
• WP2.2. M1 High-level music descriptors
• rhythm
• key
• timbre
• WP2.3. Iconic representation
• WP2.4. Source separation
• WP3.2-M3 Browsing using the high-level music
  descriptors
• WP6 M1-F1 real-time audio processing
• transposition of sources, time-stretching,
  interpolation of instruments, morphing using
  content information

3
WP2 Indexing

• WP2.1. Audio segmentation / summary
• Research
• initial algorithm (1)
• integration of tonality vector
• hierarchical subdivision
• beat-synchronous audio summary
• Development
• (1) stand-along MCR executable
• Integration
• first prototype sent to Sony

4
WP2 Indexing

• WP2.2. High-level music descriptors rhythm
• Research
• new version of time variable tempo-tracking, beat
  marking (1)
• estimation of binary/ternary subdivision
• rhythm complexity estimation
• rhythm similarity based on rhythm patterns
• Development
• part of the code (1) is now in C (1/3 file
  duration)
• (1) stand-along MCR executable
• Evaluation
• comparable to best results of ICMC2004 tempo
  induction contest
• Integration
• to be done

5
WP2 Indexing

• WP2.2. High-level music descriptors rhythm
• Binary/Ternary estimation
• Rhythm steadiness
• Rhythm complexity
• Rhythm salience

6
WP2 Indexing

• WP2.2. High-level music descriptors key/tonality
• Research
• first version of tonality vector extraction
• test using multi-pitch extraction Yeh 2004
• Development
• too early
• Integration
• too early
• Evaluation
• -
• Dissimination
• -

7
WP2 Indexing

• Planning
• WP2.1. Audio structure/audio summary
• already available MCR prototype
• finish parameters tuning
• development
• WP2.2. High-level music descriptors rhythm
• already available MCR prototype
• finish steadiness, variations
• development
• WP2.2. High-level music descriptors key/tonality
• research ongoing
• test
• development

8
WP2 Indexing