CSE 460373: Multimedia Systems

1
CSE 4/60373 Multimedia Systems

• Instructor Surendar Chandra (surendar_at_nd.edu)
• Room 356C Fitz (631-8975)
• Office Hours Wed 200-300
• (other times, by email appt)
• Email/iChat/AIM is the best way to reach me
• Course Web cse.nd.edu/courses/cse40373/www
• Mailing list cse40373-01-fa06_at_listserv.nd.edu

2
Outline for today

• High level introduction to Multimedia Systems
• Course policies
• Course goals, organization and expectation
• Grading policy, late policy, reevaluation policy
• Academic honesty

3
Definition Multimedia

• Systems operating on multiple modalities text,
  audio, images, drawings, animation, video etc.
• Some would like to restrict it to systems that
  simultaneously operate on more than one
  modalities. Others are more forgiving.
• Audio/video vs video
• Sychronizing multiple modalities is hard

4
Example Multimedia Applications

• Video teleconferencing, distributed lectures,
  telemedicine, telesymphony
• White board, collaborative document editing
• Augmented reality
• DVDs, digital movies, VOIP telephony
• Networked games
• Video on demand (from cable TV, satellite etc.)
• Can you think of more applications?
• YouTube.com, founded in Feb 2005
• 100 million videos per day
• 65,000 videos being uploaded daily
• 20 Gbps?

5
What areas does Multimedia touch

• Multimedia application touches on most of the fun
  components games, movies etc. Multimedia require
  technologies from across CS, arts etc.
• Networks and Operating Systems Media objects
  have real time constraints, objects are large
• OS scheduling, storage system design, data block
  placement, network management, routing, security
  etc.
• Multimedia coding Content analysis, retrieval,
  compression, processing and security
• Multimedia tools, end systems and applications
  Hypermedia systems, user interfaces, authoring
  systems

6
Topics to be covered

• First half from the book, get people up to speed
  and then in second half discuss from papers.
• Focus on breadth rather than depth. There is way
  too much to cover as it is.
• Fundamentals of Multimedia
• Aug 24 Graphics and Image Data Representation
  and Color in Image and Video (Ch. 3 and 4)
• Aug 29 Fundamental Concepts in Video (Ch. 5)
• Aug 31 Basics of Digital Audio (Ch. 6)
• Sep 5 Basic Video Compression Techniques (Ch.
  10)
• Sep 7 MPEG Video Coding - MPEG-4, MPEG-7 (Ch. 12)

7
Multimedia Systems

• Sep 12 Quality of Service (Chapter 2)
• Sep 14 Multimedia Operating Systems (Chapter 3)
• Sep 19 Media Server (Chapter 4)
• Sep 21 Media Server (Chapter 4 cont) and
  Networks (Chapter 6.4 and 6.5)
• Sep 26 Synchronization (Chapter 8)
• Sep 28 Synchronization (Chapter 8 cont)
• Oct 3 Group communication (Chapter 7)
• Oct 5 Midterm

8
Papers

• Media storage
• Oct 10 Multimedia storage - survey
• Oct 12 Media server workload analysis (HP Labs)
• Oct 24 P2P workload
• Collaborative systems
• Oct 26 Tele-symphony (ISI)
• Oct 31 3D tele-immersion
• Nov 2 Coliseum (HP Labs) Nahrstedt visits
  department
• Video sensors
• Nov 7 Sensor enhanced Video
• Nov 9 Panophytes sensor
• Nov 14 Multi-tier camera sensors
• Nov 16 Misc - Multi-resolution video
• Online games
• Nov 21 Traffic characterization
• Nov 28 Game server selection
• Nov 30 Wireless gaming in Nintendo DS and Sony
  PSP

9
Grade distribution

• Home work assignments 2 x 10 pts
• We will have two written take home assignments,
  each in the midpoints of the first and second
  half of the class (separated by fall break)
• Home work projects 2 x 10 pts
• We will have two programming projects in the
  first half of the class
• Course project 30 pts
• You should start thinking about the course
  project from the beginning of the class, though
  you would work in earnest in the second half of
  the course. The project grade will be split
  between project contents (10 pt), project
  proposal (5 pts), final project presentation (5
  pt) and a final report (10 pt).
• Mid term exams 15 pts, Final Exams 15 pts
• in class, open book/notes affair.

10
Homework projects

• Projects are group (ideally two) efforts.
• Each project should be electronically turned in
  with a succinct report on what you learned
• Maximal freedom in trying out ideas

11
Course project

• Try out something that we learnt in class.
  Ideally, this project will be related to your
  research. I will give some suggestions. The key
  milestones are a project proposal, project status
  report, final report and presentation. If you
  need resources, let me know and we can try to
  get/purchase them.
• E.g. project I was video recording my lectures
  in ugrad OS. Other faculty in CSE and other
  departments are interested in doing this
  themselves. Storage is a big problem, these
  faculty cannot maintain web servers etc. etc. A
  challenge would be to write a p2p application,
  which works on the LAN, figures out other peers,
  and advertises the contents that they have.
  Perhaps, the faculty just copy their lectures to
  their local share and it magically shows up for
  everyone. Talk to me

12
Reevaluation policy

• Arithmetic errors, missed grading will be
  reevaluated promptly
• I encourage you to discuss concerns with your
  solution with me
• I discourage re-evaluation of partial credits
  (partial credits are based on the complexity of
  your solution and the overall class performance)
• Football penalty policy
• If you think you deserve a better partial grade,
  write down the reason why you think that you
  deserve a better grade and how many extra points
  you think you deserve. If I agree, you could get
  up to this many extra points. If I disagree, you
  will lose this much points. You can increase your
  odds by performing experiments to prove your
  answer

13
Late policy

• None Projects/homework/critiques are due at
  1230 pm (right before the beginning of class). I
  do not accept late submissions (not even a
  second)
• Please contact me regarding unforeseen emergencies

14
Academic Honesty

• Freedom of information rule
• Collaboration is acceptable (even for individual
  efforts such as take home assignments as long as
  you follow the rules of this course)
• To assure that all collaboration is on the level,
  you must always write the name(s) of your
  collaborators on your assignment. Failure to
  adequately acknowledge your contributors is at
  best a lapse of professional etiquette, and at
  worst it is plagiarism. Plagiarism is a form of
  cheating.

15
Academic Honesty Gilligans Island Rule

• This rule says that you are free to meet with
  fellow students(s) and discuss assignments with
  them. Writing on a board or shared piece of paper
  is acceptable during the meeting however, you
  may not take any written (electronic or
  otherwise) record away from the meeting. This
  applies when the assignment is supposed to be an
  individual effort. After the meeting, engage in
  half hour of mind-numbing activity (like watching
  an episode of Gilligan's Island), before starting
  to work on the assignment. This will assure that
  you are able to reconstruct what you learned from
  the meeting, by yourself, using your own brain.