Parallel Algorithms:

1
Parallel Algorithms Design and Analysis
by Shietung Peng
2
Course Information

• The field of parallel processing is concerned
  with architectural and algorithmic methods for
  enhancing performance of digital computers
  through concurrency.
• Concurrent computation has been around since the
  early days of digital computers, however, only
  recently has it been widely applied due to the
  advance in technologies.
• This course focuses on the design and analysis of
  parallel algorithms which is the core in the
  field of parallel processing.

3
Course Information (Conti.)

• The models of parallel computation range from
  very abstract (the PRAM model) to very concrete
  (the circuit model), with real parallel computers
  and user models falling between these two
  extremes.
• The PRAM models offers a simple and familiar
  programming model but is quite remote from what
  transpires at the hardware level.
• We also explore various intermediate models such
  as graphical models including linear arrays,
  rings, meshes, and hypercube-based network models.

4
Course contents

• The contents of this course are divided into the
  following four parts.
• Part I Fundamental concepts
• Part II Design of algorithms on PRAM
• Part III Design of algorithms on 2D mesh
• Part IV Design of algorithms on hypercube

5
Teaching Materials

• Lecture notes available on my website.
• There are totally 9 lecture notes.
• Each lecture note includes some exercise
  assignments.
• Reference books
• Introduction to Parallel Processing by B.
  Parhami, Plenum Press.
• Introduction to Parallel Algorithms by C.
  Xavier and S. Iyengar, John Wiley Sons, Inc.
• Introduction to Parallel Algorithms and
  Architectures by T. Leighton, MIT Press.

6
Time Table

• Part I
• Classes 1 5
• Lecture notes 1 3
• Part II
• Classes 6 7
• Lecture note 4
• Part III
• Classes 8 10
• Lecture notes 5 7
• Part IV
• Classes 11 13
• Lecture notes 8 9

7
Exercise Assignments

• There are totally eight exercise assignments, one
  per lecture note except the last one.
• Each exercise assignment includes 2 to 4
  problems.
• Working on the exercise problems will greatly
  improve your understanding on the subjects.
• The students are encouraged to submit answer file
  for each exercise assignment.
• The solutions for each exercise assignment will
  be distributed to you before starting the next
  lecture note.

8
Some Tips

• No exam.
• No project.
• Attending the classes is required. If for some
  reason, you cannot come to the class please send
  me an email before the class.
• Do exercises as much as you can.