John Demme Simha Sethumadhavan

1
John Demme Simha Sethumadhavan Columbia
University
2
Meet Joe
Smart
Joe
(Chief)?
Programmer
3
Joe Needs to Parallelize His Code
MPI?
Cell Processor?
Synchronization?
PThreads?
???
Shared Memory?
Cloud Computing?
NUMA?
SMP?
FPGA?
Transactional Memory?
StreamWare?
SSE?
CUDA?
OpenMP?
Fortran?
Occam?
GPGPU?
UPC?
Erlang?
Multi-core?
CMP?
Sisal?
4
Joe Wasn't Trained for This
Advanced Programming I Final Exam Fall
2000 Question Describe a deadlock situation. (2
pts)?
When two threads are locked in a fight to the
death?
5
Wouldnt it be nice

• If we had a system that would offer advice!
• Suggest correct compiler optimizations to use
• Provide custom code templates to start
  parallelization
• Suggest patterns for code reorganization
• Worked across different types of applications
• Worked across different languages
• Traditional machine only automation
• On going research and most desirable/ideal
  solution
• High precision analysis hindered by ambiguity
• Several engineering challenges

6
Alternative Crowd sourcing

• Use collective intelligence to solve complex
  tasks
• Leverage growth of the Internet
• How does it apply to parallelization?

7
COMPASS System

Expert Ed
Database
User Interactions with COMPASS
Guru Users
Learners
8
Bogus Charts
COMPASS Usage
9
Bogus Charts
COMPASS Extends Moore's Law
Physical Device Scaling Stops
10
Mining COMPASS(the connection, at last)?
COMPASS DB
11
Effects of COMPASS Usage (Another Bogus Chart)?
COMPASS Usage
Power Efficiency
Transistors per die
Application Speed
12
COMPASS Owners make a fortune
Gajillion Dollars
13
Chip Vendor and COMPASS Profits
COMPASS Profits
Chip Vendor Profits
14
Processor Unit, Phone Home!
10 FFTs, 5 N-Body Simulations, 2 Neural Net
Simulations, 15 PDE Solvers, 30 Garbage
Collection
14
15
I, For One, Welcome our Robotic Overlords
16
2030
OSAKA, JAPAN VIOLENCE BREAKS OUT AT COMPUTER
ARCHITECTURE PROGRAM COMMITTEE MEETING
16
17
Evolution of the Architect
2009
2035
Bob's Career
Expert Ed'sTo join the COMPASS project please
subscribe to compass_at_lists.cs.columbia.eduURL
compass.cs.columbia.edu