Results of Prior NSF RI Grant: TITAN

1
Results of Prior NSF RI Grant TITAN

• David E. Culler
• Computer Science Division
• U.C. Berkeley
• NSF Site Visit
• March 2, 1998

2
Titan Agenda

• Develop a new type of system which harnesses
  breakthrough communications technology to
  integrate a large collection of commodity
  computers into a powerful resource pool that can
  be accessed directly through its constituent
  nodes or through inexpensive media stations.
• SW architecture for global operating system
• programming language support
• advanced applications
• multimedia application development

3
Results

• Constructed three prototypes, culminating in 100
  processor UltraSparc NOW
• GLUnix global operating system layer
• Active Messages providing fast, general purpose
  user-level communication
• xFS cluster file system
• Fast sockets, MPI, and SVM
• Titanium and Split-C parallel languages
• ScaLapack libraries
• Heavily used in dept. and external research
• gt instrumental in establishing clusters as a
  viable approach to large scale computing
• gt transitioning to an NPACI experimental
  resource

4
Highly Leveraged Project

• Large industrial contribution
• HP media stations
• Sun compute stations
• Sun SMPs
• Intel media stations
• Bay networks ATM, ethernet
• Enabled several federal grants
• NOW
• Titanium
• Daedalus
• Castle
• Berkeley Multimedia Research Center

5
Software Warehouse

• Coherent software environment throughout the
  research program
• Billions bytes of code
• Mirrored externally
• New SWW-NT

6
Novel Systems Design

• Virtual networks
• integrate communication events into virtual
  memory system
• Implicit Co-scheduling
• cause local schedulers to co-schedule parallel
  computations using a two-phase spin-block and
  observing round-trip
• Co-operative caching
• access remote caches, rather than local disk, and
  enlarge global cache coverage by simple
  cooperation
• Network virtual memory, fast sockets
• Large-scale Storage Clusters
• ISAAC active security
• Internet Server Architecture
• TACC Proxy architecture

7
Novel Cluster Design

• Tertiary Disk
• very low cost massive storage
• hosts archive of Museum of Fine Arts
• Pleiades Clusters
• functionally specialized storage and information
  servers
• constant back-up and restore at large scale
• NOW tore apart traditional AUSPEX servers
• CLUMPS
• cluster of SMPs with multiple NICs per node

8
Multi-Tier Networking Infrastructure

• Myrinet Cluster Interconnect
• ATM backbone
• Switched Ethernet
• Wireless

9
Applications

• Inktomi Search Engine
• World Record Disk-to_Disk store
• RSA 40-bit key
• IRAM simulations, Turbulence, AMR, Lin. Alg.
• Parallel image processing
• Protocol verification, Tempest, Bio, . . .
• Services that utilize NOW on demand
• TACC (transcoding) Proxy
• Transcend
• Wingman
• MBONE media gateway

10
Sample of 98 Degrees from Titan

• Amin Vahdat WebOS
• Steven Lumetta Multiprotocol Communication
• Wendy Heffner Multicast Communication Protocols
• Doug Ghormley Global OS
• Andrea Dusseau Implicit Co-scheduling
• Armando Fox TACC Proxy Architecture
• John Byers Fast, Reliable Bulk Communication
• Elan Amir Media Gateway
• David Bacon Compiler Optimization
• Kristen Wright Scalable web cast
• Jeanna Neefe xFS
• Steven Gribble Web caching
• Ian Goldberg Wingman
• Eshwar Balani WebOS security

11
Demo before Tour
12
UCB CSCW Class
Sigh no multicast, no bandwidth, no CSCW class...
Problem Enable heterogeneous sets of
participants to seamlessly join MBone sessions.
13
A Solution Media Gateways

• Software agents that enable local processing
  (e.g. transcoding) and forwarding of source
  streams.
• Offer the isolation of a local rate-controller
  for each source stream.
• Controlling bandwidth allocation and format
  conversion to each source prevents link
  saturation and accommodates heterogeneity.

GW
GW
14
A Solution Media Gateways
Sigh no multicast, no bandwidth, no MBone...
AHA!
MBone
Media GW