Grids and Biology: A Natural and Happy Pairing

1
Grids and Biology A Natural and Happy Pairing

• Rick Stevens
• Director, Mathematics and Computer Science
  Division
• Argonne National Laboratory
• Professor, Department of Computer Science
• Director, Computation Institute
• The University of Chicago
• Stevens_at_cs.uchicago.edu

2
TeraGrid 40 Gbit/s DWDM Wide Area Network
StarLight International Optical Peering
Point (see www.startap.net)
Abilene
Chicago
DTF Backbone
Indianapolis
Urbana
Los Angeles
Starlight / NW Univ
UIC
San Diego
I-WIRE
Multiple Carrier Hubs
Ill Inst of Tech
ANL
OC-48 (2.5 Gb/s, Abilene)
Univ of Chicago
Indianapolis (Abilene NOC)
Multiple 10 GbE (Qwest)
Multiple 10 GbE (I-WIRE Dark Fiber)
NCSA/UIUC

• Solid lines in place and/or available by October
  2001
• Dashed I-WIRE lines planned for summer 2002

3
TeraGrid in a Nutshell
4 Lambdas
CHI
LA
100 TB DataWulf
96 GeForce4 Graphics Pipes
32 Pentium4 52 2p Madison 20 2p Madison Myrinet
96 Pentium4 64 2p Madison Myrinet
20 TB
ANL
Caltech
ANL
256 2p Madison 667 2p Madison Myrinet
128 2p Madison 256 2p Madison Myrinet
1.1 TF Power4 Federation
500 TB FCS SAN
230 TB FCS SAN
NCSA
SDSC
PSC
4
OptIPuter Hosting on TeraGrid

• One way to think of TeraGrid is a hosting
  environment to support virtual OptIPuters
• OptIPuter can be viewed as an overlay on
  TeraGrid resources combining a collection of
  compute, data and visualization resources via
  optical networking.

5
Super Networks Enable New Applications

• Database blasting
• Gimme the whole thing and Ill sort it out at my
  end
• On-Demand caching for collaborative analysis
• Spontaneous large-scale tuple spaces.. minning
  rabbit trails
• Streaming tiled-displays (100 Megapixel
  displays)
• Super Access Grid.. Lets watch all the digital
  streams in parallel
• Deep images
• Multiresolution, navigable images, movies, gimme
  all the versions in all the formats

6
Super Network Applications

• Trickle charging shared petabyte databases
• Always up-to-date repositories (mirrors, etc.)
• Persistent objects and cooperative computation
  that extend persistent objects
• Gimme all versions of that object that ever
  existed (dump the cvs repo)
• Spontaneous peer-to-peer infrastructure
• Match the structure of infrastructure to the
  structure of social networks

7
Super Networks Require New Architectures

• Super high-bandwidth systems have high
  concurrency
• Tbps network _at_ 100x10 Gpbs, 25x40 Gbps etc.
• Large bandwidth delay products
• Non-intuitive chunking, based on compute/bdp
• Large-granularity in transactions (see previous
  page)
• Stream processing architectures
• Flow oriented services become increasingly
  important

8
Super Network Architecture Implications

• Speculation
• Super Networks create a computing and storage
  commons
• Increased used of speculation becomes possible
• Resource (commons) management
• Personal infrastructure complexity will become a
  major SW problem
• Extensions of OS concepts needed