The Need for Global High Performance Networks

1
CENIC2000 Internet2 and Global Development
Institutional Impact
Michael McRobbie Vice President for Information
Technology and CIO Indiana University
2
1. The Need for Global High Performance Networks

• The tools of research and education are
  increasingly based on applications of advanced
  information technology which require access to
  distributed deep computing and data resources.
• The outputs of advanced research and education
  tools increasingly rely on advanced
  visualization.
• Advanced, unique scientific instruments must be
  available to global research communities.
• The emergence of the global research community
  requires advanced methods for supporting the
  collaboration of geographically distributed
  researchers.

3
1.a Distributed Deep Computing and Data
ResourcesThe GIOD Project
A Caltech, CERN and HP joint project addressing
data storage and access problems posed by nextgen
particle collider experiments which will start at
CERN in 2005. Data rates from online systems
will be of order 100 MBytes/sec yearly
accumulation of several PetaBytes. Raw data will
be reconstructed for particle tracks, energy
clusters, etc. in near-real time by large
processor farms (107 MIPS) based on commodity
hardware. http//pcbunn.cithep.caltech.edu/
4
Distributed Deep Computing and Data
ResourcesMaximum Likelihood Analysis Of
Phylogenetic Data
DNA data has accumulated more rapidly than
compute power so researchers must often exclude
potentially infor-mative data to make statistical
analysis practical. Utilizing the computationally
intensive maximum-likelihood method of
phylogenetic inference in a globally distributed
collection of computational nodes, Indiana
University, National University of Singapore and
ACSys CRC in Australia have analyzed the DNA of
cytoplasmic coat proteins, micro-sporidia, and
cyanobacteria.
http//www.indiana.edu/rac/hpc/cp.html
5
1.b Advanced VisualizationVirtual Pelvic Floor
Supported in part by the National Library of
Medicine and developed by researchers at
University of Illinois Chicago and Cook County
Hospital, the Virtual Pelvic Floor is a new
method of teaching the complex anatomy of the
pelvic region utilizing virtual reality and
advanced networking technology. The stereoscopic
collaborative environment is used to teach
residents and students the highly complex anatomy
and physiology of the pelvic floor.
http//www.amia.org/pubs/symposia/D005507.PDF
6
Advanced VisualizationHigh Brilliance X-ray
Crystallography for MacromolecularStructure
Determination
Virtual Reality Cave
ImmersaDesk2
Advanced Photon Source

http//www.cs.indiana.edu/ngi
7
1.c Scientific InstrumentsTrans-Pacific
Telemicroscopy
Scientists at the Osaka University Research
Center for Ultra High Voltage Electron Microscopy
(UHVEM) and University of California San Diego
National Center for Microscopy and Imaging
Research (NCMIR) successfully use international
advanced research networks to couple the world's
largest and most powerful (3 million volt)
transmission electron microscope at UHVEM to a
remote-use computer pavilion set up at NCMIR.
http//www.npaci.edu/online/v3.10/telemicroscopy.h
tml
8
Scientific InstrumentsAdvanced Photon Source
Advanced Photon Source
wide-area dissemination
desktop VR clients with shared controls
real-time collection
archival storage
tomographic reconstruction
http//epics.aps.anl.gov/welcome.html
9
1.d Advanced CollaborationSpace Physics and
Aeronomy Research Collaboratory
The Space Physics and Aeronomy Research
Collaboratory (SPARC) is an NSF-sponsored
community resource for the upper atmospheric and
space sciences operating 24 hours a day for
scientific collaboration and access to real-time
and archival data.
http//sparc-1.si.umich.edu/sparc/central
10
Advanced CollaborationNational Tele-immersion
Initiative
A telecubicle has a stereo-immersive desk surface
as well as at least two stereo-immersive walls.
These three display surfaces meet in the
formation of a desk against a corner. When linked
to others on the net, the telecubicle forms a
virtual collaborative environment.
http//io.advanced.org/tele-immersion/
11
Advanced CollaborationAccess Grid
The US Dept of Energy-sponsored Access Grid
supports human interaction across the Grid. It
consists of multimedia displays, presentation and
interaction environments, interfaces to Grid
middleware and interfaces to visualization
environments. The Access Grid supports
large-scale distributed meetings, collaborative
work sessions, seminars, lectures, tutorials and
training. The Access Grid design point is group
to group communication, complementing the
Computational Grid.
http//www-fp.mcs.anl.gov/fl/accessgrid/
12
2. Advanced Applications Require

• High bandwidth, e.g. Trans-Pacific Telemicroscopy
  requires gt 35Mbps continuous for visual display.
• Low or predictable latency, e.g. remote operation
  of scientific instrumentation requires bounded
  signaling latency.
• Bandwidth and latency contracts provided to
  applications by network QoS (quality of service)
  mechanisms.
• Advanced network services, e.g. multicast-enabled
  multipoint collaboration.

13
Advanced Applications also Require

• Application middleware services, e.g. Globus,
  which provide a basic software infrastructure
  that integrates geographically distributed
  computational and information resources.

14
3. US High Performance Research and Education
Networks

• Government agency
• ESNet - Department of Energy (1980s)
• NREN - NASA (1997)
• iDREN - Department of Defense (1996)
• Research and Education
• vBNS - NSF (1995)
• Abilene - Internet2 Project/UCAID (1998)

15
4. The vBNS

• A high-performance research and education network
  developed through cooperative agreement between
  the National Science Foundation (NSF) and MCI.
• Five year program inaugurated in 1995.
• 100 connections made as of January 2000.
• The NSF and MCIW have entered into a three-year
  no-cost extension of the cooperative agreement
  beginning April 1, 2000.
• Now offers commercial connections as vBNS.

16
5. Internet2 and Abilene

• Internet2 is a consortium of over 170
  universities, founded in 1996, working in
  partnership with industry and government to
  develop and deploy advanced network applications
  and technologies, accelerating the creation of
  tomorrow's Internet.
• Abilene is a high-performance network for higher
  education and industry collaborators within the
  U.S.
• Abilene and Internet2 are projects of the
  University Corporation for Advanced Internet
  Development (UCAID).

17
Abilene

• Abilene announced in April 1998 by VP Gore at the
  White House.
• Indiana University announced in July 1998 as the
  Network Operations Center (NOC) for Abilene.
• Abilene became operational February 1999.
• Abilene is the worlds most advanced production
  high-speed network.

18
The Abilene Project

• Abilene is a high-speed network to
• support Internet2 applications development
• provide an advanced network testbed
• demonstrate next generation operational and QoS
  capabilities
• create facilities for network research

19
Abilene Network Engineering Objectives

• Deploy a production network to support Internet2
  applications RD
• Establish network quality of service (QoS)
• Support native multicast
• Utilize GigaPoPs as effective service points

20
Abilene Partners

• University Corporation for Advanced Internet
  Development (Management)
• Qwest Inc. (Fiber)
• Cisco Inc. (Routers)
• Nortel Inc. (SONET Transmission Equipment)
• Indiana University (Network Operations Center)

21
(No Transcript)
22
Abilene Characteristics

• 10,000 miles of national backbone operating at
  2.4 Gbps (OC48) among GigaPoPs
• Connections to Abilene at 155 Mbps (OC3), 622
  Mbps (OC12), and 2.4 Gbps (OC48)
• Packet/IP over Sonet technology (PoS)

23
Access to Abilene Backbone

• Access Nodes are very close to almost all of the
  university GigaPoPs
• Access Nodes are located at Qwest PoPs
• Currently there are 131 Access Nodes
• will grow as Qwest SONET plant grows

24
Abilene Access Nodes
Seattle
Cleveland
Sacramento
New York
Denver
Indianapolis
Kansas City
Los Angeles
Atlanta
Abilene Core Node
Houston
Abilene Access Node
Operational January 1999
25
Abilene Services

• Current
• High Performance (best effort) IPv4
• Performance Measurement
• Multicast
• IPv6
• Future
• QoS via DiffServ (QBone)
• Voice over IP (VoIP)

26
Networks Peering with Abilene

• National Research Networks
• vBNS ESNET NREN
• iDREN
• International Research Networks
• CAnet APAN/TransPAC NORDUnet
• SURFnet DANTE JANET
• RENATER NII (SINET) SingAREN
• Tanet IUCC

27
The Abilene Network Operations Center

• Operated by Indiana University
• Housed at IUPUI (Indianapolis)
• Core engineering team from IU Bloomington IUPUI
• Co-located with the IU, TransPAC, STAR TAP and
  Euro-Link NOCs
• 7 x 24 Operation
• Dedicated front-line operators
• Engineers on duty
• To be located in the new Communications
  Technology Complex at IUPUI
• http//www.abilene.iu.edu

28
The Abilene NOC Weather Map
http//hydra.uits.iu.edu/abilene/traffic/abilene.
html
29
6. STAR TAP HPIISGlobal High-Performance
Research Education Networking

• The growth of international scientific
  collaborations leads to requirement for global
  data communications infrastructure on par with
  what is available domestically.
• The Science, Technology, And Research Transit
  Access Point (STAR TAP) is persistent
  infrastructure funded by the NSF to facilitate
  the interconnection and interoperability of
  advanced international networking and
  applications. STAR TAP anchors the NSF
  international connections program (HPIIS)
  networks.

30
STAR TAP HPIISGlobal High-Performance Research
Education Networking

• The NSF HPIIS (High Performance International
  Internet Services) program solicited
  international connections to provide the basis
  for advanced network support of international
  collaboration in research and education.
• STAR TAP provides a common interconnection point,
  HPIIS provides the links to global high
  performance research and education networks

31
International Network Operations Center at
Indiana University
http//noc.startap.net
32
International Network Operations Center at
Indiana University

• IU manages the TransPAC HPIIS project
• http//www.transpac.org
• and provides centralized NOC and engineering for
  STAR TAP and the Euro-Link and MIRnet HPIIS
  networks
• http//noc.startap.net
• The International Networks NOC is fully
  integrated with the Abilene NOC
• http//www.abilene.iu.edu

33
International Network Operations Center at
Indiana University

• International and Abilene NOC services include
• Problem management
• Network monitoring
• Change management
• Documentation
• Reports
• Security management
• Engineering
• Testing evaluation

34
STAR TAP Logical Map
35
STAR TAP Physical Architecture
36
HPIIS Networks TransPAClinking APAN (Asia
Pacific Advanced Network)
37
HPIIS Networks MIRnetlinking Russia
38
HPIIS Networks Euro-Linklinking European
National Research Networks

• CERN
• European Laboratory for Particle Physics
• IUCC
• Israel Inter-University Computation Center
• NORDUnet
• Nordic Countries' National Networks for Research
  and Education
• RENATER2
• France Research and Education Network
• SURFnet
• The Netherlands Research and Education Network

39
HPIIS Meets Internet2 The Distributed STAR TAP

• The original STAR TAP architecture of a single
  interconnection point in Chicago is expected to
  evolve to a distributed model supporting multiple
  international connecting points.
• Internet2/Abilene is expected to offer transit of
  international traffic to provide the underpinning
  of the distributed STAR TAP.

40
HPIIS Meets Internet2 The Old Model
41
HPIIS Meets Internet2 The Distributed STAR TAP
STAR TAP / NGIX-NORTH Abilene, CAnet3, TransPAC,
vBNS, CERN, SURFnet, ESnet, MIRnet, SINET, DREN,
RENATER, SingAREN, NREN, TAnet, NORDUnet, IUCC
and GEMnet
NGIX-WEST Abilene SingAREN TransPAC 2001(?)
NGIX-EAST Abilene, vBNS, DFN, JAnet, ESnet,
SURFnet, INFN, NORDUnet, DANTE, CAnet3
42
7. Institutional ImpactExploiting Internet2 and
HPIIS

• The development of information technology at IU
  is guided by a comprehensive University-wide
  strategic plan, http//www.indiana.edu/ovpit/stra
  tegic/.
• The five-year plan commits expenditures of over
  200M.
• The plan stresses the importance of local,
  regional, national and international networking.

43
Institutional ImpactExploiting Internet2 and
HPIIS

• Switched 10/100Mbps Ethernet to every desktop
• Gigabit campus backbone
• Upgraded regional campus connections to 45Mbps
• Robust optical fiber infrastructure within
  Indiana
• Dark fiber connections between major campuses
• Establishment of the State GigaPoP in
  Indianapolis
• Regional Cyberbelt initiative to interconnect IU,
  Purdue, the Indiana GigaPoP and potentially NCSA
  via dark fiber
• Offered High Performance Network Application
  Program grants

44
(No Transcript)
45
Indiana GigaPoP
46
The CyberBelt Initiative
47

• IU and EVL at UIC in collaboration with
  University of Tokyo and Keio University are
  organizing iGrid2000 - a major research
  demonstration at the INET2000 conference, July
  18-21, in Yokohama, Japan to showcase the ongoing
  development of an International Grid (iGrid) for
  global community networking.

48

• Over two dozen applications featuring
  technological innovations and application
  advancements requiring high-speed networks, with
  emphasis on distributed supercomputing,
  tele-immersion, remote instrumentation, large
  datasets, collaboration, digital video, streaming
  media and high-definition television will be
  demonstrated.
• http//www.startap.net/igrid2000

49
8. Conclusion

• IUs exceptional commitment to engagement in
  local, regional, national and international
  networking makes a major contribution at IU to
• the development and utilization of advanced tools
  for research and education
• the facilitation of global scientific
  collaborations
• network technology research and development
• Hence this involvement is important strategically
  to the research and education missions of the
  University and to the development of rich
  connections and relationships in global research
  communities.

50
URLs

• Indiana University Office of the Vice President
  for Information Technology
• http//www.indiana.edu/ovpit
• Information Technology _at_ Indiana University
• http//www.indiana.edu/itiu