OMNInet

1
StarLight An Overview Joe Mambretti, Director,
(j-mambretti_at_northwestern.edu) International
Center for Advanced Internet Research
(www.icair.org) Director, Metropolitan Research
and Education Network (www.mren.org) Partner,
StarLight, PI-OMNINet (www.icair.org/omninet) Tho
mas A. DeFanti, Maxine D. Brown and Alan
Verlo Electronic Visualization Laboratory UNIVERSI
TY OF ILLINOIS AT CHICAGO tom_at_uic.edu,
maxine_at_uic.edu, darkman_at_evl.uic.edu Linda
Winkler Argonne National Laboratory
winkler_at_mcs.anl.gov I2 MM Chicago,
Illinois December 3-6, 2006
2
The Move to Data-Intensive Science
Engineering-e-Science Community Resources
LHC
Source Larry Smarr
ATLAS
3
TransLight/StarLight StarLight

• StarLight is the worlds largest 1 GE and 10 GE
  optical exchange for research and education
  networks (70 1GE and 50x10G)
• StarLight is a large research-friendly
  co-location facility with space, power and fiber
  that is available to university and
  national/international network collaborators as a
  point of presence/ GOLE in Chicago (by
  researchers for reseachers)
• StarLight provides an optical infrastructure and
  proving ground for network services optimized for
  high-performance applications
• StarLight is a collaboration of NU, UIC, ANL,
  CAnet 4, and many others, with partial funding
  by NSF/OCI and DOE

Northwestern Universitys Chicago downtown campus
www.startap.net/starLight Source Maxine Brown
4
StarLight Infrastructure

• StarLight is a large research-friendly
  co-location facility with space, power and fiber
  that is being made available to university and
  national/international network collaborators
  as a point of presence in Chicago

5
Lights

• Lights are bandwidth concentrators and
  exchanges (StarLight, NetherLight, CAnet4,
  UKLight, NorthernLight, T-LEX, CzechLight, etc)
• Lights also deliver Grid services such as
  computing, storage and visualization support
• Lights disrupt old pricing structures from the
  traditional telcos, which kept the prices high
• Lights goal is understanding the big data
  streams and how to map them economically to the
  least services they need
• TransLight is the initial infrastructure part of
  GLIF, the Global Lambda Integrated Facility
  (GLIF), an direct result of Euro-Link activities

6
TransLight/StarLight
7
Star TransLight/StarLight StarLight GOLE
Configuration
www.glif.is/resources/starlight-topology.jpg Sourc
e Linda Winkler
8
IRNC Is Part of the Global Lambda Integrated
FacilityAvailable Advanced Network Resources -
September 2005

• GLIF is a consortium of institutions,
  organizations, consortia and country National
  Research Education Networks who voluntarily
  share optical networking resources and expertise
  to develop the Global LambdaGrid for the
  advancement of scientific collaboration and
  discovery

Visualization courtesy of Bob Patterson, NCSA
data compilation by Maxine Brown, UIC.
www.glif.is
9
TransLight/StarLightFunds Two Trans-Atlantic
Links
IRNC pays for links only. MAN LAN Internet2 pays
for HDXc GÉANT2 pays for router At AMS-IX,
SURFnet pays for HDXc GÉANT2 pays for
router StarLight CANARIE pays for HDXc
StarLight has the Force10 At NetherLight, SURFnet
pays for HDXc UvA pays for Nortel ERX 8600 switch
IRNC Services MAN LAN Layer 3 (default) StarLight
Layer 2 VLANs, engineered upon request.
GÉANT2 PoP _at_ AMS-IE NetherLight
StarLight
MAN LAN

• OC-192 routed connection between MAN LAN in New
  York City and the Amsterdam Internet Exchange
  that connects the USA Abilene and ESnet networks
  to the pan-European GÉANT2 network
• OC-192 switched connection between NLR and RONs
  at StarLight and optical connections at
  NetherLight part of the GLIF LambdaGrid fabric

www.startap.net/translight Source Maxine Brown
Tom DeFanti
10

• TransLight is a 10Gbps lightpath donated by Cisco
  and deployed by NLR that facilitates US, European
  and Pacific Rim network connections
• Enables participating networks to easily
  configure direct connections whenever needed
• Adds resiliency and stability to the North
  American segment of GLIF

www.pnw-gigapop.net/news/translight_conn.html
Source Maxine Brown Tom DeFanti
11
TransLight/Pacific Wave10GE Wave Facilitates US
West Coast Connectivity
Developing a distributed exchange facility on the
US West Coast (currently Seattle, Sunnyvale and
Los Angeles) to interconnect international and US
research and education networks
www.pacificwave.net/participants/irnc/ Source Tom
DeFanti Maxine Brown Ron Johnson
12
TransLight/StarLightTo Provision 3Gb from
Chicago to Europe to Enable GLORIAD
Source Greg Cole, GLORIAD
13
CAnet4 has Nx10Gb and Equipment at StarLight
Source CANARIE
14
SURFnet6 National Optical RE Network Is Directly
Connected to StarLight

• High Performance Optical Switching
• Numerous 10 Gbit/s Lightpaths
• Dynamic Provisioning
• 500,000 Users
• 84 Institutes

15
UKLight is Connected to StarLight with 10Gb and
Equipment
SuperJANET RD Network
UKLightLondon
CAnet
StarLightChicago
10Gb/s
10Gb/s
2.5Gb/s
Abilene
CERN
10Gb/s
10Gb/s
10Gb/s
NetherLightAmsterdam
CzechLight
Local Research Equipment
GEANT
International Point-of-Access
Source Peter Clarke, David Salmon, UKLight
16
StarLight and Asia Pacific
StarLight
Source APAN, StarLight
17
JGN II Network Topology Map
10 Gbps?StarLight
Source JGN II
18
Kreonet
Source Kreonet
19
WHREN - LILA Proposal

• Joint response by FIU and CENIC to NSF IRNC
  solicitation
• 2.5Gbps persistent high-performance research
  network for South America to support U.S. and
  international science and engineering research
  and education communities
• Collaboration with research network operators and
  exchanges in the Americas
• Phased implementation over 5 years

Source AMPATH
20
TeraGrid Integrating NSF Cyberinfrastructure
UC/ANL
PU
PSC
NCAR
IU
NCSA
ORNL
SDSC
TACC
TeraGrid is a facility that integrates
computational, information, and analysis
resources at the San Diego Supercomputer Center,
the Texas Advanced Computing Center, the
University of Chicago / Argonne National
Laboratory, the National Center for
Supercomputing Applications, Purdue University,
Indiana University, Oak Ridge National
Laboratory, the Pittsburgh Supercomputing Center,
and the National Center for Atmospheric Research.
SOURCE TeraGrid
21
DOT Sites, I-WIRE, and OMNInet
OMNInet
Starlight (NU-Chicago)
Because of SL Renovation This Cluster is at iCAIR
Argonne
Not Yet Part of Testbed
Not Yet Provisioned
Qwest455 N. Cityfront
UC Gleacher 450 N. Cityfront
UIC
UIUC/NCSA
McLeodUSA 151/155 N. Michigan Doral Plaza
All DOT Links Here GE
Level(3) 111 N. Canal
Illinois Century Network James R. Thompson
Ctr City Hall State of IL Bldg
UChicago
IIT
22
Chicago
23
EnLIGHTened ComputingConnectivity Diagram with
Partners
To Canada
To Asia

• International
• Partners
• GLIF

To Europe
SEA
POR
BOI
EnLIGHTened wave (Cisco/NLR)
CAVE wave
PIT
OGD
DEN
CHI
KAN
CLE
SVL
WDC
Cisco/UltraLight wave
LONI wave
TUL
DAL

• Members
• MCNC GCNS
• Renaissance Comp. Inst.
• LSU CCT

• Official Partners
• ATT Research
• SURA
• NRL
• Cisco Systems
• Calient Networks
• NLR

• NSF Project Partners
• OptIPuter
• UltraLight
• WAN-in-LAB
• DRAGON

HOU
24
First Circuits For NewNet via MREN to Conference
25
NRL (The First Link of the National Lambda
Rail StarLight ltgt PSC for ETF)
Source John Silvester, Dave Reese, Tom West,
CENIC
26
Calit2 is Now OptIPuter Connecting Remote
Moore-Funded Microbial Researchers over NLR
OptIPortals
UW
NW!
UIC EVL
MIT
JCVI
UCI
UCSD
SIO
OptIPortal
SDSU
CICESE
27
10GE CAVEwaveon the National LambdaRail
28
DOEs ESnet Connects Facilities and Collaborators
at StarLight
CAnet4 KDDI (Japan) France Switzerland Taiwan
(TANet2)
Australia CAnet4 Taiwan (TANet2) Singaren
CAnet4 CERN MREN Netherlands Russia StarTap Taiwa
n (ASCC)
GEANT - Germany - France - Italy - UK - etc
Sinet (Japan) Japan Russia(BINP)
ESnet IP
Japan
QWEST ATM
International (high speed) OC192 (10G/s
optical) OC48 (2.5 Gb/s optical) Gigabit Ethernet
(1 Gb/s) OC12 ATM (622 Mb/s) OC12 OC3 (155
Mb/s) T3 (45 Mb/s) T1-T3 T1 (1 Mb/s)
42 end user sites
Source DOE
29
DOEs UltraScience Net is at StarLight
30
UltraLight Network PHASE III

• Move into production
• Optical switching fully enabled amongst primary
  sites
• Integrated international infrastructure

Source UltraLight Network
31
NIH Biomedical Informatics Research Network
(BIRN)International Federated Repositories
BIRN Collaboratory today Enabling collaborative
research at 28 research institutions comprised of
37 research groups.
www.nbirn.net
32
DREN Network Is At StarLight
33
NASAs NISN is at StarLight
Commercial Ameritech NAP Starlight Most Important
Connections to Mid-West SouthEast Regional
networks, Tier 1 ISP networks
NGIX East New Generation IP Connections to East
Coast Regional networks, Tier 1 ISP networks,
and Europe
NGIX West New Generation IP Connections to West
Coast Regional networks, Tier 1 ISP
networks, the PacRim, Japan, and Australia
MAE East Most Important Connections to East Coast
Regional networks, Tier 1 ISP networks, and
Europe
MAE West Most Important IP Connections to West
Coast Regional networks, Tier 1 ISP
networks, the PacRim, Japan, and Australia
Source NASA
34

• An Advanced Network for Advanced Applications
• Designed in 1993 Initial Production in 1994,
  Managed at L2 L3
• Created by Consortium of Research Organizations
  -- over 20
• Partner to STAR TAP/StarLight, I-WIRE, NGI and
  RE Net Initiatives, Grid and Globus Initiatives
  etc.
• Model for Next Generation Internets
• Developed Worlds First GigaPOP
• Next the Optical MREN
• Soon - Optical TeraPOP Services

35
IRNC Is About More Than NetworksSystem
Integration Applications, Middleware, Networks
Communications of the ACM (CACM)Volume 46,
Number 11November 2003Special issue Blueprint
for the Future of High-Performance Networking

• Introduction, Maxine Brown (guest editor)
• TransLight a global-scale LambdaGrid for
  e-science, Tom DeFanti, Cees de Laat, Joe
  Mambretti, Kees Neggers, Bill St. Arnaud
• Transport protocols for high performance, Aaron
  Falk, Ted Faber, Joseph Bannister, Andrew Chien,
  Robert Grossman, Jason Leigh
• Data integration in a bandwidth-rich world,
  Ian Foster, Robert Grossman
• The OptIPuter, Larry Smarr, Andrew Chien, Tom
  DeFanti, Jason Leigh, Philip Papadopoulos
• Data-intensive e-science frontier research,
  Harvey Newman, Mark Ellisman, John Orcutt

www.acm.org/cacm
36
IEEE Communications March 2006
37
(No Transcript)
38
(No Transcript)
39
Thank You Very Much!

• Our planning, research, and education efforts are
  made possible, in major part, by funding from
• US National Science Foundation (NSF) awards
  ANI-0225642, EIA-0115809, and SCI-0441094
• State of Illinois I-WIRE Program, and major UIC
  cost sharing
• Many corporate friends and partners
• Argonne National Laboratory and Northwestern
  University for StarLight and I-WIRE networking
  and management
• National Lambda Rail, Pacific Wave, CENIC and
  Cisco Systems

40
www.startap.net/starlight
Photo By Maxine Brown