Friends. Grids. The Future. GLOBAL RING NETWORK FOR ADVANCE

1
GLOBAL RING NETWORK FOR ADVANCED APPLICATIONS
DEVELOPMENTRussia-China-USA Science Education
Network
April 14, 2003
Greg Cole, Natasha Bulashova, National Center
for Supercomputing Applications (NCSA) University
of Illinois at Urbana-Champaign (gcole_at_uiuc.edu,
natasha_at_uiuc.edu)
2
Presentation Objectives

• Update on US-Russian NaukaNet Program
• Introduce Russia-China-USA GLORIAD program

3
NaukaNet Overview

• 5 year 4.1 million NSF Cooperative Agreement
  under HPIIS Program
• Co-funded by Russian Ministry of Industry,
  Science Technology
• 1998-2001 MIRnet
• Univ of Tennessee
• 6 Mbps ATM Service (Moscow M9 - STARTAP)
• 2001-2002 FASTnet
• NCSA, Univ of Illinois at Urbana-Champaign
• 45 Mbps ATM Service (Moscow M9 - STARTAP)
• 2002-June, 2004 NaukaNet
• 155 Mbps POS Service (Moscow M9 - Starlight)
• Upgrade in 2003 to 2x155 Mbps POS Service

5 year goal
4
NaukaNetTraffic Growth, 1999 - 2003
5
NaukaNetGrowth in IP Flows gt 200 Mbytes
6
Number of Unique IP Addresses Using NaukaNet,
2000-2002
7
(No Transcript)
8
NaukaNetTraffic to Novosibirsk, Russia
9
(No Transcript)
10
(No Transcript)
11
(No Transcript)
12
(No Transcript)
13
Top Institutional Users of NaukaNet in
RussiaNov. 2002
14
Top Institutional Users of NaukaNetin U.S.,Nov.
2002
15
Application Communities

• High Energy Physics
• International Thermonuclear Experimental Reactor
  (ITER)
• Atmospheric Sciences
• Spallation Neutron Source
• Space Sciences Cooperation
• Astronomical Sciences/IVO
• US-Russian Plutonium Disposition Project
• Non-proliferation/Arms Control Program
• US-Russia Materials Protection, Control
  Accountability Program
• Security Studies/Issues
• Geosciences
• Bioinformatics

16
(No Transcript)
17
(No Transcript)
18
NaukaNet Congestion ahead
19
Near-Future Plans

• Add second OC3 Starlight - Moscow
• Complete European exchange for Russia-Europe
  traffic
• Improved (live) Monitoring System
• Access Grid Node in Moscow
• Switched Ethernet testbed project
  (Moscow-Novosibirsk)
• New IPv6 Services / experimentation
• June Conference in Moscow and St. Petersburg
• Russian domestic infrastructure improvement

20
GLOBAL RING NETWORK FOR ADVANCED APPLICATIONS
DEVELOPMENTRussia-China-USA Science Education
Network
21
Why GLORIAD?

• Time to develop follow-on to NaukaNet program
• Science applications demand it (HEP, ITER, NVO,
  Atmospheric Sciences, Spallation Neutron Source,
  Nanomaterials collaborations, network security,
  etc.)
• Desire to extend SE network in Russia to Far
  East
• TransTelecom network in place
• Highest level interest in US for improving
  US-China SE cooperation
• Highest level interest in Russia for improving
  Russia-China SE cooperation
• Good opportunity to develop general framework for
  tri-lateral cooperation around a most advanced
  SE network

22
Introduction to GLORIAD

• Proposed network/program to be operational in
  2004
• Co-developed (and to-be-co-funded) by U.S.,
  Russia, China
• Expanded capacity for science and education
  collaboration (10 Gbps)
• New Global Ring topology for reliability and
  new applications
• Essential for supporting advanced SE
  applications (particularly HEP, Astronomy,
  Atmospheric Sciences, optical network research,
  network security research)
• Follow-on to US-Russian NaukaNet Program

23
Details (initial proposal)

• Layer 1 10 Gbps Lambda ring across Russia,
  China, US (and the oceans between) (likely access
  point in Amsterdam also)
• Layer 2 Switched Ethernet
• Layer 3 IPv6
• Program to develop network management,
  utilization, monitoring, resource allocation and
  scheduling tools
• Program to develop Cyberinfrastructure supporting
  SE collaboration
• Program to educate potential users and to
  educate/inform continuously scientists/educators
  in all 3 countries about opportunities to
  collaborate

24
The 4 Layer GLORIAD Model
Application Communities
Scientists, educators, policy-makers, public
organizations, students
Collaboration Framework
Middleware/grid tools, technologies tying
together networks, computers and communities
Sculpted Network Platform
Ethernet (layer 2) switching, IPv6 migration,
Network monitoring and management (scheduling,
allocation) tools
Lightwave/Lambda Network
Lambda-based network optical switching
25
Goal Applications

• Network will carry the full mix of SE traffic
• Emphasis, however, on supporting single
  applications that need Gbps capacity
• ITER-Grid (US, China have just (re-) joined)
• HEP LHC data distribution
• National Astronomy Virtual Observatory
• Climate change / atmospheric sciences
• Digital Sky
• Digital Earth
• Wavelength Disk Drive (based on Canadian efforts)
• Data mining, security monitoring and
  visualization
• Large scale digital video services

26
Serving Major Science/Education Application Areas

• GLORIAD is being developed to serve global SE
  collaborations. The following lists a few
  typical programs or program areas in which at
  least two (and in many cases, all three) of the
  countries jointly participate.
• USA International Space Station Alpha DOE Arms
  Control Policy Studies National Nanotechnology
  Initiative Human Genomics Nuclear Threat
  Initiative (NTI) Grid Physics Network
  Cooperative Threat Reduction Program MPCA
  Antarctic Research Programs Earth Observation
  The Globe Program
• Russia ITER Large Hadron Collider (LHC)
  U.S.-Russia Joint Commission on Economic
  Technological Cooperation Seismic / Geological
  Research Programs HERA-B (proton-electron
  accelerator) Forest and Wildfire Research
  Controlled Thermonuclear Fusion Irkutsk Project
  Junior Achievement Simple Words Childrens
  Program Neurosurgery International Plasma
  Physics
• ChinaYangtze River / Three Gorges Space
  Telescope Program Large Radio Telescope (FAST /
  KARST) U.S.-China National Laboratory
  Interactions in Arms Control / Nonproliferation
  China Biodiversity Network U.S.-China Joint ST
  Commission Russia-China Oil Pipeline Project
  Shanghai Cooperation Organization

27
Technical Details (initial proposal)

• Initial capability to switch multiple ethernet
  segments
• Later capability to switch multiple lambdas (year
  3)
• Optical (initially, Ethernet) switches in Chicago
  (Starlight), Amsterdam (NetherLight), Moscow
  (RusLight), Novosibirsk (SiberLight), Beijing
  (ChinaLight), Hong Kong (HKLight)
• Self-healing ring topology (ex if network outage
  across Atlantic, US traffic to Moscow transits
  Pacific/China/Siberia)
• IPv6 proposed for advanced applications,
  security, future of IP networking

28
A series of Starlight type facilities providing
services for lambda-switching, ethernet-switching
, IPv6 routing, IPv4 routing. Also, a testbed
for advanced network research.
29
Russian Backbone Network (RBnet)
30
China CSTNet (800 research facilities/institutions
)


31
US High Performance Network (Abilene, pictured
here, is one of several US networks others
include DOEs Esnet, NASAs NREN, US Govt
network, etc.)
32
Financing

• Proposed 5 year Project (2003-2008)
• Backbone cooperatively managed by US, China,
  Russia partners
• Project cooperatively funded by US, China,
  Russia.
• US commitment anticipated at 2.5M annually
• Proposal each country funds transit across its
  territory.
• US funds 1/2 circuit to Russia and 1/2 circuit to
  China.
• Russia funds 1/2 circuit to US.
• China funds 1/2 circuit to US.
• Each country funds personnel, equipment,
  operations necessary for full program operation
  (i.e., distributed 24/7 NOC, training/support,
  security services, grid development, etc.)

33
Organizational Details

• Russian Federation Kurchatov Institute (Dr.
  Velikhov), Russian Academy of Science (Dr.
  Velikhov), Joint Supercomputing Center (RAS),
  Ministry of Industry, Science Technology,
  Ministry of Communications, Ministry of
  Education, Ministry of Atomic Energy.
  (TransTelecom likely network provider)
• Peoples Republic of China CSTnet/CNIC, Chinese
  Academy of Science. (Dr. Jiang)
• U.S.A. University of Illinois National Center
  for Supercomputing Applications (lead
  university), National Computational Science
  Alliance, U.S. National Science Foundation, U.S.
  Department of Energy. (several telecomm companies
  being evaluated as possible network providers)
  Also, National Academy of Engineering, San Diego
  Supercomputing Center, Argonne National
  Laboratory, Oak Ridge National Laboratory, Sandia
  National Laboratory, International Center for
  Advanced Internet Research (ICAIR) at
  Northwestern University, others. (Challenge must
  present a nation-wide consortium of U.S. SE
  community to match interest/level of commitment
  in Russia and China)

34
Academician Evgeny Velikhov

• Academician, Russian Academy of Science
• Academician-Secretary, Info. Computing
  Division, RAS
• President, RRC Kurchatov Institute
• Science Advisor, President, Russian Federation
• Leader, ITER
• Leader, Russian NaukaNet (GLORIAD)
• Founder and Director, Russian Junior Achievement

35
Mianheng Jiang

• Vice President, China Academy of Sciences
  (Computing and IT Division)
• Telecommunications/IT developer in China
• Leader, China GLORIAD program

36
Baoping Yan

• Director, Computer Network Information Center,
  China Academy of Sciences

37
Organizing Trip to BeijingDecember 7-16, 2002
38
GLOBAL RING NETWORK FOR ADVANCED APPLICATIONS
DEVELOPMENTRussia-China-USA Science Education
NetworkOrganizing Tripwith Chinese Academy of
SciencesComputer Network Information Center
(CNIC) December 7 - 16, 2002Beijing, Peoples
Republic of ChinaVisitorsAcad. Evgeny
Velikhov, Kurchatov InstituteNatasha Bulashova,
NCSA, University of IllinoisGreg Cole, NCSA,
University of Illinois
39
Trip Purpose

• Explore Opportunities to Expand the US-Russian
  NaukaNet SE Program with partners from Chinese
  Academy of Science (CAS), with CAS CSTnet and
  with a global ring network based on lightwave
  technology

40
Trip Results

• December 14, 2002
• Memorandum of Understanding Signed by China
  (Jiang Mianheng), Russia (E. Velikhov), and US
  (G. Cole) to develop GLORIAD

41
Trip Results
Consensus Reached on GLORIAD program With Plans
for Program Development, Program Management,
Network Topology, Technology, Science
Collaborations
42
The Memorandum of Understanding
The Chinese Academy of Sciences represented by
the Computer Network Information Center (CNIC),
the Russian Research Center Kurchatov Institute
and the US National Center for Supercomputing
Applications (NCSA) of the University of Illinois
jointly propose a new strategic framework for
advancing SE cooperation among the three
countries and across the myriad disciplines
comprising current and future collaborative
research. Linking their scientific communities
with an advanced SE network and Grid-based
services, the multi-national GLORIAD program will
actively encourage and coordinate applications
across multiple disciplines and provide for
sharing such scientific resources as databases,
instrumentation, computational services,
software, etc. In addition to supporting active
scientific exchange with network services, the
program will provide a test bed for advancing the
state-of-the-art in collaborative and network
technologies including Grid-based applications,
optical network switching, an IPv6 backbone,
network traffic engineering and network security.
Supporting the increasing growth in global SE
cooperation, GLORIAD will cooperate with other
national SE networks and scientific resources as
required.
43
Lightwave/Lambda Network

• 10 Gbps Lambda Continuous Ring (segmented into
  multiple GigE ethernets)
• Need to decide carrier issues, meet points, etc.
• Russias network will be ready (to Russia-China
  border) in late 2003
• Chinas network will be ready (to Russia-China
  border) in early 2004
• Important in later phase of project (year 3) that
  we have multiple lambdas (at least, when needed)
  and capability to switch lambdas on demand

44
Action Items

• Determine carrier issues for trans-Atlantic and
  trans-Pacific links. Must choose carrier with
  stable financial base, excess lambda capacity,
  eagerness to work on large RD project.
• Finalize arrangements with Russian company
  TransTelecom
• Finalize transit issues within and to/from China
• Finalize network topology (optical nodes,
  facilities, equipment)

45
Resource Access/Scheduling System

• Provide for ability to advance-schedule resource
  allocation requests end-to-end
• Software system to automatically update network
  devices
• Must handle Level 2 switching for end-to-end VLAN
  provisioning
• Must handle Level 3 routing for providing
  improved QoS through core network (for example,
  using MPLS or other service)
• Must by year 3 provide for scheduling/switching
  (at optical level) lightwaves
• Must provide back-end reporting and surveying to
  determine how well network met customers needs

46
Collaboration Framework

• Middleware/grid tools, technologies
  (Cyberinfrastructure)
• Collaboration
• Sharing of computational resources
• Sharing of storage/data resources
• Sharing of expensive/scarce instrumentation,
  sensor data, etc.

47
Global Grid Development

• GLORIAD will provide the network linking GRID
  communities in US, Russia and China (and, via
  Starlight and Netherlight, other countries)
• Will support the general US-Russian NaukaGrid
  program and other focused Grid communities

48
ITER-Grid Development

• Dr. Velikhovs goal Virtual ITER sites with
  ready, immediate access to conferencing
  facilities, live data streams generated by
  experiments/operations, distributed access to
  computational resources, remote instrumentation,
  monitoring and control applications.
• Need conferencing/lecture capabilities
  immediately (AG?)
• Network needs will eventually exceed 10 Gbps
• Preparing concept paper on what the ITER-Grid
  will be
• Would like to propose joint development effort
  NCSA, Argonne, ORNL, others?

49
Kurchatov Institute Conferencing Facilities

• Currently based on several H.323 (polycom)
  devices
• Would like to add Access Grid node
• Useful for KI collaborations with NCSA, ORNL,
  Argonne, Sandia, ITER/fusion community
• Useful model for other Russian sites (implement
  multicast network across Russian SE network)
• NaukaNet network capable

50
Application Communities

• GLORIAD is to focus on application communities -
  especially those with needs which could not be
  met without such an advanced network
• First, need to identify and document needs of
  these communities
• Second, need to educate/inform scientists,
  educators, students about potential services,
  capabilities
• Third, need to continually inform/update broad
  community about opportunities of collaboration

51
Active interest in GLORIAD program

• Signed Statement of the US-Russian Joint
  Committee for Science and Technology (J.
  Marburger, M.P. Kirpichnikov)
• Presentation to Presidents Science Advisory
  Council, Russian Federation
• Signed Agreement (March 12, 2003) between 7
  Russian Ministries, Russian Academy of Science
  RRC Kurchatov Institute

52
Signed Statement of US-Russian ST Commission
Informational and Telecommunication Technologies
in Science and Education The Committee gave a
favorable appraisal of the results achieved
through cooperation between the Russian Ministry
of Industry, Science, and Technology (MIST) and
the Russian Academy of Sciences (RAS) and the
U.S. National Science Foundation (NSF) on high
capacity computing and new generation computer
networks, including under the NaukaNet (FASTnet)
Project, carried out by the Interagency
Supercomputer Center, the Russian Science Center
Kurchatov Institute, the National Center for
Supercomputing Applications (University of
Illinois, Urbana-Champaign), and the
Supercomputer Center at the University of
California, San Diego. The Committee recommended
that U.S. and Russian cooperation partners
continue their active cooperation and discussions
of the potential of next-generation computing and
networking projects, such as those envisioned as
the "TERRA GRID" network and the Global Network
For Advanced Application Development (GLORIAD).
53
Presentation to Russian ST Council
January 2003 The forum was the President's
Science Technology Council and the participants
included -- in addition to the President (who
presides over this council) -- the nation's most
senior science officials (including the Minister
of Science, Industry Technology, the President
of the Russian Academy of Science and the
President of the Kurchatov Institute (Dr.
Velikhov)), and also the Finance Minister (and
Vice Premier), the Minister of Commerce, the
Minister of Atomic Energy and the head of the
National Security Council. Where the
Kurchatov Institute leads, Russia follows
(Russian President)
54
Signed Russian Agreement

• On Wednesday, March 12, 2003, Dr. Velikhov placed
  the final signature on a document developed by 7
  senior organizations in Russia indicating support
  and intention to pursue implementation of
  GLORIAD.
• It was signed at the Minister level by Ministry
  of Industry, Science Technology, Ministry of
  Communications, Ministry of Atomic Energy and
  Ministry of Education. Also, the President of the
  Russian Academy of Sciences signed on behalf of
  the Academy and Dr. Velikhov on behalf of
  Kurchatov Institute (and as project
  organizer/lead).
• The agreement is to not only fund the
  international and networking parts of GLORIAD but
  also domestic infrastructure and programs to
  enable the science and education communities to
  utilize GLORIAD.
• Finally, we understand that Russian federal funds
  are now obligated for GLORIAD -- from the above
  organizations -- the Ministry of Industry,
  Science Technology will be the financially
  responsible organization.

55
GLORIAD Proposal

• Ready in summer, 2003
• Joint proposal preparation so that document is
  useful in US, Russia and China
• Primary focus on applications served by unique
  network services as well as advanced network
  research development test bed
• Beginning to coordinate closely with other HPIIS
  teams TransPAC (J. Williams), EuroLink (T.
  DeFanti), Starlight (T. DeFanti, J. Mambretti)
  (next meetings May 2003)

56
(No Transcript)
57
(No Transcript)
58
(No Transcript)
59
(No Transcript)
60
GLORIAD Management Team Issues

• Science and Network Policy
• Cybersecurity
• Export Control Issues
• Technical Network Engineering
• Grid Development
• Corporate Relations
• Government Relations
• Cultural Affairs
• Youth Programs/Applications
• Evaluation and Audit

61
Other Events/Project Ideas/Plans

• April 14 discussions with Russian/Chinese
  partners (Washington)
• Workshop in June (ship, St. Petersburg Russia)
• International Simple Words program (global
  essay contest for children)
• Program to encourage science/education
  collaboration among young people (School-Grid)
• US-Russia-China Edu-Cultural Channel

62
the end (thank you!)