Cyberinfrastructure: Networking Update 30March2005

1
CyberinfrastructureNetworking
Update30-March-2005

• Julio Ibarra
• Executive Director
• CIARA/AMPATH/WHREN-LILA
• Julio_at_fiu.edu

2
Cyberinfrastructure Update

• Highlights and Introductions Heidi Alvarez,
  FIU
• FIU Networking Update Julio Ibarra, FIU
• Related Activities in Networking and Grids
  Harvey Newman, Caltech
• Network Monitoring Projects Xun Su, Caltech
  Chi Zhang, FIU
• Grid Computing Update Jorge Rodriguez, UF,
  Ernesto Rubi, FIU and Paul Avery, UF
• International Update with Brazil Sergio
  Novaes, UNESP

3
Year 3 Cyber Milestones
4
Cyberinfrastructure Funding Distribution
Highlights

• Closely resembles 2003 Project Execution Plan
  Milestones Funding
• Introduction of WHREN-LILA and AtlanticWave
  networking services
• Equipment is roughly the same, just reprogrammed
  to match the current active equipment
  configuration including the CISCO ONS 15454s
  purchased with year 2 funding minus 1 Month
  support for Julio Ibarra

• Other Direct Costs includes the sub-contract
  with Caltech for network engineering support
• Funding totals unchanged
• New networking innovations
• Strong network monitoring program to determine
  bandwidth needs

5
(No Transcript)
6
Outline

• Cyber Year 2 accomplishments
• Year 3 cyber updates
• Leveraged Activities
• IRNC connections for Latin America
• AtlanticWave and distributed exchange service
• Pan-American Advanced Studies Institute
• REU and Cisco URP programs
• CHEPREO 2005 Cyber work plan

7
Cyber Year2 Accomplishments

• Purchased Cisco ONS 15454s for Miami and Sao
  Paulo
• Established STM-4 circuit between Miami and Sao
  Paulo
• Hired Fabian Alcantara to provide IT support with
  Ernesto Rubi for CHEPREO, funded at the 50 level
  from both AMPATH and CHEPREO
• Tier 3 data center is fully operational at the
  NAP
• Participating in NLR through FLR
• Enabled Brazil HEP researchers Novaes in Sao
  Paulo and Santoro in Rio to participate in SC04
  bandwidth challenge, led by Caltech

8
Year 3 Funding in support of milestones

• Year 3 funding affords the procurement and
  operation of
• equipment for link from Miami to Jacksonville,
  interconnecting with NLR and AtlanticWave
• ports on ethernet switch and router to support
  Gig-E flows
• CHEPREOs connection to the AtlanticWave

9
Leveraged Activities

• NSF IRNC award for Latin America, Increasing the
  Rate of Discovery and Enhancing Education across
  the Americas awarded, 0441095, provides
  additional cyberinfrastructure resources for
  CHEPREO, UltraLight and other NSF activities for
  South America
• Hosted the Chinese American Networking Symposium,
  NSF OISE award 0506892
• Pan-American Advanced Studies Institute (PASI)
  award OISE 0418366, Grid Computing and Advanced
  Networking for High-Energy Physics and Astronomy

10
(No Transcript)
11
The WHREN-LILA Project

• Proposal submitted by Florida International
  University (FIU) and the Corporation for
  Education Network Initiatives in California
  (CENIC) - Award 0441095
• Links Interconnecting Latin America (LILA) aims
  to Improve connectivity in the Americas through
  the establishment of new inter-regional links
• Western-Hemisphere Research and Education
  Networks (WHREN) is a coordinating body of
  organizations from across North and South America
  that aims to leverage the network resources of
  participating members to foster collaborative
  research and advance education throughout the
  Western Hemisphere

11
12
Links Interconnecting Latin America (LILA) Year 1

• Increases Miami - Sao Paulo link from 622Mbps to
  1.2Gbps
• Q2 2005
• Evolving to 2.5Gbps
• Establishes a dark fiber segment between San
  Diego and Tijuana for a 1Gbps link
• May 2005
• Interconnects with Latin Americas RE networks in
  Sao Paulo and Tijuana
• Introduces an infrastructure to develop a
  distributed international exchange and peering

12
13
View of NSF IRNC
14
AtlanticWave

• AtlanticWave is an International Peering Fabric
• US, Canada, Europe, South America
• Distributed IP peering points
• NYC, WDC, ATL, MIA, SPB
• SURA, FIU-AMPATH-CHEPREO, the IEEAF, MAX,
  SoX/SLR, MANLAN, and in partnership with the
  Academic Network of Sao Paulo (ANSP) are
  combining efforts to establish AtlanticWave
• Described as an integral component of the
  WHREN-LILA proposal to extend LILA on the
  Atlantic side to MANLAN in NYC
• Leverages IRNC resources in NYC, Seattle, and LA
  to reach strategic global resources

14
15
AtlanticWave Topology

• A-Wave provides multi-layer/multi-protocol
  services between participating networks
• Layer 3 peering services over ethernet
• GLIF light path services
• Others TBD
• A-Wave will to provide a production Layer 3
  distributed exchange capability
• Ethernet based
• Best effort packet exchange
• Linear topology unprotected (NLR based)
• 1 GE, 10GE LAN, 10GE WAN client access
• Jumbo frame support

15
16
Sao Paulo Distributed exchange point

• The lambda cloud created by the WDM
  infrastructure permits the arbitrary
  interconnection of pairs of level 1 or 2 devices
  in different PoPs attached to the cloud
• Lambdas will usually use n-Gbps Ethernet framing
• exceptionally SDH/Sonet framing could be used

17
Distributed Exchange Topology

• Leverages Brazils exchange point in Sao Paulo
  and GIGA to connect HEP clusters at SP-RACE and
  UERJ
• International exchange points interconnect to
  form a distributed exchange service for
  international networks
• Integrates Miami, Sao Paulo, CHEPREO and
  Brazilian HEP community to use AtlanticWave
  distributed exchange, optimizing traffic flows to
  other leveraged projects and CERN

GIGA
Madrid
17
18
Monitoring and Measurement Activities

• NSF REU Distributed Network Monitoring using
  NetFlow and MonALISA project
• An integrated networking monitoring system using
  Cisco Netflow, MonALISA and NLANR PMA/AMP tools
• PingER and NLANR AMP active measurement resources
  in service for links to Latin America

18
19
CHEPREO 2005 Work Plan

• Install Cisco ONS 15454 in Sao Paulo
• Increase link capacity from 622 Mbps to 1.2 Gbps
• Work with ANSP, RNP-Giga and Caltech to connect
  Sao Paulo (Novaes) and Rio (Santoro) clusters
• Integrate Miami, Sao Paulo, the Brazilian HEP
  community and CHEPREO to the AtlanticWave
  distributed exchange
• Work with Caltech and partners in Brazil to tune
  flows across links and optimize traffic flows to
  other leveraged projects and to CERN
• Work with IRNC awardees for measurement and
  Caltech to implement link flow tools

20
Pan-American Advanced Studies Institute

• NSF sponsored program to offer a series of
  lectures at the advanced graduate and
  postgraduate level involving domain researchers,
  students and practitioners. Award 0418366, OISE
  Americas Program
• Aims to disseminate advanced scientific and
  engineering knowledge, stimulate collaborative
  learning and cooperation among the research
  communities of the Americas

Mendoza Argentina

• CIARA, along with collaborators from the U.S.,
  Argentina and Brazil, is organizing a PASI to
  offer a series of lectures on the role of Grid
  Computing and Advanced Networking for High-Energy
  Physics and Astronomy
• Our PASI is scheduled for May 15-20, 2005 in
  Mendoza, Argentina
• Approximately 40 students from the Americas will
  learn of the major experiments, Grid and advanced
  networking technologies and how the growing
  interdependence between the science and the
  technologies are forming global collaborations

http//ciara.fiu.edu/pasi/
20
21
Thank You!

• CHEPREO, WHREN-LILA, AMPATH infrastructure,
  science application support, education, outreach
  and community building efforts are made possible
  by funding and support from
• National Science Foundation (NSF) awards
  STI-0231844, MPS-0312038, OISE-0418366 and
  SCI-0441095
• Florida International University
• Latin American Research and Education community
• The many national and international collaborators
  who support our efforts

21
22
More Slides
23
LILA Miami - Sao Paulo link design
Abilene

• Provides Gig-E flows and hybrid services to
  Brazils HEP community in Sao Paulo (SP-RACE),
  Rio (UERJ Tier2) and other sites in Brazil
• Integrates Miami, Sao Paulo, CHEPREO and
  Brazilian HEP community to use AtlanticWave
  distributed exchange, optimizing traffic flows to
  other leveraged projects and CERN
• Peering with Internet2s Abilene and other RE
  networks through AMPATH

NAP of the Americas Miami
AtlanticWave
GigE
GigE
LILA-Miami Optical Mux (Cisco ONS 15454)
1.2Gbps evolving to 2.5Gbps
COTIA Sao Paulo
GigE
GigE
GigE
GigE
GEANT Madrid
UERJ Tier2
23
24
Distributed Network monitoring using Netflow and
MonALISA

• Development project that integrates NetFlow
  monitoring data with the MonALISA framework
• Collaboration between FIU, Caltech and CERN
• Builds a lightweight, scalable and customizable
  utility that enables viewing flows based on
  source-destination pairs
• Allows for a historical trend analysis of network
  behavior as well as a close-to-realtime look at
  flow data
• Builds a framework for an Integrated Passive Flow
  Measurement Toolkit (next slide)
• Support from NSF REU Award SCI-0231844
• REU Report available at http//www.ampath.net/publ
  ications.htm

24
25
Integrated Passive Flow Measurement Toolkit

• A real-world deployable network monitoring
  toolkit that improves the functionality of
  MonALISA by integrating NetFlow and NLANR PMA
• Cisco University Research Program (URP) Award to
  Caltech and FIU
• Leverages NSF REU project that integrates NetFlow
  into MonALISA
• Integrates MonALISA, Cisco NetFlow and NLANR PMA
  tools to facilitate efficient network planning
  and operation for the at large networking
  community
• Being deployed to monitor traffic flows for
  CHEPREO between the US and Brazil
• Toolkit will be available by Sept. 2005

25
26

• CHEPREO is an exemplar of how domain research,
  education and outreach is enabled by technology
  and cyber infrastructure
• FIU created CIARA as an instrument to bridge
  domain research with institutional technology
  investments to improve knowledge creation and
  knowledge sharing
• CHEPREO, leveraging institutional investments,
  such AMPATH, FLR and NLR, validates the approach
  for research, education and outreach

27
AtlanticWave Design
Prepared by Jerry Sobieski
27