MIX: An overview on services and news 2006

1
MIX An overview on services and news 2006

• A cura dello
• Staff del MIX

2
Organization
General Assembly
Board of directors
Technical Committee

• AIIP
• Albacom S.p.A.
• Cable Wireless S.p.A.
• Clio S.r.L.
• Cubecom S.p.A. in liquidazione
• Elitel S.p.A.
• Energy s.a.s. in liquidazione
• Equant Italy S.p.A.
• Eutelia S.p.A.
• Fastweb S.p.A
• Grapes Network Services S.p.A.
• I.Net S.p.A.
• ITnet S.r.L.
• Italia On Line s.r.l.
• KPNQWest Italia S.p.A.
• MC-Link S.p.A.
• Netscalibur Italia S.p.A.
• Sequenza S.p.A.
• Spin S.r.L.

Antonio Blasco Bonito, CNR Andrea Colangelo,
Eutelia Davide De Palo, Fastweb Alberto Maria
Langellotti, Telecom Italia Mauro Magrassi,
MIX Flavio Palumbo, Wind Valeria Rossi,
MIX Alessandro Zanetti, I.Net
Lorenzo Chirico, IT.Net Marco Concina ,Telecom
Italia Vittorio Figini, Utility Line Italia Marco
Fiorentino,KPNQwest Italia Joy Marino, AIIP Paolo
Nuti, MC-Link Paolo Susnik, Tiscali
MIX Staff
Managing director Valeria Rossi
Technical Office Gianmarco Clerici Mauro
Magrassi Simone Morandini Michele Perrucci
General secretariat Monica Arensi
3
Growth
20 June 2001
May 2001 gt 1Gb
January 2001 June 2001 21 ISPs (total
68)
Today
Num. of ISPs 56 Num. of operators 24 Total
access bdw 104 Gbit
Private peering 33
4
Premises

• Campus Caldera, Milan Pal.D/ Ala 3
• 400 mq total surface
• 170 mq data room
• Availability of 40 racks for ISPs
• About 50 mq for carriers
• Optical fiber and UTP Cat. 5 and Cat. 5e
  precabling
• Dedicated racks for local operators
• Dedicated racks for permutation and servers
• UPS and Electronic Group System
• Air conditioning system
• 220V e -48V electrical power

5
MIX ISPs
Admission policies

• ISPs providing Internet access (LIR and own AS)
• ISPs providing hosting and/or housing services if
  including Internet access (LIR and own AS)

Istitutional service
Added value services
L3 public peering
L3 private peering
Others

• 1 port (depending on nominal bandwidth)
• 1/3 MIX rack 19 space (router inside)
• and/or rack space for 1 optical box
• precabling to MIX switches
• double power 220V
• MIX OOB access (router inside)
• H24 access
• IPv4 and IPv6 peering addresses
• Multicast peering
• direct peering with guests services
• Q-tag ()
• gt1 ports ()
• gt 1/3 rack ()
• () extra annual fees

• Private VLAN
• 1 dedicated vlan
• Precabling to MIX switches
• IPv4 and IPv6 addresses
• Q-tag ()
• Dedicated ports ()
• Back-to-back
• Interconnection circuit
• Closed User Groups
• 1 dedicated vlan
• Precabling to MIX switches
• IPv4 and IPv6 addresses
• () extra fees

• Interconnection to carriers
• Interconnection to P.I.R. (PA) ? 2006
• dedicated rack space
• precabling to MIX-PIR switches
• IPv4 address
• shared interconnection to RUPA
• Interconnection to VoIP LAN ? 2006

6
MIX guests

• External services available on the MIX public
  peering LAN
• ccTLD .it secondary DNS nameserver
• ccTLD .eu secondary DNS nameserver
• other ccTLD (nda) secondary and replicas DNS
  nameservers
• K-root replica DNS nameserver
• I-root replica DNS nameserver
• RIPE RIS Project (Remote Route Collector 10)

7
MIX Carriers
Admission policies

• Operators providing access to MIX premises
  through their own infrastructures (L1 and/or L2)

Level 1 Interconnection Services at MIX Agreement
Level 2 Interconnection Services at MIX Agreement
Layer 1 Dark Fibers
Layer 2 ? 2006 Pseudowires Eth/LAN extensions
Layer 1 SDH/Dwdm

• room in MIX racks for L2 equipment
• precabled circuits to MIX switches
• ports on MIX switches
• double power 220V
• availability H24 access
• dedicated pipes for interconnection circuits

• room in a dedicated area for trasmission
  equipment
• -48 electrical power
• dedicated pipes for fibers
• dedicated pipes for electrical cable
• availability H24 access
• dedicated pipes for interconnection circuits

• room in dedicated MIX racks for optical boxes
• precabling to MIX switches
• availability H24 access
• dedicated pipes for interconnection circuits

8
MIX outside

• Member of Euro-IX board
• in June 2001 MIX is one of the 7 charter members
  of the European Internet Exchange Association
  (www.euro-ix.net)
• to co-ordinate technical standards across the
  continent, develop common procedures, and share
  and publish statistics and other information.
  This publishing of information would in turn give
  all interested parties a better insight into the
  world of IXPs.
• Today 38 IXPs members, 24 Countries (3 USA, 1
  India, 2 Japan)
• Member of AIIP board (Italian Internet Providers
  Association)
• Member of VOIPEX board (Consortium for the
  development of Services over IP)
• Partner in SPC project
• in 2003 MIX has contributed in designing Italian
  Public Administrations Network (Sistema Pubblico
  di Connettività)
• in 2006 MIX has created an extension to PIR in
  Rome
• Partner in EU project CoCombine
  (www.cocombine.org)
• The EU project COCOMBINE studies the Economics
  of the Internet. It has a special focus on the
  Upstream Internet Sector, Internet Backbones,
  Internet Exchange Points, Peering and Transit
  Agreements and Competion Policy.
• 2001-2005 MIX cooperates with University of
  Padua in new monitoring systems tools development

9
Some more Details on

• MIX Infrastructure
• MIX Statistics and Monitoring Systems
• MIX News 2006
• Technical
• Administrativia

10
Data Center

• Infrastructure
• Security Systems
• Areas
• MIX Switches

11
Infrastructure

• UPS and Power Distribution
• Generator
• Two redundant UPS systems
• Air Conditioning System
• Four cooling units
• 18C 50Humidity
• Piping System
• Ceiling and floor pipes for fiber/copper

12
Security Systems

• Fire/flooding detection
• Smoke/water sensors
• Gas Extinguishers
• Burglar Alarm
• Monitored Data Center
• Video Survelliance
• Intrusion Notification
• Access Control
• Limited and controlled access

13
Areas

• Red Area
• Green Area
• Blue Area

14
Red Area

• Dedicated to carriers
• -48V Power distribution system
• Multiple piping system copper/fiber and
  electrical distribution

15
Green Area

• Dedicated to local operators
• Cabling to MIX Switches
• Multimode Fiber
• Singlemode Fiber
• Multiple optical fiber piping system

16
Blue Area

• Dedicated to ISPs and L2 equipments
• Cabling to MIX Switches
• Copper (cat 5e)
• Fiber (Multimode)
• Redundant 220V Power Bars
• 600x600 Racks

17
MIX Area

• Reserved for
• MIX Networking Equipment
• MIX Servers
• Guest Servers
• MIX Patch Panels

18
MIX Switches

• Foundry Networks
• BigIron Jetcore 8000 15000
• Total switching capacity gt700 Gbps
• 10/100 Base TX Ports
• 1000 Base SX/LX Ports
• 10000 Base GX SR/LR/ER Ports

19
Some more Details on

• MIX Infrastructure
• MIX Statistics and Monitoring Systems
• MIX News 2006
• Technical
• Administrativia

20
Monitoring _at_ MIX

• NOC monitoring tools
• Overall peering network health status
• 24x7 alerting system
• ISPs monitoring tools
• Realtime and historical statistics system
• Available only for members

21
Network monitoring

• Network parameters
• Packetloss
• RTT
• Reachability v4-v6
• Switch parameters
• CPU load
• Chassis temperature

22
Reporting alerting

• Nagios RRD MRTG
• Widely used
• Highly customizable
• Pop-up/e-mail/sms alerts

23
Inter Provider Traffic Analyzer

• In cooperation with Padova Ricerche
• Detects peering traffic anomalies for ISPs
• Anomalies correlation mechanism
• Day-by-day analysis
• Realtime anomaly detection

24
IPTA
Real time analysis
Daily analysis
25
IPTA, future steps

• sFlow integration
• Type of traffic
• TCP, UDP, etc
• IP addresses
• Networks that are source or destination of
  traffic peaks

26
Monitoring on switches

• Statistical/historical purposes
• Nominal bandwidth check
• Anomalous peaks are excluded

27
Statistics for ISPs
28
Traffic matrix

• Traffic monitoring tool
• Based on sFlow technology
• Displays traffic exchanged between ISPs pairs on
  the public LAN
• Useful for bilateral traffic analysis and
  reshaping

29
Traffic matrix
30
Some more Details on

• MIX Infrastructure
• MIX Statistics and Monitoring Systems
• MIX News 2006
• Technical
• Administrativia

31
Technical Update 2006

• Access to MIX _at_ L2
• VOIP Project

32
Access to MIX _at_ L1 or L2

• To maximise the chances to reach MIX we allow
• Deployment of dark fiber from datacenters located
  in Caldera Campus or elsewhere (remote routers)
• Hosting of L1 (SDH, DWDM) equipment to deliver
  interconnection services to hosted routers
• Starting from 2006 also
• Hosting of L2 equipment to reach MIX through LAN
  extension services (remote routers)

33
Access to MIX _at_ L1 or L2
IP Backbone
IP Backbone
Peering Router
IP Backbone
Peering Router
SDH / DWDM transport
L2 Transport
Dark Fiber Terminating on optical box _at_ MIX
Peering Router
MIX DATACENTER
34
L2 Connections to MIX

• Carriers able to provide MPLS-L2 or more
  generally LAN extensions (metro carrier)
  transportations services can provide MIX remote
  access
• L2 operators must sign a separate contract
  with MIX with specific bilateral SLAs (tecnical
  and administrative)

35
L2 Domains of responsibility
Customer Operator Agreement
MIXCustomer Peering MoU
MIX Customer/Operator SLAs
MIX Operator Agreement
36
L2 Tech Policies

• Paradigm 1 MIX port 1 customer 1 MAC
  address
• 1 MIX port 1 Operator port 1 remote customer
• Mac Addresses filtering port security
• MIX IEEE OUI - based
• No Spanning Tree

37
VOIP Reasons

• Converging Networks Converged XP
• N-play services key for all our customers
• Voip Peering aside Internet peering maximises
  efficiency
• VOIP Italian XP

38
VOIP Objectives

• Help growth of a VOIP neutral marketplace
• Help newcomers and ISPs to get into the field
  (lowering initial investments by sharing border
  infrastructures)
• VOIP Quality Measurements Focus

39
VOIP Approach

• One-to-Many Vs. Any-to-Any in these early days,
  with so many different standards
• we feel is better for a VOIP provider to set up
  a single interconnection to a Normalizer and
  then being able to send traffic to other networks
  through it rather than maintaining a set of
  different interconnections, one for each Voip
  peering or transit partner
• Unfortunately BGP-4 is not there yet for Voip,
  and might not come for a while

40
VOIP Howto

• We carved a dedicated VLAN for VOIP on our
  switches to gain flexibility on IP routing (to
  avoid public IP and AS restrictions)
• We installed a cluster of Session border
  controllers as Normalizers for signalling and
  media, to hide topology between parties, and to
  act as data collector for statistics (IP
  transport and traditional voice quality
  parameters)

41
VOIP Flows
42
VOIP Ongoing Work

• Standardization support for presence, instant
  messaging and video calls
• Neutral Accounting on CDR
• Facilitate access to Emergency Numbers from pure
  Voip networks
• Build up a web marketplace for Long distance
  market
• Explore other services for SIP based peering
  (inter-domain access control, CDR coupling and
  encryption)

43
QA

• MIX N.O.C.
• noc_at_mix-it.net
• 39 02 40915701