Network Measurements Research Group Charter Discussion BoF

1
Network Measurements Research GroupCharter
Discussion BoF

• Chairs Brian Tierney
• Richard Hughes-Jones
• GGF11 Honolulu

2
Intellectual Property Policy

• I acknowledge that participation in GGF11 is
  subject to the GGF Intellectual Property Policy.
• Intellectual Property Notices Note Well All
  statements related to the activities of the GGF
  and addressed to the GGF are subject to all
  provisions of Section 17 of GFD-C.1 (.pdf), which
  grants to the GGF and its participants certain
  licenses and rights in such statements. Such
  statements include verbal statements in GGF
  meetings, as well as written and electronic
  communications made at any time or place, which
  are addressed to the GGF plenary session,
• any GGF working group or portion thereof,
• the GFSG, or any member thereof on behalf of the
  GFSG,
• the GFAC, or any member thereof on behalf of the
  GFAC,
• any GGF mailing list, including any working group
  or research group list, or any other list
  functioning under GGF auspices,
• the GFD Editor or the GWD process
• Statements made outside of a GGF meeting, mailing
  list or other function, that are clearly not
  intended to be input to an GGF activity, group or
  function, are not subject to these provisions.
• Excerpt from Section 17 of GFD-C.1 Where the GFSG
  knows of rights, or claimed rights, the GGF
  secretariat shall attempt to obtain from the
  claimant of such rights, a written assurance that
  upon approval by the GFSG of the relevant GGF
  document(s), any party will be able to obtain the
  right to implement, use and distribute the
  technology or works when implementing, using or
  distributing technology based upon the specific
  specification(s) under openly specified,
  reasonable, non-discriminatory terms. The working
  group or research group proposing the use of the
  technology with respect to which the proprietary
  rights are claimed may assist the GGF secretariat
  in this effort. The results of this procedure
  shall not affect advancement of document, except
  that the GFSG may defer approval where a delay
  may facilitate the obtaining of such assurances.
  The results will, however, be recorded by the GGF
  Secretariat, and made available. The GFSG may
  also direct that a summary of the results be
  included in any GFD published containing the
  specification. GGF Intellectual Property
  Policies are adapted from the IETF Intellectual
  Property Policies that support the Internet
  Standards Process.

3
Agenda for NM-RG Meeting 7 Jun 1230

• Agenda bashing
• Note Takers Please
• Presentation of the Proposed Charter Brian
• Some examples of possible study areas Richard
• Possible topics for NM-RG Martin
• The way forward Discuss topics of interest All
• Charter Wordsmithing and Milestones Brian

4
The Proposed Charter

• The Network Measurements Research Group (NM-RG)
  will focus on the relationship between
• network performance characteristics and Grid
  middleware. The objective of NM-RG is to explore
• what aspects of the network are most important to
  Grid middleware, and explore how the
• knowledge of network behaviour such as bandwidth,
  latency, or jitter, might be used to build
• network-aware middleware.
• Specific topics of interest include, but are not
  limited to
• What network characteristics are most useful to
  Grid Applications ?
• What Characteristics are Network aware Grid
  applications using at the moment?
• Are there "derived characteristics"
  (combinations of characteristics) that are even
  more useful?
• When can passive monitoring be used, and when
  must active monitoring be used?
• Which Grid services should collect and publish
  passively collected network monitoring data?
• How to monitor Next Generation Grid Networks.
• The role of the NM-RG role is related to, yet
  quite distinct from that of the Network
  Measurement
• Working Group (NM-WG). The NM-WG is focused on
  specific mechanisms for publishing network
• monitoring data. The NM-RG will provide a forum
  for discussion of how Grid middleware might
• utilize such information. This is currently an
  open research question, and one we feel can best
  be

5
(No Transcript)
6
Relations between Characteristics

• Can a light-weight observation give good
  indication of network conditions ?
• From the work of EU DataGrid WorkPackage 7
• From the work of IEPM
• And many others
• More studies required

7
RIPE 1-way TCP throughput UK-SARA

• RIPE 1-way time ms
• Sara ? RAL
• 20 Oct 01
• RIPE 1-way time ms
• RAL ? Sara
• TCP Iperf prediction
• Mbit/s
• UCL ? Sara

8
Ping UDP throughput MAN-CERNFrom 20 Oct 01

• PingER rtt (ms)
• dl cern
• 1000 byte packet
• Forecast
• UDPmon throughput Mbit/s
• man cern
• 300 1400 byte frames

100
80
60
40
20
9
iperf TCP UDPmon throughput MAN-SARA From 20
Oct 01

• Iperf TCP throughput Mbit/s
• ucl sara
• 262144 byte buffer
• Forecast in Green
• UDPmon throughput Mbit/s
• man sara
• 300 1400 byte frames

100
80
60
10
(No Transcript)
11
Application scenarios of Network Cost Functions

• From the Work of EU DataGrid WorkPackage 7
  (Tiziana Ferarri)
• Resource Brokerage
• Identify most suitable Computing Elements (CE)
  Storage Elements (SE), according to a combined
  set of network criteria
• packet loss minimization
• Round Trip Time minimization
• throughput maximization
• Data management
• Estimate of the time needed to transfer a file of
  known size from a source SE to a destination SE
• Aadaptive remote file access
• If the file/files needed by a given application
  are only known at run time, the Application can
  optimise access to remote files based on the
  dynamic selection of the most appropriate Storage
  Element set.
• More studies required

12
The Network Cost Functions

• Example 1
• File_size (bits) Throughput (SourceSE,
  DestinationSE)
• Example 2 Closeness Ci,j (pli,j ,r i,j,th i,j )
• Given
• ri,j Round Trip Time between CEi and SEj
• Rmax max s,t ? rs,t ? for all CEs and SEt in a
  given set
• pli,j packet loss probability on the network
  path connecting
• CEi and SEj
• th i,j throughput of data transfer between
  CEi and SEj
• THmax max s,t ? ths,t ?
• Ci,j (pli,j ,r i,j ,th i,j ) 1 if CEi is
  local to SEj
• Ci,j (pli,j ,r i,j ,th i,j ) 0 if SE
  unreachable or if pli,j gt P where P
• is a configurable threshold
• Ci,j (pli,j ,r i,j ,th i,j ) (th i,j / THmax)
  ? ( r i,j / R rmax)
  
• where 0 lt? lt 1 otherwise

13
Closeness Ci,j (pli,j ,r i,j,th i,j )
Fig 1 alpha 1/2
Fig 2 alpha 1/10
14
(No Transcript)
15
Getting Involved in NMRG

• Network Measurements Working Group (NMWG) is part
  of the Performance and Information Systems area.
• Mailing list is nm-wg_at_gridforum.org
• Web-pageshttp//www-didc.lbl.gov/NMWGhttp//for
  ge.gridforum.org/projects/nm-wg/
• Join mailing list and participate
• Send an email to majordomo_at_gridforum.orgwith the
  body "subscribe nm-wg"