????????? Network Performance Evaluation and Testing

1
?????????Network Performance Evaluation and
Testing

• ??? ???
• Sichuan Network Communication Key Technology
  Laboratory
• xyzhang_at_swjtu.edu.cn
• 87601745-604

2
?6????????
6.1 ?????? 6.2 ??????? ? 6.3 ??????? 6.4
?????? 6.5 ??????? 6.6 ?????????
3
??????????????,??????? 1)
?????????????????,????????? 2)
???????????????? 3) ?????????,????????????
Performance Testing??????Conformance
Testing??????Interoperability Testing,??????
????????,?????????,???????????????,??????????

4
????????? 1)???????,??????????????????????,??????
??????????????????? ???????????????????,?????(
Formal)?????(Protocol Verification)????????? 2)???
???????????????????????????????????????
5
6.1 ??????
1???????????????????? ??????????QoS?????,????
????????????????????????????????,????????????,????
???????????????????????????????????????????,????(P
rotocol Engineering)??? ???????????????????,?
???????,?????????????????????,???????????,????????
?,???????????????????????????????????
6
??????
(1)????????????,????? (2)???????????,????? (3)????
??????????????,?????????????????????????????????
?,???????????????? (4)???????????????,????????????
?????????????????????????????????????????? (5)???
???????????? (6)?????????,?????????,??????????????
???????
7
??????
?1 ??????(???)
8
2????????
??????????????????????????????????????????,???
???????????,?????????????????????????,????????????
??????,???????????????????????,???????????????????
??,???????????????????,??????????????????????
????????,????????
9
????????????????????????,????????(IUTImpleme
ntation Under Test)?????,???????,?????????,??IUT??
????????????????? ???????????,????????????
????????????,??????????????
10
3????????
????????????????????????????????? (1)
?????(Conformance Testing) ?????????????,????????
??(IUT)???????????? (2) ????(Performance
Testing) ??????????????(????????????????????????)
????????????????????????????,???????????,?????????
????
11
(2) ??????(Interoperability Testing)
?????????????????????(??????X.400?SMTP)???????????
???????? (3) ?????(Robustness Testing)
??????????????????????(????????????????)?
12
4??????????
1)OSI/RM????????? ??(Protocol)??(Service)SA
P (Service Access Point)??????(Abstract Service
Primitive)PDU (Protocol Data Unit)SDU (Service
Data Unit) N-PDU(N-1)SDU
13
2)???????
????(Primitive)?????????????,??????????SAP??
??????,???????????ISO/OSI????????????? ?
Request ???????????????????????,????,????????
? Indication ????????????????,?????,????,????????
? Response ?????????Indication,??????Indicatio
n? ? Confirmation ???????????????
???????????????(Request?Response),??????????????(I
ndication ?Confirm)?
14
???????
15
???????????????????
???????????    (1) ???????      
CONNECT.request????????????       
CONNECT.indication????????????????    
CONNECT.response???????/?????????       
CONNECT.confirm??????????????    (2)
???????        DATA.request??????       
DATA.indication???????    (3) ???????       
DISCONNECT.request??????       
DISCONNECT.indication???????????
16
??????????????????
? CONNECT.request   ????????
  ? CONNECT.indication   ?????????
  ? CONNECT.response   ???????
  ? CONNECT.confirm   ??????????
  ? DATA.request   ????????????
  ? DATA.indication   ?????????
  ? DATA.request   ????????
  ? DATA.indication   ??????????
  ? DISCONNECT.request   ?????
  ? DISCONNECT.indication   ????????,??????


 
17
3)?????
???????????????SAP????????????????????
OSI/RM???/???????(Action/Behavior)???,???????????
(Protocol state)?,????(Event)(???????)?????(?????
????????????-PDU)???????????????
18
???????
?????????N????????,N??????????,?????????,?????
????N????????????????????????????????
1)?????????????N???????,??????????????????????????
???? 2)????????????????????????(?????????????
??,??Event / Behavior (Action)?????????/????)
19
????
1) ????????????????????????????????????????(Ev
ent),??????????(N-Connect Request?Call
Connected) ?????????????????????????????????
???????(Action),?????????????????(Call
Request?N-Connect Confirm)
?????3???????(S0)?????????(S1)???????(S2)?
2) Event/Action
20
6.2 ???????
6.2.1 ???????? 6.2.2 ???????(ISO/IEC9646) 6.2.3
???????(????????) 6.2.4 ?????(ATS) 6.2.5 ???????
21
6.2.1 ???????
???????????????????,????????????????????????,???
????????????????? ???????????????????,???????
??,?????(IUT)??????,????IUT?????????????,??IUT????
????????????,???????????IUT???????????
22
??????????????,???????????????????????????????
?,??????????,?????????????????????????????
???????????????????????????????????????????????,??
??????????????????????????????????????????????????
???????????????????????????????????,???????????
23
6.2.2 ???????
1????????ISO/IEC9646 ?????????????????,?????
?????????90??ISO?????????ISO/IEC9646(CMTF
??????????),??????????????,???????????????????????
??????????????????????????(YD/T 1251)?
ISO/IEC9646??????????????????,?????????????????ISO
/IEC9646??????
24
ISO/IEC9646?? CTMF (Conformance Testing
Methodology and Framework)

• ISO/IEC 9646-1 ????(General concepts)
• ISO/IEC 9646-2 ???????(ATS Abstract Test Suite
  Specification)
• ISO/IEC 9646-3 ??????????(TTCN Tree and Tabular
  Combined Notation)
• ISO/IEC 9646-4 ????(Test Realization)
• ISO/IEC 9646-5 ???????????????????(Requirements
  on Test Laboratories and Clients for the
  Conformance Assessment Process)
• ISO/IEC 9646-6 ????????( Protocol Profile Test
  Specification)
• ISO/IEC 9646-7 ????????? (Implementation
  Conformance Statements)

25
2?????????
?ISO/IEC9646?,????????(IUT)???????????????????
???,????????????????????????,?????????????????????
? (1) ???????????????????? (2)
??????????????????????? (3)
?????????????????,????????
26
?????????(PICS,Protocol Implement Conformance
Statements)
?????????????,??????????????????????????????,
??????????,?????????????????????????????(PICS),???
???????,???????????????????
????????PICS??????,??IUT???????????,?????????(PIXI
T, Protocol Implementation Extra Information
Statement)??PIXIT????????????????,?????????????
27
?????????????????????? (1)
?????????????????????????????????????????????????
???????????????????????????? (2)
????????????????,???????????????????????????
??,????????????????????? (1)
??????????????????????????????PICS??????????????
??? (2) ???????????????IUT?????
28
3???????
???????????,?????????????????????????????????
?????,ISO 9646????????????? ??????(Basic
Interconnection Test),????(Capability
Test),????(Behavior Test),???????(Conformance
Resolution Test)? (1) ?????????IUT?????????,?
????????, ?????????????
29
(2) ???????IUT???????????? (3)
???????IUT???????????,??????????(Comprehensive
Testing)??????(Exhaustive Testing)????????????????
IUT???????,??????????????????????? (4)
??????????????????????????????????????,????,??CTMF
????????????????
30
IUT???????B, C, D???,???????????(????,????,??
??)????????????????????(?)????????????????? ?
B?(IUT????????)??????????????????? ?
C?(IUT????????????)??????????????,??????? ?
D?(IUT?????????)????,?????????
31
4????????????

• ???????,??????IUT???OSI???????,IUT???????????
  (SUT, System Under Test)?
• ?????(PCO, Points of Control and
  Observation)??????IUT?????????????PCO??IUT,???IUT?
  ??????,?????????
• Tester?IUT??????(PCO)???????????????SAP??

32
?????? SAP
????
??/?? ????
??/?? ????
?????? SAP
????? SAP
????
?2 ?(?????)????????PCO
33
?3???ISO/IEC9646??????OSI????????????????????
???????????
IUT ???? SUT ???? LT ???? UT ???? PCO ????? SAP
????? TCP ?????? ASP ?????? PDU ??????
?3 ???????????(????????)
34
?????(UT,Upper Tester)??????(LT,Lower
Tester),????IUT??????PCO,??PCO?IUT??????????,LT???
?????,??IUT???????PCO,??????????????????????,?????
?PCO?????FIFO??(??/??)? ?CTMF?,?????????????
????,IUT??????UT??,?????LT?????????,UT?????????IUT
?????,?LT?????IUT???????,????,UT?LT??????IUT?????
35
IUT?UT?LT??????????(ASP,Abstract Service
Primitives)?????????,LT?IUT????????(PDU)???????,P
DU??ASP???????????,?PDU????????,????PDU???????,???
????????PDU????,??ASP?PDU???????
??????TCP(TCP,Test Coordination
Procedures)????LT?UT???,??LT?UT???????????????3???
????????????????,????????????????????????????
36
?????---????????
??????????
37
5?IUT???????
?4?????CTMF?IUT????????
??IUT??????????????,??????????????????????????,??
?????? ??????????,??????????????????,????????
??????????,????????????????????????,?????????,???
???????
38
?4 IUT???????
39
6.2.3 ???????
??????
?????????LT?UT?TCP???????????????????SUT?????
?????????PCO????????ASP?PDU????????
????????,??????????????????????????????????????
40
1????IUT???????
ISO/IEC9646??Tester?IUT???????????,???????????
??????(Location)??????(External)?
????????????????????(???????IUT??)???????????,???
??????(Distributed test)??????(Coordinated
test)??????(Remote test)??????????????IUT???????PC
O?
41
1)????? (LTM Local test Method)
?????????????????????,??????UT?LT?IUT????????
?LT?UT?????IUT?????,???IUT?????,??????????IUT???,?
?????(TCP)????LT?UT???(?5)?
?5 ?????(LTM)
42
????????,??????IUT??????????????????????????
?????? ??? ????IUT??????????,????????????????
????????????? ? ??????????????????????PCO,????
???????????????,???????????????,??????????????
? ??????????????????,????????????????????
????????????????????
43
2)????? (DTM Distributed test Method)
?????????????IUT ?UT ????????,?LT????????????,
??6???LT?IUT???(n-1)???????,?????PCO?IUT???LT??
?6 ?????
44
????UT?????
??UT??????????,??UT????????????????????IUT?
????(??IUT????)????UT???????
UT??????(??????? ?UT???????????? ??????????)
UT
IUT????????????
IUT (Implementation Under Test)
????(UT)????????
45
?????????,????????????? ???
??UT?LT???????????IUT????,??UT?LT??????????,??????
??????????????????,????????????????????????????,??
????????????,??????????????????? ?
???IUT???????????????,???????????????(????????)?
46

• ?????????????????(UT)???,????????,????????,?LT?UT?
  ??????????,LT??,UT???????,???????(TR -Test
  Responder)?
• ????NBS??????????????????,?????????????????????
  ,?????,????????????????
• ??????LT?UT?????????

47
3)????? (RTM)
?7 ?????
??,?????IUT??????????,?UT????????,???????????
??????????UT,?????UT?LT??????
?????????????????????????????????????,????????????
?????????????????????????7,LT?IUT???(n-1)?ASP????,
?????n??(PDU)???
48
????????LT?????????????????IUT????,?????????
???? ????????????????????,??????DTM??????????
??,???????????????????????????????????????????????
49
??? ?????????????????????IUT???????SAP?????I
UT,?????IUT?????IUT?????????,?????????????IUT?????
???? ? ???????,???IUT??????????????????????,?
??????????IUT????????,????IUT????????????
??????LTM?RTM????,?RTM?????
50
4)????? (CTM Coordinated test Method)
?????????????(?8)? ?????????????????????TM
P (Test Management Protocol,??????),????????????UT
?LT?
?8 ?????
51
?????????TMP,???????????????????
??????????????????????????????TMP??????????,?????
???????????????
52
ISO???4????????
LTM????????????,????????????RTM????,???????,?????
??(??)????????????DTM,?CTM,????,?UT??????????????
???? ????????
53
2????????(Ferry-Clip Test Method)
1) ?ISO?????????? ?????????????????,????????I
UT??????????????,??????????????????????????,??????
IUT???????????????? ????????????????????????
???????????
54
??????????(National Physical
Laboratory)????,????????????????????????,Zeng?????
???????????????????,?????????????????????????(Fe
rry)???????????????????????????,???????????????
????,???????IUT??????????IUT????????????????????
55
2) ?????(Ferry Test Method)
? ?????????????????????
IUT??????? SAP
?? ?? (LT)
???? (UT)
?????
? ? ? ? ? ? ? ? ?
IUT (Implementation Under Test)
???
???
?IUT??? ?????
?IUT??? ?????
IUT??????? SAP
????
????
??????
?9 ?????????????
56
? ????(Ferry Clip)?????????(Ferry-Clip Test
Method)??????????
IUT??????? SAP
???? (LT)
???? (UT)
??????
? ? ? ? ? ? ? ? ? ? ?
? ?? ??
IUT
??? ??
?IUT??? ?????
??????
IUT??????? SAP
????
??????
????
?10 ??????????ISO?????
57
? ???????????????ISO?????????????????????ISO??????
?????????? ? ???????????????????????????????????
??????????????????????????????,??7????,???????????
????OSI???????????????????????
58
3?????IUT???????
1) ??/????????? ? ??/?????Conformance
Testing????????????? I/O????????????????,?????????
?,????I/O???????????,???????????????????? ?
????????????/??????? ????????/????????????(????)?
59
? ???????????????????(???????????????)?????,??????
??????????????????(????????)? ???????????????(??
????)? ??????????????????????(??????)? ???????????
??????(??????????)?
60
? ?????????????????,???????????????,???????,??
?????????????? ????????????????(Relay
Function)??????,????????????,????????????????,????
NN?????,???????????????11???
?????????????????,????????????????,?????????????
61

• ????????,??????PDU??????(??????),?????????????
  
• ISO 9646?Conformance test????????????????????
  
• ??????????????

62
2) ??????(Loop-back Test Method)
??????????????,???????????????????????,???????
????,?????????,???????????????????,???????????????
?
63
(b) ??????????
64
????????
???? ????????????,???????????????????,??????????
,???????????????????????????????????
65
3) ??????(TTM - Transverse Test Method)
?????????????????????,?????????????????????????
?????????,???????????????????????????,????????????
?
66
(No Transcript)
67
?????(Transverse Test Method)?????
?????????????????????,????????????????????
??????? ??????????????????????????????????
??????,??????????????????????/????????,?????,????
???????
68
4????????

• ? ???(End-System)
• 7/5??????????Conformance?
• ???????(?/??????)????????SAP??/?????????
• Local Test Method(????????)
• N-SAP(????) (N-i)-SAP(????)
• Remote Test Method(????????)
• N-SAP(???) (N-i)-SAP (????)
• Distributed/Coordinated Test Method (?????????)
• N-SAP(????) (N-i)-SAP(????)
• ???(Lower Tester)?????????,???????????????
  ???IUT????(N-i)-SAP?

69

• ? ??/????(Relay/Intermediate System)
• ????(U-Platform) ?????, ?????Performance?
• ??????(SM-Platform) 7/5?,?????Conformance?
• ???????????????????RTM,?????(N-i)-SAP??????,N-SAP?
  ????)?
• ????????????/??????????????????,???????????
• ???????(Lower Tester)?
• ? ??????????????!

70
5?????(LT)?????

• 1)??????
• ? ??????????????????
• ??????(IUT)?????,?(N-i)?N???????
• ?????(N-i)-SAP??????IUT???,?????(N-i)-Service????
• ?????????
• ????????????(N-i)????????(??????),????(N-i)???????
  ?????(??????)
• ???????IUT?????????,???IUT???????????(PDU)?(??????
  ??)

71

• ?????????IUT?????????????,?????????????????????(??
  ?????????????)
• ??IUT???????(N?????),????????????????(N-i)-Service
  ??,??????,???????????????????????????????????,?IUT
  ?????????????,?????????????????
• ????????????????????????(????????)????????????????
  ???????????????(????????)?

72

• ???????????????,??
• ????????(??????)????
• ????????Logging
• ??????????/??????????????/???????(Test Case
  Selection)

73
2)??????

• ??????(?/?) Test Support Platform
• ?????????????Test Definition Language
  Compiler/Interpreter
• IUT??????(?????) IUT Peer
• ??????(???????)Test Executor
• ??(??????)???? Test Interface Module

74
???????RTM?Tester????
75
6.2.4 ???(TS)?????
??????????????????? ? ??????????????? ?
????????????????????? ??,???(Test
Suite)?????????,?????????????????,???????,????????
???????????,??????????????,??????????????????????
?????????????????
76
???????,?????????3??? ???????????????????
??????????????????????????????????(ATS)
?????????,??????????????????????????(ETS)
?????????(TE),????IUT???????(Case),????IUT???????,
???IUT????????????????
77
1??????(ATS)
1)ATS?? ?????????,?1????????
?????(Test Suite)???????????,???????(Test
Group)???????????????????(Test
Purpose)???,????????????????????(Finite State
Machine,FSM)?????,????????????????????,???????????
????????????????
78
???????,??????????????????,???????????????
?1 ??????
?2 ??????
79
?2 ??????
???????????? ??????????????IUT???????,
???????????????(Test Sequence)?????????????,??????
??????body??????body?,?????????preamble,?????????
???IUT??????,????body???body?,????IUT?????????FSM?
????????,????????????,??????????postamble,?IUT????
?(????),??2?
80
???????(TTCNTree and Tabular Combined Notation,)
????????(Test Step)????,?????????
???????,???????????????,????????????????????,?????
??????????,???????????????????????????preamble?ver
ification?postamble???????????,??????????????body?
???????,??????????????????????TTCN???????
81
?????????????????(Test Event),?????????????,
????ASPs?PDUs?Timer???????(????????????)?
?????????????????(???IUT???IUT???PDU?ASP???)??????
????????????????????????,??,?????????????????
82
2)ATS???
? ????ATS ???ATS??????,ISO/IEC9646-2???ATS????
???,??????????????? ? ???ATS??,??????????PICS,???
?????????? ? ????????????,???????? ?
?????????????????? ? ??????????????(GTC),???????
???,???Body?Event?????
83
? ????????????,?GTC???,???ATC,???????????,??????(
?LT)?????????(TCP)??? ? ??????????????(?TTCN),??
ATC???,??????????? ? ????????????PICS?????,?????
?????????? ? ????ATS????
84
? ????ATS
??,???????????????????????????FSM???,????????
????????,??FSM????????????????????????????????????
(GTS). ??????????,??????????(??????????????)?
?????????????????????????????????,????????????????
???????????????,???????????(ATS)?
85
2???????(ETS)
???????,??(IUT)?PICS?PIXIT
(????XML????),??????ATS?????????,??????????,???PIX
IT????????????????????(ATS)???????????????????????
???(ETS),?????????????IUT???????????
86
??????????????PICS/PIXIT????,???????????????
?,??????PICS/PIXIT?????? PICS/PIXIT?????????
? ???????????,????,????????
????????????Service ID,????,?????
??????????????????
87
3?????(TE)
????????????????????????(CTE)??????????(ITE)
? ?????????,?????????,??????ATS???????ETS???
????????????,????????,?????????????
???????????,?ATS?ETS???????????????,??????????????
??????????,???????????
88
6.2.5????????
???????????????? (1) ???????????????
(2) ?????(Test Suite)??????????????????,?????????
???????????????(ATS)? (3) ???(Test
Case)?????????PICS?PIXIT,?ATS?????????,???PIXIT??
???????????,?ATS?????????????????????(ETS)?
89
????????????
90
(4) ???? ?ETS?IUT??????????????????????
??,??????????ETS???????????,?????????????????,????
???????????????????????,???????????(step),????????
?,??????IUT????,????????,????????????PDU,?????????
??PDU????,???????
91
(5) ????????? ??,???????????????????????
??????,??????IU T ?????????????????????,??????????
? ??????????????????,?????????????????
92
?????????,?????????????????????
??????????????????????,??????,???????????????????
??,??????????????????,????????????,????????
????????,??????PCO?IUT?????????????,??????????????
?????,???????????????
93
6.3 ????????
6.3.1 ??????? 6.3.2 ????????? 6.3.3
???????????????
94
?????????,?????????,?????????????????
??????,???????????????????????????????????????????
?
95
6.3.1 ????????
??????????????????,??????ETSI?ITU-T?ISO?????
???????????,????? ? ETSI TS 102237
??????????ETSI TS 202237 ??????? ?
ITU-T????ITU-T Z.itfm ?????????? ?
ISO??????????????? ? ????????YD/T1521-2006
???????????????????????????????????????????,???
?????????????
96
?????????????,????????????????????????????????
?????????????????????????????,??????????????,?????
??????????????
97
6.3.2 ??????????
???????,??????????????????????????????????????
??????????????????????
?????????
98
?????????????? ? ????(Qualified
Equipment,QE)?????(EUT) ??????(???????)???????????
??????????????????,?????????????????? ?
???????????????,????????????????(Test
Driver)??????????????? ?
??????????????????,????????????????????,????????(M
MIs) ???????(PDIs) ???????(APIs) ?
99
?????????????????????????????????,???????????
????????????????? ? ???????????,?????????????
????????????????????????????????????(Interoperabl
e Features Statement,IFS) ??????????(Test Suite
Structure,TSS) ????????????IFS ?? ?
????,???????????????????????
100
6.3.3 ???????????????
???????????????????????????,????????????,?????
????? ? ??????,?????????????????????,????????
?????????????????? ? ??????,????????????????
???????????? ? ??????,??????????,???????????
? ??????,?????????????,????????????????
101
?????,??????????????????????????????????
? ??????????????,?????????? ?
????????(?????) ,????????,?????????? ?
????????????????,???????,???????
102
??????????????????????????,???????????????????
????????????,????????????????
??,???????????????,???????????????????????????????
????????????,??????????????????????
103
6.4 ????????
????????IUT,?????????????IUT?????????Tester??
?,???????,??????????IUT???????ASP?PDU????????IUT??
?????????????IAPs (Implementation Access
Points)? ????????,Tester??????IAPs,??Tester?I
UT??????????,??IUT????????????????????,Tester?????
?IUT??,?IUT???(????????)??,Tester?????????
104
??????????????????IUT????????????,???Tester?IU
T,??????IUT?????????(Test Context)?Tester?????????
???????PCOs,?????????????????CPs (Coordination
Points)? IUT,Tester,?????,?????,?????IAP,?????
PCO????CP?????????(??)?????????????????IUT,???,???
?????????????????,?????????????????????
105
(No Transcript)
106
????????????????????????????????????,?????????
??IETF?????????(BMWG)???????,??????????(??)???????
???
107
6.5 ???????
??????????????????????,?????????????????????
108
6.6 ?????????
???????????,????????????,??????????,?????????,??
??????,?????????????????????,????????????,???????
??????????????????????? ??????????????????????
???????????,????????,?????????????????????
???????????????????????
109
1??????????
???????????????????????????????,????????????
??????????,???????????????????????????????????????
?????????????????????? ?????????????????(FSM)
?Petri???????????????????
ISO????????????3??????????ISO?ESTELLE,LOTOS
?CCITT?SDL ?
110
2??????????
1)???????? 2)????????(????????) 3)?????????,????
??????????????????????????????????????????????????
4)?????????????? 5)?????????? 6)?????????????
111
???