Sound Empirical Evidence in Software Testing Gordon Fraser, and Andrea Arcuri

1
Sound Empirical Evidence in Software
TestingGordon Fraser, and Andrea Arcuri
Gordon Fraser and Andrea Arcuri. 2012. Sound
empirical evidence in software testing. In
Proceedings of the 2012 International Conference
on Software Engineering (ICSE 2012). IEEE Press,
Piscataway, NJ, USA, 178-188.

• ???? ??(????)

2012?08?30? ICSE???2012
2
????

• ??
• ????????????,?????????????,???????????????????????
  ??.
• ?????????????????????,????????????(???????)???????
  ???,threats to external validity??????.
• ??
• ????????????,???????????????????????????,?????????
  ??????.

3
?????

• SourceForge??????100??Java??????????,??????.
• ?????????????,????????????????EvoSuite????.
• ????????????.????????????????????????,?????????.
• ???????????(??????????????)????????.

4
??

• ???????????????.?????????,??????????.
• ???????????
• GUI???????????
• ????????????????
• ????????????????????????,????(??????????)?????????
  ?????????.
• ????????????????????????.

5
?????

• ?????????????,????????????????????.
• ????????????????.
• ????????.
• ?????????,???????????.
• ????????????????.
• ??????122???????.
• ????????????????.
• ????????????????,??????????.

6
Privacy and Utility for Defect Prediction
Experiments with MORPH

• Fayola Peters, Tim Menzies (West Virginia
  University )

???? ??(NTT???)
7
????

• ???????????????????????????????????
• ????????????,???????????????????????????
• ?????????????,??????????????????????????
• ???????????????,???????????????MORPH?????

8
???????????????

• ?????????????????
• ????????????????????????

name wmc dit cbo lcom loc ???
taskdefs. ExecuteOn 11 4 14 29 395 0
Default Logger 14 1 8 49 257 1
taskdefs. TaskOut- putStream 3 2 1 0 58 1
taskdefs. Cvs 12 3 12 32 310 0
taskdefs. Copyfile 6 3 4 1 136 1
NoBanner Logger 4 2 3 0 59 0
?????????!
????????,??????????????????!
9
?????????????

• ??????????????????
• ????????,??,etc

name wmc dit cbo lcom loc ???
taskdefs. ExecuteOn 11 4 14 29 395 0
Default Logger 14 1 8 49 257 1
taskdefs. TaskOut- putStream 3 2 1 0 58 1
taskdefs. Cvs 12 3 12 32 310 0
taskdefs. Copyfile 6 3 4 1 136 1
NoBanner Logger 4 2 3 0 59 0
10
?????????????

• ??????????????????
• ????????,??,etc

name wmc dit cbo lcom loc ???
taskdefs. ExecuteOn 11-14 lt5 gt10 25-50 gt250 0
Default Logger 11-14 lt5 lt10 gt250 1
taskdefs. TaskOut- putStream lt7 lt10 lt150 1
taskdefs. Cvs 11-14 lt5 gt10 25-50 gt250 0
taskdefs. Copyfile lt7 lt5 lt10 lt10 lt150 1
NoBanner Logger lt7 lt5 lt10 lt10 lt150 0
11
MORPH??????????

• MORPH yi xi (xi - zi) r
• ?????????????MORPH?????
• ??????????????????
• ?????????
• ????(???????????????????????)?????

??????
???????
???????
????????????
12
???????

• MORPH??????????????
• 10?OSS???????????????
• MORPH????????????,3?????????????,???????
• ??
• MORPH??????,????????????????????1/4???(Fig.5??)
• ?????????????????????(Fig.5??)
• MORPH??????????????????????,???????????????????(Fi
  g.6,7??)

13
Bug Prediction Based on Fine-Grained Module
HistoriesHideki Hata, Osamu Mizuno and Tohru
Kikuno

• ???? ??(????)

2012?08?30? ICSE???2012
14
??????????????

• ???????1?
• ????????????????,??????????????????????????
• ??????????????????????,???????????????????????
• ??????? v.s. ???????/???????????????

??????,?????? ?????????
??????????????????????????????,?????????????????.
15
Historage
Hideaki Hata, Osamu Mizuno, and Tohru Kikuno.
Historage fine-grained version control system
for Java.IWPSE-EVOL '11. pp. 96-100. 2011.

• ????????????????????
• ????????????GIT????????

???????????????????????,??????????????????????????
16
????

• RQ1???????????,???????????????????????
• RQ2?????????????,?????????????????????????
• RQ3?????????,???????????????????

YES
???? gt ???? gt ?????
????????????,?????????????? ??????,???????????????
?
YES
????????,????????????
??????.???????????????????.
17
??

• 1?(????),2?(????)?????????
• ??????? v.s. ????????
• ??????????????
• ????????????????????
• ???????????,?????????.
• 10-fold cross validation 1,000 run
• ????????? ????????????????????????????????????