????????????

1
??????????????????????????
1
2
3

• ???? ,???? ,William Byrne ,
• Simon King ,????
• ???
• University of Edinburgh
• Cambridge University

2
1
1
2
3
2
??(1/2)

• ????????
• ?????? ? 1-best?????
• ?????????????????????
• ????????????Ney, 99
• ???????????????????
• ? ???????
• ??????????????
• ?????????????????

3
??(2/2)

• ??????????????????
• ???????????
• ??????
• ????????
• ???????
• ???????
• ????????????
• ?????????????????

????????????????????
4
????

• ????????(Finnish-to-English)
• ?????
• ??????????????
• ?????
• HiFST (???????????)
• EuroParl 865,732????????
• ??20???????????
• ?????
• HMM????????
• ?????????8,129???????

5
???????

• ????(??5?)???????

N-best MT output sentence Speech
1 We support what you have said.
2 We support what you said.
3 We are in favour of what you have said.
4 We support what you said about.
5 We are in favour of what you said.
????? We can support what you said.
6
??????

• Amazon Mechanical Turk???
• Section 1 ???????
• ????????(Naturalness)
• Section 2 ???????
• ?????????(WER)
• ????????????(S2ST-Adequacy)
• ????????????(S2ST-Fluency)
• Section 3 ???????
• ???????(MT-Adequacy)
• ???????(MT-Fluency)
• ???150?

7
????????

• ?????????
• ??? ? ?????????
• ??? ? ????????
• ??????????????
• ???????????????????
• ? ????????????????

??? ???
??? 0.12 0.24
??? ???
??????? -0.17 -0.25
8
????????

• ????????????????

9
?????????

• ?????????????????

10
??N-gram????????

• ??N-gram
• ???N-1????????????????
• ??N-gram???? ? ?????
• ??N-gram????????????
• ???????????865,732?????
• SRILM toolkit (Kneser-Ney smoothing)

1-gram 2-gram 3-gram 4-gram 5-gram
MT-Fluency 0.28 0.39 0.42 0.43 0.44
11
??5-gram?????????

• ??5-gram??????????????
• ???? 0.87

12
??N-gram?????????

• ??????????????????
• ????????????????????
• ?????????????N-gram????
• ? ??????????
• ??N-gram????????????
• ???????????8,129?????
• SRILM toolkit (Kneser-Ney smoothing)

1-gram 2-gram 3-gram 4-gram 5-gram
Naturalness 0.05 0.15 0.19 0.20 0.18
13
??4-gram?????????

• ??4-gram??????????????
• ???? 0.81

14
???

• ??????????????????
• ??????????????????
• ????????
• ????????
• ????????????????
• ??N-gram ? ???????
• ??N-gram ? ????????
• ?????
• ?????????????????
• ??????????????????

15
??(3/3)

• ?????????????
• ?????????????????
• ???????????????
• ? ????????????????????

16
??5-gram????

• ????????????????
• ???? 0.44

17
??(1/2)

• ????????
• ?????????????????????
• (Speech-to-Speech Translation)
• ?????????????????????
• ????????????????????

18
??(2/2)

• ?????????????
• ???????????????
• ? ????????????????
• ???????????????
• ? ????????????????????