Institute of Formal and Applied Linguistics Wiki

This paper emphasizes on using “one translation per discourse” heuristic in hierarchical phrase-based machine translation after getting motivated by “one sense per discourse” heuristic in Word Sense Disambiguation. A document (domain specific) is treated as a discourse unit in this paradigm. A novel approach of forced decoding is used to implement the heuristic in three different ways in machine translation system. Experiments are performed on Arabic-English and Chinese-English language pairs.

1. Paper on the similar approach by Carput (2009) has found to be different in comparison to this work. They have used “one translation per discourse” approach as a post-processing step for MT whereas this works integrate the proposed scheme inside the decoding model of MT system. The later approach could also affect the selection of neighboring phrases whereas same doesn't hold for Carput (2009).

1. Without giving any proper evidence, authors have speculated that modeling “one-sense-per-discourse” is similar to the human translators' nature of making consistent word choices for specific domains.

1. Forced Decoding is the decoding method in which for a given pair of source and target sentences, decoder searches for the translation rules that fit the target sentence for a given source sentence.

1. Term “cases” represent situations in which multiple occurrences of a given source phrase (f) in a document (d) might be translated using more than one different translation rules resulting in different target translations. Such cases are shown in Table 1, numbers shown in column “Translation counts” are the number of sentences in which source phrase occurred. E.g. in 4th row, Korea=2 shows that word “Korea” is produced as target translation in 2 sentences whereas in last column same source phrase is translated as “the” in one sentence and as “which” in other sentence.

1. After selecting sample cases, few filtering techniques have applied to discard the irrelevant samples. Filtering steps are well documented in the paper on page 419 in first paragraph of 2nd column.

1. The core idea of maintaining translation consistencies (TC) is implemented by intrdocuing bias towards TC in form of “consistency features”. Three consistency features are used inside the decoding model and their values are estimated using 2-pass decoding scheme.

1. BM25 which is used as term weighting function is a well known ranking function in the filed of information retrieval and a refined version of TF-IDF (another ranking function uses in IR).

1. C₁ is a fine-grain approach of term weighting function and it is computed by counting how many times rule was applied in first-pass. This approach suffers when source and target phrase differs only in non-terminal positioning or use of determiners.

1. C₂ on other hand is a coarse-grain function which takes only target tokens into account. To us, C2 looks similar to the language model feature but trained only on the target side of the dev set.

1. C₃ goes over all alignment pairs and for each rule it select those term pairs that have maximum feature vaue.

Evaluation:

1. Cdec's implementation of Hierarchical MT is used in this work. As we know, hierarchical decoding is also implemented in other MT systems such as Moses, Joshua etc. The selection of cdec over other MT systems is authors' personal choice and doest not bring extra benefits.

1. MIRA is used to train the MT system.

1. Authors don't tune decoder in first-pass i.e. they don't calulcate feature weights (lambda) and probably they use weights from their previous experiments or setups. They don't clearly state the reason of this decision but our hypothesis is they might skiped the tuning step just to speed up the translation process.

1. NIST-BLEU is used to compare results with official NIST evaluation whereas IBM-BLEU is used for evaluating the rest of experiments. We don't fully understand the use of different BLEU (prefering shorter sentences incase of NIST and longer incase of IBM) for evaluation and not sticking with NIST-BLEU only.

1. They gain maximum of 1.0 point increase in BLEU after combining all three features.

1. Authors called BLEU as a “conservative measure” due to negatively marking their system whenever a selection of content word didn't have exact match in reference translation. We strongly disagree with their claim because baseline is also evaluated using same the metric and it also suffers with decreasy in accuracy because of content word mismatch. We see two solutions to the mentioned issue:

i- They could have supported their argument by manually evaluating the test set.
ii- Instead of wasting half of the page length by criticizing over BLEU, they could have evaluated their system on other metric such as METEOR.

1. Also, significance testing is not performed.

Paper is nicely written and all experiments are well documented. We believe that consistent translation choices system is better suited only for translating from direction of morphologically-rich to morphologically-low language pairs but in case of reverse direction this approach can make serious errors by putting different morhological forms of the words bearing different meanings under the conistent translations.