Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision | Next revision Both sides next revision | ||
courses:rg:overcoming_vocabulary_sparsity_in_mt_using_lattices [2010/11/29 23:31] ivanova |
courses:rg:overcoming_vocabulary_sparsity_in_mt_using_lattices [2010/11/29 23:32] ivanova |
||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== Overcoming Vocabulary Sparsity in MT Using Lattices | + | ====== Overcoming Vocabulary Sparsity in MT Using Lattices |
=== Steve DeNeefe and Ulf Hermjakob and Kevin Knight === | === Steve DeNeefe and Ulf Hermjakob and Kevin Knight === | ||
- | ====== | ||
- | + | ===== Overview of the article | |
- | ==== Overview of the article ==== | + | |
Line 14: | Line 12: | ||
- | ==== Introduction ==== | + | ===== Introduction |
The article is about overcoming the problem of vocabulary sparsity in SMT. The sparsity occurs because many words can have inflection or can take different affixes while in the vocabulary we might not find all those forms. | The article is about overcoming the problem of vocabulary sparsity in SMT. The sparsity occurs because many words can have inflection or can take different affixes while in the vocabulary we might not find all those forms. | ||
Line 47: | Line 45: | ||
There is no information in the article about how the rule is selected in case there are suitable rules for one affix. Probably they have uniform distribution of rules and they leave to a language model to choose one. | There is no information in the article about how the rule is selected in case there are suitable rules for one affix. Probably they have uniform distribution of rules and they leave to a language model to choose one. | ||
- | ==== Challenge (3) ==== | + | ===== Challenge (3) ===== |
The third challenge is to correct spelling mistakes. If the word has one spelling mistakes, they try to correct. But they don't remove the original word, they just add the found options. If the word has more than one spelling mistakes, they do not deal with it. | The third challenge is to correct spelling mistakes. If the word has one spelling mistakes, they try to correct. But they don't remove the original word, they just add the found options. If the word has more than one spelling mistakes, they do not deal with it. |