Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
khresmoi:start [2012/02/28 15:01] hlavacova |
khresmoi:start [2012/02/29 13:40] hlavacova |
||
---|---|---|---|
Line 15: | Line 15: | ||
---- | ---- | ||
- | ==== Poznámky k datům ==== | ||
- | Píšu to rovnou sem nahoru, aby to bylo na ráně. | ||
- | Data z **JRC-Aquis** se během posledních několika týdnů změnila, takže nejsou kompatibilní se skriptem, který je k nim dodáván, ten se nezměnil. Měla jsem zálohovaná data z páru fr-en, tak jsem je zpracovala, jsou na svém místě. V adresáři original jsou i ostatní data, tj. pro páry de-en a cs-en, ale nejsou zpracovaná, | ||
- | Zpracování fr-en jsem provedla " | ||
- | Z porovnání obou paralelních fr-en dat usuzuji, že na ně byl použit jiný aligner. Lepší? | ||
- | |||
Line 28: | Line 22: | ||
^ Corpus ^ Source ^ Domain ^ EN-FR ^ EN-DE ^ alignment | ^ Corpus ^ Source ^ Domain ^ EN-FR ^ EN-DE ^ alignment | ||
- | | TDA translation memory | + | | TDA translation memory |
- | | CESTA Evaluation Package | + | | CESTA Evaluation Package |
- | | EQueR Evaluation Package | + | | EQueR Evaluation Package |
- | | CESART Evaluation Package | ELRA | in | | | | | 9000 Kw | | DONE | | + | | CESART Evaluation Package | ELRA | in | | | | | 9000 Kw | | DONE: |
- | | French Gigaword | LDC | news | | | | | 863 Kw | | | + | | French Gigaword | LDC | news | | | | | 863 Kw | | |
- | | Acquis | JRC | law | 1,25 Ms | 1,33 Ms | sent | | | | + | | [[khresmoi: |
- | | EMEA | European Medicines Agency | in | 373 Ks | 12 Mw | | 26.34 Mw | 14.9Mw | | + | | EMEA | European Medicines Agency | in | 373 Ks | 12 Mw | | 26.34 Mw | 14.9Mw | |
- | | MESH | U.S. National Library of Medicine | in | | | | 838 kw | | + | | MESH | U.S. National Library of Medicine | in | | | | 838 kw | |
| OrphaNet | | OrphaNet | ||
- | | Europarl | WMT12 | parl | 1.8Ms | 1.7Ms | sent | | | | DONE | | + | | Europarl | WMT12 | parl | 1.8Ms | 1.7Ms | sent | | | | DONE: |
- | | News Commentary | + | | News Commentary |
- | | News monolingual | WMT12 | news | | | | 181kw | 147kw | 162kw | DONE | | + | | News monolingual | WMT12 | news | | | | 181kw | 147kw | 162kw | DONE: |
- | | United Nations | WMT12 | un | 12.3Ms | | | | | | | + | | United Nations | WMT12 | un | 12.3Ms | | | | | | |
| French-English 109 corpus | WMT12 | web | 22.5Ms | | sent | | | | DONE | | | French-English 109 corpus | WMT12 | web | 22.5Ms | | sent | | | | DONE | | ||
| Medpedia wiki| Medpedia | in | | | Medpedia wiki| Medpedia | in | | ||
| Corpus Of Parallel Patent Applications (Coppa)| WIPO | in | 24,8Mw = 1,2Ms | | sent | | | Corpus Of Parallel Patent Applications (Coppa)| WIPO | in | 24,8Mw = 1,2Ms | | sent | | ||
- | | Corpus Of Parallel Patent Applications (Coppa)| WIPO | in | 33,5Mw | | par | | + | | Corpus Of Parallel Patent Applications (Coppa)| WIPO | in | 33,5Mw | | par | |
| Corpus Of Parallel Patent Applications (Coppa)| WIPO | tech | 153,8Mw = 7,5Ms | | sent | | | Corpus Of Parallel Patent Applications (Coppa)| WIPO | tech | 153,8Mw = 7,5Ms | | sent | | ||
- | | Corpus Of Parallel Patent Applications (Coppa)| WIPO | tech | 178,8Mw | | par | | + | | Corpus Of Parallel Patent Applications (Coppa)| WIPO | tech | 178,8Mw | | par | |
| MAREC | Wien TU | in | ? | ? | ? | | | | MAREC | Wien TU | in | ? | ? | ? | | | ||
| Springer Bilingual Corpus | much.more | in | | 1.09 Mw | sent | | | | Springer Bilingual Corpus | much.more | in | | 1.09 Mw | sent | | | ||
Line 52: | Line 46: | ||
| OpenSubtitles2011 | OPUS | | | 5 Ms | sent | | | | OpenSubtitles2011 | OPUS | | | 5 Ms | sent | | | ||
+ | == Vysvětlivky == | ||
k, M ... thousand, milion | k, M ... thousand, milion | ||
w, s, f ... words, sentences, files (for parallel data only source (English) words are counted) | w, s, f ... words, sentences, files (for parallel data only source (English) words are counted) | ||
* viz podrobnější info v podsekcích | * viz podrobnější info v podsekcích | ||
+ | Sloupec Note obsahuje název podadresáře / | ||
+ | 8-) stažená data, ale nezpracovaná | ||
+ | :?: nevíme, jestli chceme | ||
+ | :-? chceme stahovat, ale zatím nevíme, jak na to ... z různých příčin | ||
+ | 8-O čekáme na data | ||
+ | :!: nějaký problém, podrobněji v poznámkách - prokliknout z prvního sloupce | ||
+ | |||
+ | |||
+ | [[khresmoi: | ||
+ | |||
=== Zdroje | === Zdroje | ||
- | __JRC Acquis__ | ||
- | http:// | ||
__MAREC__ | __MAREC__ | ||
Line 84: | Line 86: | ||
__korpus OPUS__ | __korpus OPUS__ | ||
http:// | http:// | ||
- | |||
- | __JRC Acquis__ | ||
- | http:// | ||
__ELDA__ | __ELDA__ |