[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki

[ Back to the navigation ]

You are here: start » user » zeman » transliteration-of-urdu-to-latin-script

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
user:zeman:transliteration-of-urdu-to-latin-script [2010/11/09 15:34]
zeman Alef. 		user:zeman:transliteration-of-urdu-to-latin-script [2010/11/16 08:25] (current)
zeman ~
Line 1: Line 1:
 ====== Transliteration of Urdu to Latin Script ====== ====== Transliteration of Urdu to Latin Script ======
 +
 +Copyright © 2010 by Dan Zeman <zeman@ufal.mff.cuni.cz>
 +License: GNU GPL
 +This research has been supported by the grant of the Czech Ministry of Education no. MSM0021620838. 
  
 ===== Transliteration versus Transcription ===== ===== Transliteration versus Transcription =====
Line 18: Line 22:
 ===== Consonants ===== ===== Consonants =====
  
-Most of the consonants do not pose any serious problem. I decided to represent the retroflex consonants (ٹ, ڈ, ڑ) by a dot below their dental or other counterparts, as is usual across the Indo-Aryan languages. A dot above a letter distinguishes a two Arabic letters whose Urdu pronunciation is identical to other letters, from transliteration of those other letters (ث, ذ). Similarly, a cedilla below a letter distinguishes other five letters that occur in words of Arabic descent (ح, ص, ض, ط, ظ).+Most of the consonants do not pose any serious problem. I decided to represent the retroflex consonants (ٹ, ڈ, ڑ) by a dot below their dental or other counterparts, as is usual across the Indo-Aryan languages. A dot above a letter distinguishes two Arabic letters whose Urdu pronunciation is identical to other letters, from transliteration of those other letters (ث, ذ). Similarly, a cedilla below a letter distinguishes five other letters that occur in words of Arabic descent (ح, ص, ض, ط, ظ).
  
 Some other notes: //j// is pronounced as in English, not as in Czech or German. //č// and //š// are used in Baltic and Slavic languages (among others) to represent the sounds that are usually written “ch” or “sh”, respectively, in English. Of similar descent is the character //ž//; the corresponding sound is sometimes represented as “zh” in English and corresponds to the French pronunciation of //j//. //x// represents (in accord with phonetic tradition) the same sound as Czech/German/Scottish “ch”. English-oriented transcriptions of Arabic often transcribe this sound as “kh”, a solution that we want to avoid. It would conflict with the aspirated //kh// of Urdu. //ğ// is taken from Turkish and describes the sound that is often transcribed “gh” from Arabic (which we cannot use, again because of the aspirated //gh//). Some other notes: //j// is pronounced as in English, not as in Czech or German. //č// and //š// are used in Baltic and Slavic languages (among others) to represent the sounds that are usually written “ch” or “sh”, respectively, in English. Of similar descent is the character //ž//; the corresponding sound is sometimes represented as “zh” in English and corresponds to the French pronunciation of //j//. //x// represents (in accord with phonetic tradition) the same sound as Czech/German/Scottish “ch”. English-oriented transcriptions of Arabic often transcribe this sound as “kh”, a solution that we want to avoid. It would conflict with the aspirated //kh// of Urdu. //ğ// is taken from Turkish and describes the sound that is often transcribed “gh” from Arabic (which we cannot use, again because of the aspirated //gh//).
Line 60: Line 64:
 | 0645 | م | m | m | | 0645 | م | m | m |
 | 0646 | ن | n | n | | 0646 | ن | n | n |
-| 06BA | ں | n | ñ |+| 06BA | ں | ~ | ñ |
 | 0648 | و | v | w | | 0648 | و | v | w |
 | 06C1 | ہ | h | h | | 06C1 | ہ | h | h |
Line 68: Line 72:
 ===== Vowels ===== ===== Vowels =====
  
-The consonant (or semi-vowel) و //(w)// is also ambiguously used to represent the long vowels //ū// (pronounced as //oo// in English //fool//) and //o// (pronounced as //oo// in English //door//). I want to distinguish these three pronunciations. In most cases however, the script can only output //[wūo]// and leave the disambiguation to a human judgment:+The consonant (or semi-vowel) و //(w)// is also ambiguously used to represent the long vowels //ū// (pronounced as //oo// in English //fool//) and //o// (pronounced as //oo// in English //door//). I want to distinguish these three pronunciations (note however that I am not attempting to further distinguish //o// from the slightly different vowel //ao// that is pronounced as //au// in English //automatic//; I am pretending that these two are identical). In most cases however, the script can only output //[wūo]// and leave the disambiguation to a human judgment:
  
   * In word-initial position, I assume that only consonantal pronunciation is possible and always output //w//.   * In word-initial position, I assume that only consonantal pronunciation is possible and always output //w//.
Line 76: Line 80:
   * In all other cases I output //[wūo]//.   * In all other cases I output //[wūo]//.
  
-The consonant (or semi-vowel) ی //(y)// is also ambiguously used to represent the long vowels //ī// (pronounced as //ee// in English //feet//) and //e// (pronounced roughly as //ai// in English //fair//). I want to distinguish these three pronunciations. In most cases however, the script can only output //[yīe]// and leave the disambiguation to a human judgment:+The consonant (or semi-vowel) ی //(y)// is also ambiguously used to represent the long vowels //ī// (pronounced as //ee// in English //feet//) and //e// (pronounced roughly as //ai// in English //fair//). I want to distinguish these three pronunciations (note however that I am not attempting to further distinguish //e// from the slightly different vowel //ae// that is pronounced more open; I am pretending that these two are identical). In most cases however, the script can only output //[yīe]// and leave the disambiguation to a human judgment:
  
   * In word-initial position, I assume that only consonantal pronunciation is possible and always output //y//.   * In word-initial position, I assume that only consonantal pronunciation is possible and always output //y//.
Line 93: Line 97:
 The letter آ (ALEF MADDA) only appears in word-initial position and is transliterated as //ā// (which is written in other positions using normal ا). The letter آ (ALEF MADDA) only appears in word-initial position and is transliterated as //ā// (which is written in other positions using normal ا).
  
 +The YEH with the diacritic HAMZA above separates two consecutive vowels, e.g. جائے گا //jāe gā// “will go” or کوئی //koī// “some”.
 +
 +Similarly, the diacritic HAMZA above a و separates it from the preceding vowel as in ہاؤسنگ //hāūsing// “housing”. (In this case, the hamza is a separate character that is placed in the logical sequence after the و.)
 +
 +^ Unicode ^ Character ^ Pronunciation ^ Transliteration ^
 +| 0627 | ا | -, a: | a, i, u, 0, ā |
 +| 0622 | آ | a: | ā |
 +| 0648 | و | v, u:, o: | w, ū, o |
 +| 06CC | ی | j, i:, e: | y, ī, e |
 +| 06D2 | ے | e: | e |
 +| 06D3 | ۓ | e: | e |
 +| 0624 | ؤ | u:, o: | ū, o |
 +| 0626 | ئ | -, i:, e | 0, ī, e |
 +| 0654 | (hamza above)ٔ | - | 0 |
 +| 0674 | (high hamza)ٔ | - | 0 |
 +
 +The transliteration script should contain a gradually growing vocabulary that would help disambiguate known words. Otherwise there would be a very high number of ambiguous positions in any transliterated string.
 +
 +===== Short Vowels and Diacritics =====
 +
 +Without diacritics (which is more common), every consonant that is not followed by a long vowel may or may not be followed by a short vowel. I denote this possibility by the character for the neutral vowel schwa: //ə//.
 +
 +//Warning! This section is under construction. I am still confused about the exact rules for Urdu vowel representation, so I also expect more errors to occur here.//
 +
 +Although used rarely, Urdu has means to mark the three short vowels as well. This is done using one of the three diacritical marks. Long vowels can be disambiguated as well, e.g. a consonant with the pesh mark followed by a waw without any diacritic means that the waw is a long vowel //[ūo]// but not the consonant //w//.
 +
 +^ Unicode ^ Unicode Name ^ Urdu Name ^ With Beh ^ Transliteration ^
 +| 064E | ARABIC FATHA | zabar | بَ | ba |
 +| 064F | ARABIC DAMMA | pesh | بُ | bu |
 +| 0650 | ARABIC KASRA | zer | بِ | bi |
 +
 +pesh (ARABIC DAMMA, 064F) ... u ... کُون //kon// “who”
 +zabar (ARABIC FATHA, 064E) ... a ...  کَون //kawn//
 +zer (ARABIC KASRA, 0650) ... i ... 
 +
 +Possible further reading:
 +  * http://en.wikipedia.org/wiki/Arabic_diacritics
 +  * http://users.skynet.be/hugocoolens/newurdu/vowels.html
 +
 +===== Vocabulary of Frequent Words =====
 +
 +Some frequent words cannot be disambiguated by character-based rules alone but a vocabulary could identify them as existing unambiguous Urdu words and save much manual work by disambiguating them. Here are some examples:
 +
 +  * ہے => he (“is”)
 +  * میں => meñ (“in”)
 +  * ایک => ek (“one”)
 +  * اور => or (“and”)
 +
 +Note however that there are inherently ambiguous words that cannot be disambiguated without human intervention (or at least without looking at the neighboring words). Examples:
 +
 +  * تو => to (“so”) | tū (“thou”)
 +  * اس => is (“of this”) | us (“of that”)
 +  * ان => in (“of these”) | un (“of those”)
 +
 +===== The Transliteration Script =====
 +
 +You need two files. All of the transliteration knowledge is encoded in the library ''urdund.pm''. The Perl script ''translit_urdund.pl'' merely reads the standard input, passes it through the library and sends the result to the standard output. It is called like this:
 +
 +<code bash>perl translit_urdund.pl < urdu.txt > latin.txt</code>
 +
 +If you happen to sit on the ÚFAL network, you will find the script in ''~zeman/projekty/transliterace''. It should be able to find the library itself; the library is in ''~zeman/lib/translit'' (you will find programs and libraries for other writing systems in these two folders as well).
 +
 +I am also attaching the current snapshot of the two folders to this wiki {{:user:zeman:translit.zip|here}}. Note however that it will not be updated regularly.
 +
 +This is an example of an Urdu sentence and the romanized output by the script:
 +
 +  * آپ کو پچھلے 182 دنوں میں اپنی بیماری یا معزوری کے سبب مندرجہ ذیل میں سے کوئی ایک ملتا رہا ہے ؟
 +  * āp ko pəčhəle 182 dənoñ meñ əpənī b[yīe]mārī yā məˀəz[wūo]rī ke səbəb mənədərəjəh ż[yīe]l meñ se koī ek mələtā rəhā he ?
 +
 +Afterwards, a speaker of Urdu is supposed to edit the transliteration and disambiguate all remaining cases:
 +
 +  * āp ko p**ə**čh**ə**le 182 d**ə**noñ meñ **ə**p**ə**nī b**[yīe]**mārī yā m**ə**ˀ**ə**z**[wūo]**rī ke s**ə**b**ə**b m**ə**n**ə**d**ə**r**ə**j**ə**h ż**[yīe]**l meñ se koī ek m**ə**l**ə**tā r**ə**hā he ?
 +    * Of alternatives in brackets, one has to be selected. Sometimes the brackets do not list all possibilities but they are easy to guess. For instance, [yīe] should in fact be [əyə|ī|e].
 +    * The schwa //ə// is a shortcut for [aiu] or an empty string (no vowel here).

[ Back to the navigation ] [ Back to the content ]