Viseme Explained

pronounced as /notice/A viseme is any of several speech sounds that look the same, for example when lip reading.[1]

Visemes and phonemes do not share a one-to-one correspondence. Often several phonemes correspond to a single viseme, as several phonemes look the same on the face when produced, such as pronounced as //k, ɡ, ŋ//; as well as pronounced as //t, d, n, l// and pronounced as //p, b, m//). Thus words such as pet, bell, and men are difficult for lip-readers to distinguish, as all look like alike. On one account, visemes offer (phonetic) information about place of articulation, while manner of articulation requires auditory input.[2]

However, there may be differences in timing and duration during natural speech in terms of the visual "signature" of a given gesture that cannot be captured by simply concatenating (stilled) images of each of the mouth patterns in sequence.[3] Conversely, some sounds which are hard to distinguish acoustically are clearly distinguished by the face. For example, in spoken English pronounced as //l// and pronounced as //r// can often sound quite similar (especially in clusters, such as 'grass' vs. 'glass'), yet the visual information can disambiguate. Some linguists have argued that speech is best understood as bimodal (aural and visual), and comprehension can be compromised if one of these two domains is absent.[4]

Visemes can often be humorous, as in the phrase "elephant juice", which when lip-read appears identical to "I love you".

Applications for the study of visemes include speech processing, speech recognition, and computer facial animation.

Further reading

Notes and References

  1. Fisher . Cletus G. . Confusions Among Visually Perceived Consonants . Journal of Speech and Hearing Research . 1 December 1968 . 11 . 4 . 796–804 . 10.1044/jshr.1104.796 . 5719234 . subscription .
  2. Summerfield . Quentin . Lipreading and audio-visual speech perception . Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences. 29 January 1992 . 335 . 1273 . 71–78 . 10.1098/rstb.1992.0009 . 1471-2970 . 0962-8436 . 1348140. subscription .
  3. Calvert . Gemma A. . Campbell . Ruth . Reading Speech from Still and Moving Faces: The Neural Substrates of Visible Speech . Journal of Cognitive Neuroscience . 1 January 2003 . 15 . 1 . 57–70 . 10.1162/089892903321107828 . 12590843. 14153329 .
  4. McGurk . Harry . MacDonald . John . Harry McGurk . Hearing lips and seeing voices . Nature . 23 December 1976 . 264 . 5588 . 746–748 . 10.1038/264746a0 . 1012311 . 1976Natur.264..746M . subscription .