当前位置:首页 >> >>

A Speech Orientation Animation System to Disabled People


A Speech Orientation Animation System to Disabled People
JESULIANA NASCIMENTO ULYSSES, AURA CONCI Instituto de Computa??o – UFF, R Passo da Pátria 156, 24210-240, Niterói, RJ, Brasil nulysses@artnet.com.br , aconci@ic.uff.br Abstract. Audio disabled children or adults under oral rehabilitating therapy learn how to treat speech disorders or even how utter sounds imitating mouth elements position and movement. This technique has been proved beneficial to help people since specialized instructional program adopt it. The main proposal of this work is the development of an affordable tool to aid in this therapy. 1 Introduction A technique to teach deaf people is by lips reading. They can know how to speech by emitting sounds at the same time that they mimic mouth elements and movement. The therapy constitutes of in vivo teaching and auto-training sessions, and must rely on previous researches on what is the influence of each mouth element on the formation of the basic sound of a language (Warren and Kaiser, 1988). 2 Development The controlled facial animation is a complex task due to the huge complexity of the real structure of the face that is composed of muscle, bone and skin. The facial expression is related with speech mainly by mouth shape. The muscle movements control the lips and other elements of the face. The possible movements are caused by contraction or relax of muscles linear and sphincter. A linear muscle becomes thickened and shortened with contractions, and pull the face in a direction. Sphincter muscles are circular band muscles that encircle and close an orifice of the body or one of its hollow organs. On the face they surround the mouth closing the lips. Complex expressions are due to combination of these unidirectional movements. This work uses the Waters' abstract musclebased model (http://www.crl.research.digital.com/ projects/facial/facial.html) to control the synthetic face movement. That is, the linear and sphincter muscles can adequately control the mouth. In addition to these two types muscle, a control for the jaw rotation was developed. Through these controls, muscles and jaw rotation, the polygon mesh can be deformed and thus produces large range labial expression. The implementation uses macros to create the animation of the mouth. These macros control duration of the expression using the influence zone of the muscle movements. These values attributed adequately to muscle control generate the phonetic animation. We developed a proper approach to measure the mouth position during the speech process. Four parameters were used to measure the mouth element position and shape: JAW, FLARE, CORNERS and EDGES (Rodman, et al., 1997). JAW is the jaw position and is measured as the distance between the two (upper and lower) teeth. FLARE is the height of the maximum vertical aperture between lips. The other two parameters characterize the horizontal movement of lips. The EDGE measures the lips joint points, where the upper and lower lips connect. CORNERS represent the horizontal aperture of the lips during speech. To implementation the system was used C++ using OpenGL, in PCs. The main objects of the face are: Face object, FaceIO object, FaceStructure object, Skin object, Expression object, ListeExpressions object and muscle hierarchy. 3 Results and Conclusion Although, we are at the initial steps in direction of a complete system, we can animate all vowel sounds and see that the presented methodology and the facial model used enable the construction of such system. Next steps in this direction will be systematized of the methodology of measurements for easy map of the other Portuguese phonetic sounds. Acknowledgment Our deepest gratitude goes to Emmanuel Tanguy and Fabio Policarpo for they help with the facial model and C++ codes of this model. Reference [1] S. Warren and A. Kaiser. Incidental language teaching. A critical review. Journal of Speech and Hearing Disorders 51 (1988), 291-299. [2] Rodman, D. McAllister, and D. Bitzer. Lip Synchronization as an Aid to the Hearing Disabled. Proceedings of the American Voice Input/Output Society 1997, 233 - 248.

Proceedings of the XV Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI’02) 1530-1834/02 $17.00 ? 2002 IEEE


赞助商链接
相关文章:
华师10春英语教育专业翻译作业及参考答案
A、He wanted to throw up the chunk within his...computer graphics and animation with educational ...you would be aware of your orientation only when...
MARS-android视频教程代码-第二季第八集
{ // TODO Auto-generated method stub System.out...(1,0.1f,1,0.1f,Animation.RELATIVE_TO_SELF,...orientation="vertical" android:layout_width="fill_...
语言学作业 第一章
system shared by all the members of a speech ...synchronic or diachronic orientation just from the ...8. A dog cannot tell people that its master ...
Steve Jobs's speech in Stanford
Steve Jobs's speech in Stanford_英语学习_外语..." and is now the most successful animation ...Your work is going to fill a large part of ...
常用单词词汇
declined to 3Danimation 三 D forgiveness dilemma ...orientation consensus mechanisms candid cement ...a huge pace, keynote speech 主题演讲 generating ...
chrome命令行参数
orientation disable-extensions disable-geolocation ...disable-speech-input disable-ssl-false-start ...animation disable-hole-punching no-sandbox disable-...
安卓4.1
system, including faster orientation changes, faster...There is now a new paging animation when swiping...to make the platform accessible to more people ...
CSS3下篇_图文
?animation (and eight ?Value “local” for the...and Blending ?New features in CSS speech ? The...text-justify ?text-orientation ?text-overflow ?...
考研英语写作常用特色词汇
orientation is maintained in public opinion 假帐 ...animation 扫黄、打非 eliminate pornography and ...off poverty and set out on a road toprosperity...
新东方写作词汇
orientation is maintained in public opinion 假帐 ...animation “扫黄” 、 “打非” eliminate ...off poverty and set out on a road toprosperity...
更多相关标签: