Papers

Prosody dependent speech recognition on radio news corpus of American English

International Journal
2006~2010
작성자
이진영
작성일
2006-01-01 14:00
조회
212
Authors : Ken Chen, Mark Hasegawa-johnson, Aaron Cohen, Sarah Borys, Sung-Suk Kim, Jennifer Cole, Jeung-Yoon Choi

Year : 2006

Publisher / Conference : IEEE Transactions on Audio, Speech, and Language Processing

Volume : 14, issue 1

Page : 232-245

Does prosody help word recognition? This paper proposes a novel probabilistic framework in which word and phoneme are dependent on prosody in a way that reduces word error rates (WER) relative to a prosody-independent recognizer with comparable parameter count. In the proposed prosody-dependent speech recognizer, word and phoneme models are conditioned on two important prosodic variables: the intonational phrase boundary and the pitch accent. An information-theoretic analysis is provided to show that prosody dependent acoustic and language modeling can increase the mutual information between the true word hypothesis and the acoustic observation by exciting the interaction between prosody dependent acoustic model and prosody dependent language model. Empirically, results indicate that the influence of these prosodic variables on allophonic models are mainly restricted to a small subset of distributions: the duration PDFs (modeled using an explicit duration hidden Markov model or EDHMM) and the acoustic-prosodic observation PDFs (normalized pitch frequency). Influence of prosody on cepstral features is limited to a subset of phonemes: for example, vowels may be influenced by both accent and phrase position, but phrase-initial and phrase-final consonants are independent of accent. Leveraging these results, effective prosody dependent allophonic models are built with minimal increase in parameter count. These prosody dependent speech recognizers are able to reduce word error rates by up to 11% relative to prosody independent recognizers with comparable parameter count, in experiments based on the prosodically-transcribed Boston Radio News corpus.
전체 327
10 International Journal Chang-Heon Lee, Sung-Kyo Jung, Hong-Goo Kang "Applying A Speaker-dependent Speech Compression Technique to Concatenative TTS Synthesizers" in IEEE Transactions on Audio, Speech, and Language Processing, vol.15, 2, pp.632-640, 2007
9 International Journal Seungil Kim, Chungyong Lee, Hong-Goo Kang "Optimum beamformer in correlated source environments" in Journal of Acoustical Society of America, vol.120, issue 6, 2006
8 International Journal Kyoung Ho Bang, Young-Cheol Park, Jeongil Seo "Audio Transcoding for Audio Streams from a T-DTV Broadcasting Station to a T-DMB Receiver" in ETRI Journal, vol.28, issue5, pp.664-667, 2006
7 International Journal Ken Chen, Mark Hasegawa-johnson, Aaron Cohen, Sarah Borys, Sung-Suk Kim, Jennifer Cole, Jeung-Yoon Choi "Prosody dependent speech recognition on radio news corpus of American English" in IEEE Transactions on Audio, Speech, and Language Processing, vol.14, issue 1, pp.232-245, 2006
6 International Journal Jeung-Yoon Choi, Mark Hasegawa-Johnson, Jennifer Cole "Finding intonational boundaries using acoustic cues related to the voice source" in The Journal of the Acoustical Society of America, vol.118, issue 4, 2005
5 International Journal Mark Hasegawa-Johnson, Ken Chen, Jennifer Cole, Sarah Borys, Sung-Suk Kim, Aaron Cohen, Tong Zhang, Jeung-Yoon Choi, Heejin Kim, Taejin Yoon, Sandra Chavarria "Simultaneous recognition of words and prosody in the Boston University Radio Speech Corpus" in Speech Communication, vol.46, issue 3-4, pp.418-439, 2005
4 International Journal Thomas Eriksson, Samuel Kim, Hong-Goo Kang, Chungyong Lee "An information-theoretic perspective on feature selection in speaker recognition" in IEEE Signal Processing Letter, vol.12, issue 7, pp.500 - 503, 2005
3 International Journal Yang-Won Jung, Hong-Goo Kang, Chungyong Lee, Dae Hee Youn, Changkyu Choi, Jaywoo Kim "Adaptive Microphone Array System with Two-Stage Adaptation Mode Controller" in IEICE TRANSACTIONS on Fundamentals of Electronics, Communications and Computer Sciences, vol.E88-A, pp.972-977, 2005
2 International Journal Seung Kyun Ryu, Hong-Goo Kang, Sung-Kyo Jung, Dae Hee Youn "Improving the Performance of the Minimum Statistics Noise Estimator for Single Channel Speech Enhancement" in IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, vol.E88-A, pp.582-585, 2005
1 International Journal Sung-Kyo Jung, Kyung-Tae Kim, Young-Cheol Park, Hong-Goo Kang "A Fast Adaptive-codebook Search Algorithm for G.723.1 Speech Coder" in IEEE Signal Processing Letters, vol.12, issue 1, pp.75-78, 2005