Papers

Prosody dependent speech recognition on radio news corpus of American English

International Journal
2006~2010
작성자
이진영
작성일
2006-01-01 14:00
조회
2326
Authors : Ken Chen, Mark Hasegawa-johnson, Aaron Cohen, Sarah Borys, Sung-Suk Kim, Jennifer Cole, Jeung-Yoon Choi

Year : 2006

Publisher / Conference : IEEE Transactions on Audio, Speech, and Language Processing

Volume : 14, issue 1

Page : 232-245

Does prosody help word recognition? This paper proposes a novel probabilistic framework in which word and phoneme are dependent on prosody in a way that reduces word error rates (WER) relative to a prosody-independent recognizer with comparable parameter count. In the proposed prosody-dependent speech recognizer, word and phoneme models are conditioned on two important prosodic variables: the intonational phrase boundary and the pitch accent. An information-theoretic analysis is provided to show that prosody dependent acoustic and language modeling can increase the mutual information between the true word hypothesis and the acoustic observation by exciting the interaction between prosody dependent acoustic model and prosody dependent language model. Empirically, results indicate that the influence of these prosodic variables on allophonic models are mainly restricted to a small subset of distributions: the duration PDFs (modeled using an explicit duration hidden Markov model or EDHMM) and the acoustic-prosodic observation PDFs (normalized pitch frequency). Influence of prosody on cepstral features is limited to a subset of phonemes: for example, vowels may be influenced by both accent and phrase position, but phrase-initial and phrase-final consonants are independent of accent. Leveraging these results, effective prosody dependent allophonic models are built with minimal increase in parameter count. These prosody dependent speech recognizers are able to reduce word error rates by up to 11% relative to prosody independent recognizers with comparable parameter count, in experiments based on the prosodically-transcribed Boston Radio News corpus.
전체 369
8 International Conference Kyoung Ho Bang, Young Cheol Park, Dae Hee Youn "A Dual Audio Transcoding Algorithm for Digital Multimedia Broadcasting Services" in 120th Convention of Audio Engineering Society, pp.6814, 2006
7 International Conference Tacksung Choi, Young-Cheol Park, Dae Hee Youn "Efficient Out of Head Localization System for Mobile Applications" in 120th Convention of Audio Engineering Society, pp.6758, 2006
6 International Conference Kyoung Ho Bang, Young Cheol Park, Dae Hee Youn "Audio Transcoding Algorithm For Mobile Multimedia Application" in ICASSP, 2006
5 International Conference Bong-Jin Lee, Sung-Wan Yoon, Hong-Goo Kang, Dae Hee Youn "On the Use of Voting Methods for Speaker Identification Based on Various Resolution Filterbanks" in ICASSP, 2006
4 Domestic Conference 이봉진, 김원구, 강홍구, 윤대희 "다양한 해상도의 필터뱅크를 이용한 화자 검증 시스템과 스코어 조합 방법" in The fourth BERC Biometrics Workshop, 2006
3 Domestic Journal 이재성,박영철,윤대희 "프로세서 구조에 따른 DCT 알고리즘의 구현 성능 비교" in 한국통신학회논문지, vol.31, No.6C, pp.637-644, 2006
2 International Journal Ken Chen, Mark Hasegawa-johnson, Aaron Cohen, Sarah Borys, Sung-Suk Kim, Jennifer Cole, Jeung-Yoon Choi "Prosody dependent speech recognition on radio news corpus of American English" in IEEE Transactions on Audio, Speech, and Language Processing, vol.14, issue 1, pp.232-245, 2006
1 Domestic Journal 한철희, 강홍구, 황영수, 윤대희 "상대전달함수의 역필터링을 이용한 자동차 환경에서의 마이크로폰 어레이 빔형성 기법" in 한국음향학회지, vol.25, 제 1호, pp.30-35, 2006