Papers

Prosody dependent speech recognition on radio news corpus of American English

International Journal
2006~2010
작성자
이진영
작성일
2006-01-01 14:00
조회
254
Authors : Ken Chen, Mark Hasegawa-johnson, Aaron Cohen, Sarah Borys, Sung-Suk Kim, Jennifer Cole, Jeung-Yoon Choi

Year : 2006

Publisher / Conference : IEEE Transactions on Audio, Speech, and Language Processing

Volume : 14, issue 1

Page : 232-245

Does prosody help word recognition? This paper proposes a novel probabilistic framework in which word and phoneme are dependent on prosody in a way that reduces word error rates (WER) relative to a prosody-independent recognizer with comparable parameter count. In the proposed prosody-dependent speech recognizer, word and phoneme models are conditioned on two important prosodic variables: the intonational phrase boundary and the pitch accent. An information-theoretic analysis is provided to show that prosody dependent acoustic and language modeling can increase the mutual information between the true word hypothesis and the acoustic observation by exciting the interaction between prosody dependent acoustic model and prosody dependent language model. Empirically, results indicate that the influence of these prosodic variables on allophonic models are mainly restricted to a small subset of distributions: the duration PDFs (modeled using an explicit duration hidden Markov model or EDHMM) and the acoustic-prosodic observation PDFs (normalized pitch frequency). Influence of prosody on cepstral features is limited to a subset of phonemes: for example, vowels may be influenced by both accent and phrase position, but phrase-initial and phrase-final consonants are independent of accent. Leveraging these results, effective prosody dependent allophonic models are built with minimal increase in parameter count. These prosody dependent speech recognizers are able to reduce word error rates by up to 11% relative to prosody independent recognizers with comparable parameter count, in experiments based on the prosodically-transcribed Boston Radio News corpus.
전체 329
39 International Conference Tacksung Choi, Young-Cheol Park, Dae Hee Youn "Efficient Out of Head Localization System for Mobile Applications" in 120th Convention of Audio Engineering Society, pp.6758, 2006
38 International Conference Kyoung Ho Bang, Young Cheol Park, Dae Hee Youn "Audio Transcoding Algorithm For Mobile Multimedia Application" in ICASSP, 2006
37 International Conference Bong-Jin Lee, Sung-Wan Yoon, Hong-Goo Kang, Dae Hee Youn "On the Use of Voting Methods for Speaker Identification Based on Various Resolution Filterbanks" in ICASSP, 2006
36 Domestic Conference 이봉진, 김원구, 강홍구, 윤대희 "다양한 해상도의 필터뱅크를 이용한 화자 검증 시스템과 스코어 조합 방법" in The fourth BERC Biometrics Workshop, 2006
35 Domestic Journal 이재성,박영철,윤대희 "프로세서 구조에 따른 DCT 알고리즘의 구현 성능 비교" in 한국통신학회논문지, vol.31, No.6C, pp.637-644, 2006
34 International Journal Ken Chen, Mark Hasegawa-johnson, Aaron Cohen, Sarah Borys, Sung-Suk Kim, Jennifer Cole, Jeung-Yoon Choi "Prosody dependent speech recognition on radio news corpus of American English" in IEEE Transactions on Audio, Speech, and Language Processing, vol.14, issue 1, pp.232-245, 2006
33 Domestic Journal 한철희, 강홍구, 황영수, 윤대희 "상대전달함수의 역필터링을 이용한 자동차 환경에서의 마이크로폰 어레이 빔형성 기법" in 한국음향학회지, vol.25, 제 1호, pp.30-35, 2006
32 Domestic Conference 송명석, 이창헌, 강홍구 "음성 인식기를 위한 음질 향상 시스템 분석" in 2005년 음향학회학술대회, 2005
31 Domestic Conference 이민기, 김경태, 강홍구, 윤대희 "패킷 손실 가중치 모델을 기반으로 한 G.729 음성 부호화기의 비침임적(Non-Intrusive) 음질평가 방법" in 한국통신학회 2005년도 추계종합학술발표회, 논문 초록집, vol.32, 2005
30 Domestic Conference 허유미, 박영철, 윤대희 "머리전달함수의 고주파 대역에서의 개인적인 스펙트럼 특징이 externalization 성능에 미치는 영향에 대한 연구" in 한국통신학회 2005년도 추계종합학술발표회, 논문 초록집, vol.32, 2005