Papers

MF-PAM: Accurate Pitch Estimation through Periodicity Analysis and Multi-level Feature Fusion

International Conference
2021~
작성자
dsp
작성일
2023-08-11 11:15
조회
7270
Authors : Woo-Jin Chung, Doyeon Kim, Soo-Whan Chung, Hong-Goo Kang

Year : 2023

Publisher / Conference : INTERSPEECH

Research area : Speech Signal Processing, Etc

Related project : 다양한 환경에 따른 왜곡 음성 신호 전처리 및 복원 알고리즘 개발

Presentation : Oral

We introduce Multi-level feature Fusion-based Periodicity Analysis Model (MF-PAM), a novel deep learning-based pitch estimation model that accurately estimates pitch trajectory in noisy and reverberant acoustic environments. Our model leverages the periodic characteristics of audio signals and involves two key steps: extracting pitch periodicity using periodic non-periodic convolution (PNP-Conv) blocks and estimating pitch by aggregating multi-level features using a modified bidirectional feature pyramid network (BiFPN). We evaluate our model on speech and music datasets and achieve superior pitch estimation performance compared to state-of-the-art baselines while using fewer model parameters. Our model achieves 99.20% accuracy in the pitch estimation on a clean musical dataset. Overall, our proposed model provides a promising solution for accurate pitch estimation in challenging acoustic environments and has potential applications in audio signal processing.
전체 387
387 International Journal Jihyun Kim, Doyeon Kim, Hong-Goo Kang "Speaker-Discriminative Attractors for Robust Continuous Speech Separation" in TASLP, vol.34, pp.3916-3929, 2026
386 Domestic Conference 김효민, 이지현, 장인선, 강홍구 "사후 의미 증류를 이용한 유한 스칼라 양자화 기반 이단계 음성 토크나이저" in 한국방송·미디어공학회 2026년 하계학술대회, 2026
385 Domestic Conference 신재훈, 장인선, 강홍구 "효율적인 신경망 기반 오디오 코덱을 위한 잔차 오토인코딩 및 연속형 오토인코더의 잠재 표현 증류" in 한국방송·미디어공학회 2026년 하계학술대회, 2026
384 International Conference Jihyun Lee, Jiahao Li, Woojin Chung, Yan Lu, Hong-Goo Kang "AudioSketch: Controllable Image-to-Audio Generation via Semantic-Temporal Energy Modulation" in EUSIPCO, 2026
383 International Conference Sangmin Lee, Woojin Chung, Woongjib Choi, Hong-Goo Kang "MoLGE: Mixture of Language Group Experts for Efficient Scaling of Massively Multilingual Speech Recognition" in Conference On Language Modeling (COLM), 2026
382 International Conference Sangmin Lee, Eekgyun Ahn, Woongjib Choi, Hong-Goo Kang "UR-BERT: Scaling Text Encoders for Massively Multilingual TTS Through Universal Romanization and Speech Token Prediction" in INTERSPEECH, 2026
381 International Conference Seyun Um, Doyeon Kim, Hong-Goo Kang "HANUI: Harnessing Distributional Discrepancies for Singing Voice Deepfake Detection" in in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2026
380 International Conference Miseul Kim, Soo jin Park, Kyungguen Byun, Hyeon-Kyeong Shin, Sunkuk Moon, Shuhua Zhang, Erik Visser "Mitigating Intra-Speaker Variability in Diarization with Style-Controllable Speech Augmentation" in in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2026
379 International Conference Woongjib Choi, Sangmin Lee, Hyungseob Lim, Hong-Goo Kang "UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matching" in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2026
378 International Journal Hyeonjin Cha, Seyun Um, Miseul Kim, Changhwan Kim, Seungshin Lee, Hong-Goo Kang "Content-Aware Style Augmentation for Zero-Shot Voice Conversion With Short Target Speech" in IEEE Signal Processing Letters, vol.33, pp.66-70, 2025