Papers

Phase Continuity: Learning Derivatives of Phase Spectrum for Speech Enhancement

International Conference
2021~
작성자
고우석
작성일
2022-01-25 10:16
조회
1461
Authors : Doyeon Kim, Hyewon Han, Hyeon-Kyeong Shin, Soo-Whan Chung, Hong-Goo Kang

Year : 2022

Publisher / Conference : ICASSP

Research area : Speech Signal Processing, Speech Enhancement

Related project : 음성인식 성능 향상을 위한 원단 신호 전처리 및 키워드 인식 알고리즘 개발

Presentation : Poster

In this paper, we propose an effective phase reconstruction strategy for speech enhancement in noisy and reverberant environments. In neural network-based speech enhancement systems, various forms of phase information were explicitly or implicitly included in the training loss term. However, the impact of quality improvement for enhanced speech was not significant, and there was no clear analysis on the relationship between the type of phase loss and enhanced speech quality. We propose a novel strategy using phase continuity loss, delving into the relative phase estimation. From various experiments on measuring the effectiveness of magnitude and phase related loss terms for noisy and reverberant signals, we show that the proposed phase continuity loss term plays a crucial role in speech enhancement. Based on these results, we conclude that phase continuity loss is useful for training a speech enhancement model, especially denoising task, and magnitude and phase related loss terms should be properly weighted depending on the type of signal distortion.
전체 355
19 International Conference Hejung Yang, Hong-Goo Kang "Feature Normalization for Fine-tuning Self-Supervised Models in Speech Enhancement" in INTERSPEECH, 2023
18 International Conference Jihyun Kim, Hong-Goo Kang "Contrastive Learning based Deep Latent Masking for Music Source Seperation" in INTERSPEECH, 2023
17 International Conference Woo-Jin Chung, Doyeon Kim, Soo-Whan Chung, Hong-Goo Kang "MF-PAM: Accurate Pitch Estimation through Periodicity Analysis and Multi-level Feature Fusion" in INTERSPEECH, 2023
16 International Conference Hyungchan Yoon, Seyun Um, Changhwan Kim, Hong-Goo Kang "Adversarial Learning of Intermediate Acoustic Feature for End-to-End Lightweight Text-to-Speech" in INTERSPEECH, 2023
15 International Conference Hyungchan Yoon, Changhwan Kim, Eunwoo Song, Hyun-Wook Yoon, Hong-Goo Kang "Pruning Self-Attention for Zero-Shot Multi-Speaker Text-to-Speech" in INTERSPEECH, 2023
14 International Conference Doyeon Kim, Soo-Whan Chung, Hyewon Han, Youna Ji, Hong-Goo Kang "HD-DEMUCS: General Speech Restoration with Heterogeneous Decoders" in INTERSPEECH, 2023
13 International Conference Zhenyu Piao, Miseul Kim, Hyungchan Yoon, Hong-Goo Kang "HappyQuokka System for ICASSP 2023 Auditory EEG Challenge" in ICASSP, 2023
12 International Conference Hyeon-Kyeong Shin, Hyewon Han, Doyeon Kim, Soo-Whan Chung, Hong-Goo Kang "Learning Audio-Text Agreement for Open-vocabulary Keyword Spotting" in INTERSPEECH (*Best Student Paper Finalist), 2022
11 International Conference Doyeon Kim, Hyewon Han, Hyeon-Kyeong Shin, Soo-Whan Chung, Hong-Goo Kang "Phase Continuity: Learning Derivatives of Phase Spectrum for Speech Enhancement" in ICASSP, 2022
10 International Conference Chanwoo Lee, Hyungseob Lim, Jihyun Lee, Inseon Jang, Hong-Goo Kang "Progressive Multi-Stage Neural Audio Coding with Guided References" in ICASSP, 2022