Papers

Phase Continuity: Learning Derivatives of Phase Spectrum for Speech Enhancement

International Conference
2021~
작성자
고우석
작성일
2022-01-25 10:16
조회
1799
Authors : Doyeon Kim, Hyewon Han, Hyeon-Kyeong Shin, Soo-Whan Chung, Hong-Goo Kang

Year : 2022

Publisher / Conference : ICASSP

Research area : Speech Signal Processing, Speech Enhancement

Related project : 음성인식 성능 향상을 위한 원단 신호 전처리 및 키워드 인식 알고리즘 개발

Presentation : Poster

In this paper, we propose an effective phase reconstruction strategy for speech enhancement in noisy and reverberant environments. In neural network-based speech enhancement systems, various forms of phase information were explicitly or implicitly included in the training loss term. However, the impact of quality improvement for enhanced speech was not significant, and there was no clear analysis on the relationship between the type of phase loss and enhanced speech quality. We propose a novel strategy using phase continuity loss, delving into the relative phase estimation. From various experiments on measuring the effectiveness of magnitude and phase related loss terms for noisy and reverberant signals, we show that the proposed phase continuity loss term plays a crucial role in speech enhancement. Based on these results, we conclude that phase continuity loss is useful for training a speech enhancement model, especially denoising task, and magnitude and phase related loss terms should be properly weighted depending on the type of signal distortion.
전체 360
137 International Conference Hyungchan Yoon, Changhwan Kim, Eunwoo Song, Hyun-Wook Yoon, Hong-Goo Kang "Pruning Self-Attention for Zero-Shot Multi-Speaker Text-to-Speech" in INTERSPEECH, 2023
136 International Conference Doyeon Kim, Soo-Whan Chung, Hyewon Han, Youna Ji, Hong-Goo Kang "HD-DEMUCS: General Speech Restoration with Heterogeneous Decoders" in INTERSPEECH, 2023
135 International Conference Zhenyu Piao, Miseul Kim, Hyungchan Yoon, Hong-Goo Kang "HappyQuokka System for ICASSP 2023 Auditory EEG Challenge" in ICASSP, 2023
134 International Conference Byeong Hyeon Kim, Hyungseob Lim, Jihyun Lee, Inseon Jang, Hong-Goo Kang "Progressive Multi-Stage Neural Audio Codec with Psychoacoustic Loss and Discriminator" in ICASSP, 2023
133 International Conference Hyungseob Lim, Jihyun Lee, Byeong Hyeon Kim, Inseon Jang, Hong-Goo Kang "End-to-End Neural Audio Coding in the MDCT Domain" in ICASSP, 2023
132 International Conference Miseul Kim, Zhenyu Piao, Jihyun Lee, Hong-Goo Kang "Style Modeling for Multi-Speaker Articulation-to-Speech" in ICASSP, 2023
131 International Conference Hyeon-Kyeong Shin, Hyewon Han, Doyeon Kim, Soo-Whan Chung, Hong-Goo Kang "Learning Audio-Text Agreement for Open-vocabulary Keyword Spotting" in INTERSPEECH (*Best Student Paper Finalist), 2022
130 International Conference Changhwan Kim, Seyun Um, Hyungchan Yoon, Hong-goo Kang "FluentTTS: Text-dependent Fine-grained Style Control for Multi-style TTS" in INTERSPEECH, 2022
129 International Conference Miseul Kim, Zhenyu Piao, Seyun Um, Ran Lee, Jaemin Joh, Seungshin Lee, Hong-Goo Kang "Light-Weight Speaker Verification with Global Context Information" in INTERSPEECH, 2022
128 International Conference Doyeon Kim, Hyewon Han, Hyeon-Kyeong Shin, Soo-Whan Chung, Hong-Goo Kang "Phase Continuity: Learning Derivatives of Phase Spectrum for Speech Enhancement" in ICASSP, 2022