Search Results for author:
Found 12 papers, 8 papers with code
Towards Decoding Brain Activity During Passive Listening of Speech
The aim of the study is to investigate the complex mechanisms of speech perception and ultimately decode the electrical changes in the brain accruing while listening to speech.
Adaptation of Tacotron2-based Text-To-Speech for Articulatory-to-Acoustic Mapping using Ultrasound Tongue Imaging
In this paper, we experimented with transfer learning and adaptation of a Tacotron2 text-to-speech model to improve the final synthesis quality of ultrasound-based articulatory-to-acoustic mapping with a limited database.
Extending Text-to-Speech Synthesis with Articulatory Movement Prediction using Ultrasound Tongue Imaging
In this paper, we present our first experiments in text-to-articulation prediction, using ultrasound tongue image targets.
Speech Synthesis from Text and Ultrasound Tongue Image-based Articulatory Input
Besides, we analyze the ultrasound tongue recordings of several speakers, and show that misalignments in the ultrasound transducer positioning can have a negative effect on the final synthesis performance.
Advances in Speech Vocoding for Text-to-Speech with Continuous Parameters
Vocoders received renewed attention as main components in statistical parametric text-to-speech (TTS) synthesis and speech transformation systems.
Continuous Wavelet Vocoder-based Decomposition of Parametric Speech Waveform Synthesis
To date, various speech technology systems have adopted the vocoder approach, a method for synthesizing speech waveform that shows a major role in the performance of statistical parametric speech synthesis.
Towards a practical lip-to-speech conversion system using deep neural networks and mobile application frontend
Articulatory-to-acoustic (forward) mapping is a technique to predict speech using various articulatory acquisition techniques as input (e. g. ultrasound tongue imaging, MRI, lip video).
Quantification of Transducer Misalignment in Ultrasound Tongue Imaging
Ultrasound is an affordable and non-invasive imaging modality with relatively high temporal and spatial resolution to study the dynamic behavior of tongue during speech production.
Audio and Speech Processing Sound
Ultrasound-based Articulatory-to-Acoustic Mapping with WaveGlow Speech Synthesis
The training target is the 80-dimensional mel-spectrogram, which results in a finer detailed spectral representation than the previously used 25-dimensional Mel-Generalized Cepstrum.
Audio and Speech Processing Sound
Speaker dependent acoustic-to-articulatory inversion using real-time MRI of the vocal tract
Acoustic-to-articulatory inversion (AAI) methods estimate articulatory movements from the acoustic speech signal, which can be useful in several tasks such as speech recognition, synthesis, talking heads and language tutoring.
Audio and Speech Processing Sound
Speaker dependent articulatory-to-acoustic mapping using real-time MRI of the vocal tract
Articulatory-to-acoustic (forward) mapping is a technique to predict speech using various articulatory acquisition techniques (e. g. ultrasound tongue imaging, lip video).
Ultrasound-based Silent Speech Interface Built on a Continuous Vocoder
Recently it was shown that within the Silent Speech Interface (SSI) field, the prediction of F0 is possible from Ultrasound Tongue Images (UTI) as the articulatory input, using Deep Neural Networks for articulatory-to-acoustic mapping.
Sound Audio and Speech Processing
