Search Results for author:
Found 3 papers, 1 papers with code
EnCLAP: Combining Neural Audio Codec and Audio-Text Joint Embedding for Automated Audio Captioning
We also introduce a new training objective called masked codec modeling that improves acoustic awareness of the pretrained language model.
Ranked #1 on
Audio captioning
on AudioCaps
SANE-TTS: Stable And Natural End-to-End Multilingual Text-to-Speech
By the difficulty of obtaining multilingual corpus for given speaker, training multilingual TTS model with monolingual corpora is unavoidable.
Talking Face Generation with Multilingual TTS
In this work, we propose a joint system combining a talking face generation system with a text-to-speech system that can generate multilingual talking face videos from only the text input.
