SPRING-INX: A Multilingual Indian Language Speech Corpus by SPRING Lab, IIT Madras

1 code implementation • 23 Oct 2023 • Nithya R, Malavika S, Jordan F, Arjun Gangwar, Metilda N J, S Umesh, Rithik Sarab, Akhilesh Kumar Dubey, Govind Divakaran, Samudra Vijaya K, Suryakanth V Gangashetty

India is home to a multitude of languages of which 22 languages are recognised by the Indian Constitution as official.

SALTTS: Leveraging Self-Supervised Speech Representations for improved Text-to-Speech Synthesis

no code implementations • 2 Aug 2023 • Ramanan Sivaguru, Vasista Sai Lodagala, S Umesh

In the SALTTS-parallel implementation, the representations from this second encoder are used for an auxiliary reconstruction loss with the SSL features.

Decoder Self-Supervised Learning +2

Technology Pipeline for Large Scale Cross-Lingual Dubbing of Lecture Videos into Multiple Indian Languages

no code implementations • 1 Nov 2022 • Anusha Prakash, Arun Kumar, Ashish Seth, Bhagyashree Mukherjee, Ishika Gupta, Jom Kuriakose, Jordan Fernandes, K V Vikram, Mano Ranjith Kumar M, Metilda Sagaya Mary, Mohammad Wajahat, Mohana N, Mudit Batra, Navina K, Nihal John George, Nithya Ravi, Pruthwik Mishra, Sudhanshu Srivastava, Vasista Sai Lodagala, Vandan Mujadia, Kada Sai Venkata Vineeth, Vrunda Sukhadia, Dipti Sharma, Hema Murthy, Pushpak Bhattacharya, S Umesh, Rajeev Sangal

Cross-lingual dubbing of lecture videos requires the transcription of the original audio, correction and removal of disfluencies, domain term discovery, text-to-text translation into the target language, chunking of text using target language rhythm, text-to-speech synthesis followed by isochronous lipsyncing to the original video.

Chunking Speech Synthesis +1

S-vectors and TESA: Speaker Embeddings and a Speaker Authenticator Based on Transformer Encoder

no code implementations • 11 Aug 2020 • N J Metilda Sagaya Mary, S Umesh, Sandesh V Katta

Our experiments show that the performance of s-vectors with TESA is better than s-vectors with conventional PLDA-based speaker verification.

Sentence Speaker Verification