Search Results for author: Muhammad Umair Arshad

Found 6 papers, 1 papers with code

Transfer Learning based Speech Affect Recognition in Urdu

no code implementations5 Mar 2021 Sara Durrani, Muhammad Umair Arshad

Here we present a Transfer learning based Speech Affect Recognition approach in which: we pre-train a model for high resource language affect recognition task and fine tune the parameters for low resource language using Deep Residual Network.

Transfer Learning

An Attention Based Neural Network for Code Switching Detection: English & Roman Urdu

no code implementations3 Mar 2021 Aizaz Hussain, Muhammad Umair Arshad

Code-switching is a common phenomenon among people with diverse lingual background and is widely used on the internet for communication purposes.

Language Identification

Bilingual Language Modeling, A transfer learning technique for Roman Urdu

no code implementations22 Feb 2021 Usama Khalid, Mirza Omer Beg, Muhammad Umair Arshad

We train Monolingual, Multilingual, and Bilingual models of Roman Urdu - the proposed bilingual model achieves 23% accuracy compared to the 2% and 11% of the monolingual and multilingual models respectively in the Masked Language Modeling (MLM) task.

Cross-Lingual Transfer Language Modelling +2

Co-occurrences using Fasttext embeddings for word similarity tasks in Urdu

1 code implementation22 Feb 2021 Usama Khalid, Aizaz Hussain, Muhammad Umair Arshad, Waseem Shahzad, Mirza Omer Beg

In this paper, we have built a corpus for Urdu by scraping and integrating data from various sources and compiled a vocabulary for the Urdu language.

Word Embeddings Word Similarity

RUBERT: A Bilingual Roman Urdu BERT Using Cross Lingual Transfer Learning

no code implementations22 Feb 2021 Usama Khalid, Mirza Omer Beg, Muhammad Umair Arshad

It is also a well-known fact that training and maintaining monolingual models for each language is a costly and time-consuming process.

Cross-Lingual Transfer Transfer Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.