The SPECTRANS System Description for the WMT21 Terminology Task

no code implementations • WMT (EMNLP) 2021 • Nicolas Ballier, Dahn Cho, Bilal Faye, Zong-You Ke, Hanna Martikainen, Mojca Pecman, Guillaume Wisniewski, Jean-Baptiste Yunès, Lichao Zhu, Maria Zimina-Poirot

Experiment 2 uses OpenNMT to fine-tune the model.

Cluster-Based Normalization Layer for Neural Networks

no code implementations • 25 Mar 2024 • Bilal Faye, Hanane Azzag, Mustapha Lebbah

This paper introduces Cluster-Based Normalization (CB-Norm) in two variants - Supervised Cluster-Based Normalization (SCB-Norm) and Unsupervised Cluster-Based Normalization (UCB-Norm) - proposing a groundbreaking one-step normalization approach.

Clustering

Context-Based Multimodal Fusion

no code implementations • 7 Mar 2024 • Bilal Faye, Hanane Azzag, Mustapha Lebbah, Djamel Bouchaffra

Additionally, the network learns to differentiate embeddings of different modalities through fusion with context and aligns data distributions using a contrastive approach for self-supervised learning.

Self-Supervised Learning

Context Normalization Layer with Applications

no code implementations • 14 Mar 2023 • Bilal Faye, Mohamed-djallel Dilmi, Hanane Azzag, Mustapha Lebbah, Djamel Bouchaffra

Normalization is a pre-processing step that converts the data into a more usable representation.

Classification Image Classification