Contrastive Learning-Based Spectral Knowledge Distillation for Multi-Modality and Missing Modality Scenarios in Semantic Segmentation

no code implementations • 4 Dec 2023 • Aniruddh Sikdar, Jayant Teotia, Suresh Sundaram

To address this, a novel multi-modal fusion approach called CSK-Net is proposed, which uses a contrastive learning-based spectral knowledge distillation technique along with an automatic mixed feature exchange mechanism for semantic segmentation in optical (EO) and infrared (IR) images.

Benchmarking Contrastive Learning +3