no code implementations • 11 Apr 2023 • Alexandre Heuillet, Ahmad Nasser, Hichem Arioui, Hedi Tabia
In the past few years, Differentiable Neural Architecture Search (DNAS) rapidly imposed itself as the trending approach to automate the discovery of deep neural network architectures.
1 code implementation • 31 Jan 2023 • Alexandre Heuillet, Hedi Tabia, Hichem Arioui
In this article, we present NASiam, a novel approach that uses for the first time differentiable NAS to improve the multilayer perceptron projector and predictor (encoder/predictor pair) architectures inside siamese-networks-based contrastive learning frameworks (e. g., SimCLR, SimSiam, and MoCo) while preserving the simplicity of previous baselines.
1 code implementation • 20 Aug 2021 • Alexandre Heuillet, Hedi Tabia, Hichem Arioui, Kamal Youcef-Toumi
This approach is accompanied by a novel metric that measures the distance between architectures inside our custom search space.