Search Results for author: Matthieu Boussard

Found 4 papers, 1 papers with code

The Impact of LoRA on the Emergence of Clusters in Transformers

1 code implementation23 Feb 2024 Hugo Koubbi, Matthieu Boussard, Louis Hernandez

In this paper, we employ the mathematical framework on Transformers developed by \citet{sander2022sinkformers, geshkovski2023emergence, geshkovski2023mathematical} to explore how variations in attention parameters and initial token values impact the structural dynamics of token clusters.

Rényi Pufferfish Privacy: General Additive Noise Mechanisms and Privacy Amplification by Iteration

no code implementations21 Dec 2023 Clément Pierquin, Aurélien Bellet, Marc Tommasi, Matthieu Boussard

Pufferfish privacy is a flexible generalization of differential privacy that allows to model arbitrary secrets and adversary's prior knowledge about the data.

Information gain ratio correction: Improving prediction with more balanced decision tree splits

no code implementations25 Jan 2018 Antonin Leroux, Matthieu Boussard, Remi Dès

Decision trees algorithms use a gain function to select the best split during the tree's induction.

Cannot find the paper you are looking for? You can Submit a new open access paper.