Search Results for author: Bobak T. Kiani

Found 8 papers, 3 papers with code

On the hardness of learning under symmetries

no code implementations3 Jan 2024 Bobak T. Kiani, Thien Le, Hannah Lawrence, Stefanie Jegelka, Melanie Weber

We study the problem of learning equivariant neural networks via gradient descent.

Inductive Bias

Self-Supervised Learning with Lie Symmetries for Partial Differential Equations

1 code implementation NeurIPS 2023 Grégoire Mialon, Quentin Garrido, Hannah Lawrence, Danyal Rehman, Yann Lecun, Bobak T. Kiani

Machine learning for differential equations paves the way for computationally efficient alternatives to numerical solvers, with potentially broad impacts in science and engineering.

Representation Learning Self-Supervised Learning

Equivariant Polynomials for Graph Neural Networks

no code implementations22 Feb 2023 Omri Puny, Derek Lim, Bobak T. Kiani, Haggai Maron, Yaron Lipman

This paper introduces an alternative expressive power hierarchy based on the ability of GNNs to calculate equivariant polynomials of a certain degree.

Graph Learning

The SSL Interplay: Augmentations, Inductive Bias, and Generalization

no code implementations6 Feb 2023 Vivien Cabannes, Bobak T. Kiani, Randall Balestriero, Yann Lecun, Alberto Bietti

Self-supervised learning (SSL) has emerged as a powerful framework to learn representations from raw data without supervision.

Data Augmentation Inductive Bias +1

Joint Embedding Self-Supervised Learning in the Kernel Regime

no code implementations29 Sep 2022 Bobak T. Kiani, Randall Balestriero, Yubei Chen, Seth Lloyd, Yann Lecun

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data.

Self-Supervised Learning

Implicit Bias of Linear Equivariant Networks

1 code implementation12 Oct 2021 Hannah Lawrence, Kristian Georgiev, Andrew Dienes, Bobak T. Kiani

Group equivariant convolutional neural networks (G-CNNs) are generalizations of convolutional neural networks (CNNs) which excel in a wide range of technical applications by explicitly encoding symmetries, such as rotations and permutations, in their architectures.

Binary Classification

Quantum algorithms for group convolution, cross-correlation, and equivariant transformations

no code implementations23 Sep 2021 Grecia Castelazo, Quynh T. Nguyen, Giacomo De Palma, Dirk Englund, Seth Lloyd, Bobak T. Kiani

Group convolutions and cross-correlations, which are equivariant to the actions of group elements, are commonly used in mathematics to analyze or take advantage of symmetries inherent in a given problem setting.

Adversarial Robustness Guarantees for Random Deep Neural Networks

1 code implementation13 Apr 2020 Giacomo De Palma, Bobak T. Kiani, Seth Lloyd

We explore the properties of adversarial examples for deep neural networks with random weights and biases, and prove that for any $p\ge1$, the $\ell^p$ distance of any given input from the classification boundary scales as one over the square root of the dimension of the input times the $\ell^p$ norm of the input.

Adversarial Robustness Gaussian Processes

Cannot find the paper you are looking for? You can Submit a new open access paper.