Search Results for author: Javier Antorán

Found 17 papers, 11 papers with code

A Generative Model of Symmetry Transformations

no code implementations4 Mar 2024 James Urquhart Allingham, Bruno Kacper Mlodozeniec, Shreyas Padhy, Javier Antorán, David Krueger, Richard E. Turner, Eric Nalisnick, José Miguel Hernández-Lobato

Correctly capturing the symmetry transformations of data can lead to efficient models with strong generalization capabilities, though methods incorporating symmetries often require prior knowledge.

Stochastic Gradient Descent for Gaussian Processes Done Right

1 code implementation31 Oct 2023 Jihao Andreas Lin, Shreyas Padhy, Javier Antorán, Austin Tripp, Alexander Terenin, Csaba Szepesvári, José Miguel Hernández-Lobato, David Janz

We study the use of stochastic gradient descent for solving this linear system, and show that when \emph{done right} -- by which we mean using specific insights from the optimisation and kernel communities -- stochastic gradient descent is highly effective.

Bayesian Optimisation Gaussian Processes +1

SE(3) Equivariant Augmented Coupling Flows

1 code implementation NeurIPS 2023 Laurence I. Midgley, Vincent Stimper, Javier Antorán, Emile Mathieu, Bernhard Schölkopf, José Miguel Hernández-Lobato

Coupling normalizing flows allow for fast sampling and density evaluation, making them the tool of choice for probabilistic modeling of physical systems.

Online Laplace Model Selection Revisited

no code implementations12 Jul 2023 Jihao Andreas Lin, Javier Antorán, José Miguel Hernández-Lobato

The Laplace approximation provides a closed-form model selection objective for neural networks (NN).

Model Selection

Sampling from Gaussian Process Posteriors using Stochastic Gradient Descent

1 code implementation NeurIPS 2023 Jihao Andreas Lin, Javier Antorán, Shreyas Padhy, David Janz, José Miguel Hernández-Lobato, Alexander Terenin

Gaussian processes are a powerful framework for quantifying uncertainty and for sequential decision-making but are limited by the requirement of solving linear systems.

Bayesian Optimization Decision Making +1

Image Reconstruction via Deep Image Prior Subspaces

1 code implementation20 Feb 2023 Riccardo Barbano, Javier Antorán, Johannes Leuschner, José Miguel Hernández-Lobato, Bangti Jin, Željko Kereta

Deep learning has been widely used for solving image reconstruction tasks but its deployability has been held back due to the shortage of high-quality training data.

Dimensionality Reduction Image Reconstruction +1

Sampling-based inference for large linear models, with application to linearised Laplace

1 code implementation10 Oct 2022 Javier Antorán, Shreyas Padhy, Riccardo Barbano, Eric Nalisnick, David Janz, José Miguel Hernández-Lobato

Large-scale linear models are ubiquitous throughout machine learning, with contemporary application as surrogate models for neural network uncertainty quantification; that is, the linearised Laplace method.

Bayesian Inference Uncertainty Quantification

Bayesian Experimental Design for Computed Tomography with the Linearised Deep Image Prior

1 code implementation11 Jul 2022 Riccardo Barbano, Johannes Leuschner, Javier Antorán, Bangti Jin, José Miguel Hernández-Lobato

We investigate adaptive design based on a single sparse pilot scan for generating effective scanning strategies for computed tomography reconstruction.

Experimental Design

Adapting the Linearised Laplace Model Evidence for Modern Deep Learning

no code implementations17 Jun 2022 Javier Antorán, David Janz, James Urquhart Allingham, Erik Daxberger, Riccardo Barbano, Eric Nalisnick, José Miguel Hernández-Lobato

The linearised Laplace method for estimating model uncertainty has received renewed attention in the Bayesian deep learning community.

Model Selection

Uncertainty Estimation for Computed Tomography with a Linearised Deep Image Prior

2 code implementations28 Feb 2022 Javier Antorán, Riccardo Barbano, Johannes Leuschner, José Miguel Hernández-Lobato, Bangti Jin

Existing deep-learning based tomographic image reconstruction methods do not provide accurate estimates of reconstruction uncertainty, hindering their real-world deployment.

Image Reconstruction

Bayesian Deep Learning via Subnetwork Inference

1 code implementation28 Oct 2020 Erik Daxberger, Eric Nalisnick, James Urquhart Allingham, Javier Antorán, José Miguel Hernández-Lobato

In particular, we implement subnetwork linearized Laplace as a simple, scalable Bayesian deep learning method: We first obtain a MAP estimate of all weights and then infer a full-covariance Gaussian posterior over a subnetwork using the linearized Laplace approximation.

Bayesian Inference

Depth Uncertainty in Neural Networks

1 code implementation NeurIPS 2020 Javier Antorán, James Urquhart Allingham, José Miguel Hernández-Lobato

Existing methods for estimating uncertainty in deep learning tend to require multiple forward passes, making them unsuitable for applications where computational resources are limited.

Image Classification regression

Variational Depth Search in ResNets

1 code implementation6 Feb 2020 Javier Antorán, James Urquhart Allingham, José Miguel Hernández-Lobato

One-shot neural architecture search allows joint learning of weights and network architecture, reducing computational cost.

Neural Architecture Search

Cannot find the paper you are looking for? You can Submit a new open access paper.