Online Graph Dictionary Learning

12 Feb 2021  ยท  Cรฉdric Vincent-Cuaz, Titouan Vayer, Rรฉmi Flamary, Marco Corneli, Nicolas Courty ยท

Dictionary learning is a key tool for representation learning, that explains the data as linear combination of few basic elements. Yet, this analysis is not amenable in the context of graph learning, as graphs usually belong to different metric spaces. We fill this gap by proposing a new online Graph Dictionary Learning approach, which uses the Gromov Wasserstein divergence for the data fitting term. In our work, graphs are encoded through their nodes' pairwise relations and modeled as convex combination of graph atoms, i.e. dictionary elements, estimated thanks to an online stochastic algorithm, which operates on a dataset of unregistered graphs with potentially different number of nodes. Our approach naturally extends to labeled graphs, and is completed by a novel upper bound that can be used as a fast approximation of Gromov Wasserstein in the embedding space. We provide numerical evidences showing the interest of our approach for unsupervised embedding of graph datasets and for online graph subspace estimation and tracking.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Graph Classification BZR GDL-g (ADJ) Accuracy 87.81 # 1
Graph Classification COX2 GDL-g (ADJ) Accuracy(10-fold) 78.11 # 2
Graph Classification ENZYMES GDL-g (SP) Accuracy 71.47 # 4
Graph Classification IMDb-B GDL Accuracy 72.06% # 31
Rand index 51.64 # 1
Graph Classification IMDb-M GDL Accuracy 50.64% # 20
Graph Classification MUTAG GDL-g (SP) Accuracy 87.09% # 47
Graph Classification MUTAG GDL-g (ADJ) Accuracy 58.45% # 68
Graph Classification PROTEINS GDL-g (SP) Accuracy 74.86 # 62

Methods


No methods listed for this paper. Add relevant methods here