Search Results for author: Weilin Cong

Found 13 papers, 3 papers with code

On the Generalization Capability of Temporal Graph Learning Algorithms: Theoretical Insights and a Simpler Method

no code implementations26 Feb 2024 Weilin Cong, Jian Kang, Hanghang Tong, Mehrdad Mahdavi

Temporal Graph Learning (TGL) has become a prevalent technique across diverse real-world applications, especially in domains where data can be represented as a graph and evolves over time.

Graph Learning

Do We Really Need Complicated Model Architectures For Temporal Networks?

no code implementations22 Feb 2023 Weilin Cong, Si Zhang, Jian Kang, Baichuan Yuan, Hao Wu, Xin Zhou, Hanghang Tong, Mehrdad Mahdavi

Recurrent neural network (RNN) and self-attention mechanism (SAM) are the de facto methods to extract spatial-temporal information for temporal graph learning.

Graph Learning Link Prediction

Efficiently Forgetting What You Have Learned in Graph Representation Learning via Projection

no code implementations17 Feb 2023 Weilin Cong, Mehrdad Mahdavi

As privacy protection receives much attention, unlearning the effect of a specific node from a pre-trained graph learning model has become equally important.

Graph Learning Graph Representation Learning

Learn Locally, Correct Globally: A Distributed Algorithm for Training Graph Neural Networks

no code implementations ICLR 2022 Morteza Ramezani, Weilin Cong, Mehrdad Mahdavi, Mahmut T. Kandemir, Anand Sivasubramaniam

To solve the performance degradation, we propose to apply $\text{{Global Server Corrections}}$ on the server to refine the locally learned models.

On Provable Benefits of Depth in Training Graph Convolutional Networks

1 code implementation NeurIPS 2021 Weilin Cong, Morteza Ramezani, Mehrdad Mahdavi

Graph Convolutional Networks (GCNs) are known to suffer from performance degradation as the number of layers increases, which is usually attributed to over-smoothing.

On the Importance of Sampling in Training GCNs: Tighter Analysis and Variance Reduction

1 code implementation3 Mar 2021 Weilin Cong, Morteza Ramezani, Mehrdad Mahdavi

In this paper, we describe and analyze a general doubly variance reduction schema that can accelerate any sampling method under the memory budget.

Node Classification

On the Importance of Sampling in Training GCNs: Convergence Analysis and Variance Reduction

no code implementations1 Jan 2021 Weilin Cong, Morteza Ramezani, Mehrdad Mahdavi

In this paper, we describe and analyze a general \textbf{\textit{doubly variance reduction}} schema that can accelerate any sampling method under the memory budget.

GCN meets GPU: Decoupling “When to Sample” from “How to Sample”

no code implementations NeurIPS 2020 Morteza Ramezani, Weilin Cong, Mehrdad Mahdavi, Anand Sivasubramaniam, Mahmut Kandemir

Sampling-based methods promise scalability improvements when paired with stochastic gradient descent in training Graph Convolutional Networks (GCNs).

Minimal Variance Sampling with Provable Guarantees for Fast Training of Graph Neural Networks

no code implementations24 Jun 2020 Weilin Cong, Rana Forsati, Mahmut Kandemir, Mehrdad Mahdavi

In this paper, we theoretically analyze the variance of sampling methods and show that, due to the composite structure of empirical risk, the variance of any sampling method can be decomposed into \textit{embedding approximation variance} in the forward stage and \textit{stochastic gradient variance} in the backward stage that necessities mitigating both types of variance to obtain faster convergence rate.

Scene Graph Generation via Conditional Random Fields

no code implementations20 Nov 2018 Weilin Cong, William Wang, Wang-Chien Lee

Scene graph, a graph representation of images that captures object instances and their relationships, offers a comprehensive understanding of an image.

Graph Generation Image Retrieval +5

Improved Face Detection and Alignment using Cascade Deep Convolutional Network

no code implementations28 Jul 2017 Weilin Cong, Sanyuan Zhao, Hui Tian, Jianbing Shen

Real-world face detection and alignment demand an advanced discriminative model to address challenges by pose, lighting and expression.

Face Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.