Search Results for author: Ziheng Cheng

Found 11 papers, 5 papers with code

BIRNAT: Bidirectional Recurrent Neural Networks with Adversarial Training for Video Snapshot Compressive Imaging

1 code implementation ECCV 2020 Ziheng Cheng, Ruiying Lu, Zhengjue Wang, Hao Zhang, Bo Chen, Ziyi Meng, Xin Yuan

This measurement and the modulation masks are fed into our Recurrent Neural Network (RNN) to reconstruct the desired high-speed frames.

Kernel Semi-Implicit Variational Inference

no code implementations29 May 2024 Ziheng Cheng, Longlin Yu, Tianyu Xie, Shiyue Zhang, Cheng Zhang

This way, the upper-level objective becomes the kernel Stein discrepancy (KSD), which is readily computable for stochastic gradient descent due to the hierarchical structure of semi-implicit variational distributions.

Reflected Flow Matching

no code implementations26 May 2024 Tianyu Xie, Yu Zhu, Longlin Yu, Tong Yang, Ziheng Cheng, Shiyue Zhang, Xiangyu Zhang, Cheng Zhang

We propose reflected flow matching (RFM) to train the velocity model in reflected CNFs by matching the conditional velocity fields in a simulation-free manner, similar to the vanilla FM.

The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication

no code implementations19 May 2024 Kumar Kshitij Patel, Margalit Glasgow, Ali Zindari, Lingxiao Wang, Sebastian U. Stich, Ziheng Cheng, Nirmit Joshi, Nathan Srebro

In this paper, we provide new lower bounds for local SGD under existing first-order data heterogeneity assumptions, showing that these assumptions are insufficient to prove the effectiveness of local update steps.

Distributed Optimization

SnapCap: Efficient Snapshot Compressive Video Captioning

no code implementations10 Jan 2024 JianQiao Sun, Yudi Su, Hao Zhang, Ziheng Cheng, Zequn Zeng, Zhengjue Wang, Bo Chen, Xin Yuan

To address these problems, in this paper, we propose a novel VC pipeline to generate captions directly from the compressed measurement, which can be captured by a snapshot compressive sensing camera and we dub our model SnapCap.

Compressive Sensing Video Captioning

Momentum Benefits Non-IID Federated Learning Simply and Provably

no code implementations28 Jun 2023 Ziheng Cheng, Xinmeng Huang, Pengfei Wu, Kun Yuan

When all clients participate in the training process, we demonstrate that incorporating momentum allows FedAvg to converge without relying on the assumption of bounded data heterogeneity even using a constant local learning rate.

Federated Learning

Joint Graph Learning and Model Fitting in Laplacian Regularized Stratified Models

1 code implementation4 May 2023 Ziheng Cheng, Junzi Zhang, Akshay Agrawal, Stephen Boyd

Laplacian regularized stratified models (LRSM) are models that utilize the explicit or implicit network structure of the sub-problems as defined by the categorical features called strata (e. g., age, region, time, forecast horizon, etc.

Few-Shot Learning Graph Clustering +3

Motion-aware Dynamic Graph Neural Network for Video Compressive Sensing

no code implementations1 Mar 2022 Ruiying Lu, Ziheng Cheng, Bo Chen, Xin Yuan

Video snapshot compressive imaging (SCI) utilizes a 2D detector to capture sequential video frames and compresses them into a single measurement.

Compressive Sensing Video Compressive Sensing

Dual-view Snapshot Compressive Imaging via Optical Flow Aided Recurrent Neural Network

1 code implementation11 Sep 2021 Ruiying Lu, Bo Chen, Guanliang Liu, Ziheng Cheng, Mu Qiao, Xin Yuan

In this paper, we propose an optical flow-aided recurrent neural network for dual video SCI systems, which provides high-quality decoding in seconds.

Compressive Sensing Optical Flow Estimation

Memory-Efficient Network for Large-scale Video Compressive Sensing

2 code implementations CVPR 2021 Ziheng Cheng, Bo Chen, Guanliang Liu, Hao Zhang, Ruiying Lu, Zhengjue Wang, Xin Yuan

With the knowledge of masks, optimization algorithms or deep learning methods are employed to reconstruct the desired high-speed video frames from this snapshot measurement.

Compressive Sensing Demosaicking +1

MetaSCI: Scalable and Adaptive Reconstruction for Video Compressive Sensing

2 code implementations CVPR 2021 Zhengjue Wang, Hao Zhang, Ziheng Cheng, Bo Chen, Xin Yuan

To capture high-speed videos using a two-dimensional detector, video snapshot compressive imaging (SCI) is a promising system, where the video frames are coded by different masks and then compressed to a snapshot measurement.

Compressive Sensing Video Compressive Sensing

Cannot find the paper you are looking for? You can Submit a new open access paper.