Search Results for author: Zehan Zhu

Found 3 papers, 0 papers with code

PrivSGP-VR: Differentially Private Variance-Reduced Stochastic Gradient Push with Tight Utility Bounds

no code implementations4 May 2024 Zehan Zhu, Yan Huang, Xin Wang, Jinming Xu

In this paper, we propose a differentially private decentralized learning method (termed PrivSGP-VR) which employs stochastic gradient push with variance reduction and guarantees $(\epsilon, \delta)$-differential privacy (DP) for each node.

Robust Fully-Asynchronous Methods for Distributed Training over General Architecture

no code implementations21 Jul 2023 Zehan Zhu, Ye Tian, Yan Huang, Jinming Xu, Shibo He

Perfect synchronization in distributed machine learning problems is inefficient and even impossible due to the existence of latency, package losses and stragglers.

Tackling Data Heterogeneity: A New Unified Framework for Decentralized SGD with Sample-induced Topology

no code implementations8 Jul 2022 Yan Huang, Ying Sun, Zehan Zhu, Changzhi Yan, Jinming Xu

We develop a general framework unifying several gradient-based stochastic optimization methods for empirical risk minimization problems both in centralized and distributed scenarios.

Stochastic Optimization

Cannot find the paper you are looking for? You can Submit a new open access paper.