no code implementations • 6 Dec 2023 • Yifan Yang, Peiyao Xiao, Kaiyi Ji
In this paper, we revisit the bilevel optimization problem, in which the upper-level objective function is generally nonconvex and the lower-level objective function is strongly convex.
no code implementations • NeurIPS 2023 • Yifan Yang, Peiyao Xiao, Kaiyi Ji
Federated bilevel optimization (FBO) has shown great potential recently in machine learning and edge computing due to the emerging nested optimization structure in meta-learning, fine-tuning, hyperparameter tuning, etc.
1 code implementation • NeurIPS 2023 • Peiyao Xiao, Hao Ban, Kaiyi Ji
In this paper, we propose a new direction-oriented multi-objective problem by regularizing the common descent direction within a neighborhood of a direction that optimizes a linear combination of objectives such as the average loss in MTL.
no code implementations • 9 Feb 2023 • Peiyao Xiao, Kaiyi Ji
Federated bilevel optimization has attracted increasing attention due to emerging machine learning and communication applications.