Search Results for author: Fagui Mao

Found 1 papers, 0 papers with code

An Adaptive Placement and Parallelism Framework for Accelerating RLHF Training

no code implementations19 Dec 2023 Youshao Xiao, Weichang Wu, Zhenglei Zhou, Fagui Mao, Shangchun Zhao, Lin Ju, Lei Liang, Xiaolu Zhang, Jun Zhou

Furthermore, our framework provides a simple user interface and allows for the agile allocation of models across devices in a fine-grained manner for various training scenarios, involving models of varying sizes and devices of different scales.

Cannot find the paper you are looking for? You can Submit a new open access paper.