Search Results for author: Rongyu Lin

Found 1 papers, 1 papers with code

Multi-modal preference alignment remedies regression of visual instruction tuning on language model

1 code implementation16 Feb 2024 Shengzhi Li, Rongyu Lin, Shichao Pei

In conclusion, we propose a distillation-based multi-modal alignment model with fine-grained annotations on a small dataset that reconciles the textual and visual performance of MLLMs, restoring and boosting language capability after visual instruction tuning.

Instruction Following Language Modelling +2

Cannot find the paper you are looking for? You can Submit a new open access paper.