My research aim to build up unified AI system capable of simultaneously processing information from multiple modalities and addressing various downstream tasks. With this goal, I have explored following topics:
mixture-of-experts: mixture-of-experts’s structure, pretraining and domain adaption.
language-based multi-modal intelligence: multi-modal learning (acoustic, vision, language and point clouds modalities, etc.), multi-modal retrieval, downstream adaption (zero-shot learning, parameter-efficient fine-tuning).
alignment & debiasing: alignment for large language models (LLMs) and diffusion models, RLAIF.