基本信息
浏览量:43
职业迁徙
个人简介
My primary research interests lie in natural language processing and machine learning. I am excited about the generality of large language models (LLMs). In particular, I have been thinking over the following topics these days:
Adaptation of LLMs. How can we build and evaluate instruction-following models better? What perpectives do we need to consider during adaptation and their effects on the general-purpose models? What types of supervision formats could be effective and scalable?
Continual learning of LLMs. What is the boundary between pretraining and finetuning? What architectures and learning methods can enable LLMs to keep evolving after pretraining? How does models' internal knowledge interplay with new knowledge being learned?
Large-scale synthetic data. Generative models are producing data at an unprecedented speed. What are the roles of model-generated data to our model development, or even our Internet and society? How can we ensure diverse and high-quality data generation at a large scale? Can we distinguish them from human data?
Adaptation of LLMs. How can we build and evaluate instruction-following models better? What perpectives do we need to consider during adaptation and their effects on the general-purpose models? What types of supervision formats could be effective and scalable?
Continual learning of LLMs. What is the boundary between pretraining and finetuning? What architectures and learning methods can enable LLMs to keep evolving after pretraining? How does models' internal knowledge interplay with new knowledge being learned?
Large-scale synthetic data. Generative models are producing data at an unprecedented speed. What are the roles of model-generated data to our model development, or even our Internet and society? How can we ensure diverse and high-quality data generation at a large scale? Can we distinguish them from human data?
研究兴趣
论文共 35 篇作者统计合作学者相似作者
按年份排序按引用量排序主题筛选期刊级别筛选合作者筛选合作机构筛选
时间
引用量
主题
期刊级别
合作者
合作机构
CoRR (2024)
引用0浏览0EI引用
0
0
CoRR (2024)
引用0浏览0EI引用
0
0
Dirk Groeneveld,Iz Beltagy, Pete Walsh,Akshita Bhagia, Rodney Kinney,Oyvind Tafjord, Ananya Harsh Jha,Hamish Ivison,Ian Magnusson,Yizhong Wang, Shane Arora, David Atkinson,
CoRR (2024)
引用0浏览0EI引用
0
0
Kevin Xu,Yeganeh Kordi,Kate Sanders,Yizhong Wang, Adam Byerly, Jack Zhang,Benjamin Van Durme,Daniel Khashabi
arxiv(2024)
引用0浏览0引用
0
0
CoRR (2024)
引用0浏览0EI引用
0
0
加载更多
作者统计
合作学者
合作机构
D-Core
- 合作者
- 学生
- 导师
数据免责声明
页面数据均来自互联网公开来源、合作出版商和通过AI技术自动分析结果,我们不对页面数据的有效性、准确性、正确性、可靠性、完整性和及时性做出任何承诺和保证。若有疑问,可以通过电子邮件方式联系我们:report@aminer.cn