My research mainly focuses on natural language processing and code intelligence to enable computers to intelligently process, understand and generate both natural language and programming language. The long-term research goal is to develop powerful pre-trained models to support various code-related tasks, e.g. code search and code completion, to improve the productivity of the development process.