Jiajun Zhang    张家俊 (In Chinese)
Ph.D.
Research Professor
Natural Language Processing Group
Institute of Automation Chinese Academy of Sciences
Email: jjzhang@nlpr.ia.ac.cn or jiajunzhangwing@gmail.com

Education:
2006.9-2011.7  Ph.D. Institute of Automation Chinese Academy of Sciences, Beijing
2002.9-2006.7  BS. College of Computer Science and Technology, Jilin University, Changchun, Jilin


Experience:
2019.11-  Research Professor. Institute of Automation Chinese Academy of Sciences, Beijing
2014.11-2019.10  Assoicate Research Professor. Institute of Automation Chinese Academy of Sciences, Beijing
2013.9-2014.9  Visiting Researcher. Microsoft Research Asia, Beijing
2011.7-2014.10  Assistant Research Professor. Institute of Automation Chinese Academy of Sciences, Beijing


Research Interests:
Natural Language Processing, Language Modeling, Multilingual multimodal Information Processing


Bio:

Research professor with the Institute of Automation Chinese Academy of Sciences, and professor of the University of the Chinese Academy of Sciences. His main research interests are natural language processing, language models and multilingual multimodal information processing. He has won the support of the National Science Fund for Excellent Young Scholars, and he is the PI of the major project "New Generation Artificial Intelligence" for technological innovation 2030. He has published over 100 CCF-A/B papers, 2 academic books. He has served as the (senior) area chair for ACL/EMNLP/COLING, SPC for AAAI and IJCAI multiple times and as an editorial board member (associate editor) for journals such as Artificial Intelligence, IEEE/ACM T-ASLP, ACM TALLIP, and Journal of Automation.

Bio (in Chinese):

张家俊,中国科学院自动化研究所研究员、博士生导师,中国科学院大学岗位教授,主要研究方向为自然语言处理、语言模型、多语言多模态信息处理,获得国家优秀青年科学基金资助,入选中国科协首届青年人才托举工程、中国科学院青年创新促进会优秀会员和北京智源青年科学家,主持科技创新2030新一代人工智能重大项目。发表CCF-A/B类论文100余篇,出版学术专著2部、译著1部,6次获得最佳/优秀论文奖,3次被评为IJCAI、ACL和NAACL的杰出SPC和审稿人。获得中国中文信息学会钱伟长中文信息处理科学技术奖一等奖、青年创新奖一等奖和2020年北京市科学技术奖一等奖等。担任中国中文信息学会理事、第五届青年工作委员会主任和机器翻译专委会副主任。担任ACL/EMNLP/COLING的(资深)领域主席,担任Artificial Intelligence、IEEE/ACM T-ASLP、ACM TALLIP和《自动化学报》等期刊的编委。


News:

2024.07, We conduct a survey on Collaborative Strategies in the Era of Large Language Models (arxiv preprint).

2024.06, We propose and build an empathetic Large Speech-Language Model named BLSP-Emo which can understand the emotion of the speaker and respond in an empathetic way (arxiv preprint). Welcome to try our (demo).



Datasets:

The datasets constructed by our lab can be found at ZNLP in github.


Recent Publications: (Full List: Google Scholar)

2024:

Xingrun Xing, Zheng Zhang, Ziyi Ni, Shitao Xiao, Yiming Ju, Siqi Fan, Yequan Wang, Jiajun Zhang, Guoqi Li. SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms. Proceedings of ICML-2024.

Chong Li, Shaonan Wang, Jiajun Zhang, Chengqing Zong. Improving In-context Learning of Multilingual Generative Language Models with Cross-lingual Alignment. Proceedings of NAACL 2024.

Yangyifan Xu, Jinliang Lu, Jiajun Zhang. Bridging the Gap between Different Vocabularies for LLM Ensemble. Proceedings of NAACL 2024.

Jinliang Lu and Jiajun Zhang. Improving Unsupervised Neural Machine Translation via Training Data Self-Correction. Proceedings of COLING 2024.

Chong Li, Wen Yang, Jiajun Zhang, Jinliang Lu, Shaonan Wang, Chengqing Zong. X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructions. Findings in Proceedings of ACL 2024.

Yizhi Li, Ge Zhang, Xingwei Qu, Jiali Li, Zhaoqun Li, Zekun Wang, Hao Li, Ruibin Yuan, Yinghao Ma, Kai Zhang, Wangchunshu Zhou, Yiming Liang, Lei Zhang, Lei Ma, Jiajun Zhang, Zuowen Li, Stephen W Huang, Chenghua Lin, Wenhu Chen, Jie Fu. CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models. Findings in Proceedings of ACL 2024.

Xingrun Xing, Li Du, Xinyuan Wang, Xianlin Zeng, Yequan Wang, Zheng Zhang, Jiajun Zhang. BiPFT: Binary Pre-trained Foundation Transformer with Low-rank Estimation of Binarization Residual Polynomials. Proceedings of AAAI 2024.

2023:

Feihu Jin, Jiajun Zhang and Chengqing Zong. Parameter-efficient tuning for large language model without calculating its gradients. Proceedings of EMNLP 2023.

Chong Li, Shaonan Wang, Yunhao Zhang, Jiajun Zhang and Chengqing Zong. Interpreting and Exploiting Functional Specialization in Multi-Head Attention under Multi-task Learning. Proceedings of EMNLP 2023.

Jinliang Lu, Yu Lu and Jiajun Zhang. Take a closer look at multilinguality! improve multilingual pre-training using monolingual corpora only. Findings in Proceedings of EMNLP 2023.

Jinliang Lu, Feihu Jin and Jiajun Zhang. Adapter Tuning With Task-Aware Attention Mechanism. Proceedings of ICASSP 2023.

Feihu Jin, Jinliang Lu and Jiajun Zhang. Unified prompt learning makes pre-trained language models better few-shot learners. Proceedings of ICASSP 2023.

Shaonan Wang, Yunhao Zhang, Weiting Shi, Guangyao Zhang, Jiajun Zhang, Nan Lin and Chengqing Zong. A large dataset of semantic ratings and its computational extension. Scientific Data.

Jinliang Lu and Jiajun Zhang. Towards Unified Multi-Domain Machine Translation With Mixture of Domain Experts. IEEE/ACM Transactions on Audio, Speech, and Language Processing.

Haitao Lin, Junnan Zhu, Lu Xiang, Feifei Zhai, Yu Zhou, Jiajun Zhang and Chengqing Zong. Topic-oriented dialogue summarization. IEEE/ACM Transactions on Audio, Speech, and Language Processing.

Feihu Jin, Jinliang Lu, Jiajun Zhang and Chengqing Zong. Instance-aware prompt learning for language understanding and generation. ACM Transactions on Asian and Low-Resource Language Information Processing.

Xin Huang, Jiajun Zhang and Chengqing Zong. Contrastive Adversarial Training for Multi-Modal Machine Translation. ACM Transactions on Asian and Low-Resource Language Information Processing.

Yang Zhao, Jiajun Zhang and Chengqing Zong. Transformer: A general framework from machine translation to others. Machine Intelligence Research.

2022:

Yu Lu and Jiajun Zhang. Norm-based Noisy Corpora Filtering and Refurbishing in Neural Machine Translation. Proceedings of EMNLP 2022.

Chen Wang, Yuchen Liu, Boxing Chen, Jiajun Zhang, Wei Luo, Zhongqiang Huang and Chengqing Zong. Discrete Cross-Modal Alignment Enables Zero-Shot Speech Translation. Proceedings of EMNLP 2022.

Shaonan Wang, Xiaohan Zhang, Jiajun Zhang and Chengqing Zong. A Synchronized Multimodal Neuroimaging Dataset for Studying Brain Language Processing. Scientific Data 2022.

Qian Wang and Jiajun Zhang. Addressing Asymmetry in Multilingual Neural Machine Translation with Fuzzy Task Clustering. Proceedings of COLING 2022.

Qian Wang, Chen Wang and Jiajun Zhang. Investigating Parameter Sharing in Multilingual Speech Translation. Proceedings of Interspeech 2022.

Qian Wang, Jiajun Zhang and Chengqing Zong. Synchronous Inference for Multilingual Neural Machine Translation. IEEE/ACM Transactions on Audio, Speech and Language Processing 2022.

Yu Lu, Jiajun Zhang, Jiali Zeng, Shuangzhi Wu and Chengqing Zong. Attention Analysis and Calibration for Transformer in Natural Language Generation. IEEE/ACM Transactions on Audio, Speech and Language Processing 2022.

Yu Lu, Jiali Zeng, Jiajun Zhang, Shuangzhi Wu, Mu Li. Learning Confidence for Transformer-based Neural Machine Translation. Proceedings of ACL 2022.

Haitao Lin, Junnan Zhu, Lu Xiang, Yu Zhou, Jiajun Zhang, Chengqing Zong. Other Roles Matter! Enhancing Role-Oriented Dialogue Summarization via Role Interactions. Proceedings of ACL 2022.

Shuxian Zou, Shaonan Wang, Jiajun Zhang, Chengqing Zong. Cross-Modal Cloze Task: A New Task to Brain-to-Word Decoding. Proceedings of ACL Findings 2022.

Qian Wang and Jiajun Zhang. Parameter Differentiation based Multilingual Neural Machine Translation. Proceedings of AAAI 2022.

Xiaohan Zhang, Shaonan Wang, Nan Lin, Jiajun Zhang and Chengqing Zong. Probing Word Syntactic Representations in the Brain by a Feature Elimination Method. Proceedings of AAAI 2022


Awards:

Best Paper Award: PACLIC-2009, NLPCC-2012, CWMT-2014, NLPCC-2017, CCMT-2019;

Qian Weichang Chinese Information Porcessing Science and Technology Award, 2014, First Prize

Outstanding Reviewer: ACL-IJCNLP-2015, NAACL-2018;

Outstanding Senior Program Committee (SPC): IJCAI-2018;

Young Elite Scientists Sponsorship Program by CAST (2015)

Youth Innovation Promotion Association Chinese Academy of Sciences (2017)

CIPS Hanvon Youngth Innovation Award, 2018;

Beijing Science and Technology Progress Award, 2020, First Prize;

NSFC Excellent Young Scientists Fund, 2021;


Research Activity :

Senior Program Committee: AAAI (2019-2022).

Senior Program Committee: IJCAI (2017-2023)

Senior Area Chair: ACL-2021, EMNLP-2022, AACL-2022.

Action Editor, ACL Rolling Review (ARR)

Area Chair: ACL-2020, ACL-2023, EMNLP-2021, EMNLP-2019, COLING-2022, COLING-2020, COLING-2018.

PC Co-Chair: CWMT-2018.

Demo Co-Chair: NLPCC 2014; Area Co-Chair: NLPCC-2020, NLPCC-2017.

Program Committee: ACL (2014, 2015, 2017, 2018, 2019), EMNLP (2015-2018), NAACL (2016-2019), COLING (2014-2018), IJCAI (2013, 2015, 2017, 2018), AAAI(2017-2019), NLPCC (2012-2017), PACLIC (2011-2017), IALP (2013-2017), CWMT (2009-2017).

Associate Editor: IEEE/ACM TASLP, ACM TALLIP.

Editorial Board: Atificial Intelligence.

Journal Reviewer: IEEE TPAMI, IEEE TC, IEEE TNNLS, IEEE TKDE.