What doesn’t kill you makes you stronger.

I am Runxin Xu (许润昕), a master student at the Institute of Computational Linguistics in the School of EECS, Peking University, advised by Dr. Baobao Chang and Dr. Zhifang Sui. Prior to this, I earned my Bachelor’s degree at Shanghai Jiao Tong University advised by Dr. Xiaofeng Gao.

My research interests mainly lie in natural language processing, especially 1) large language modeling (LLM), 2) document-level information extraction.

Education

Peking University, Sep. 2020 - Jun. 2023

Master student at the School of EECS.
Advised by Dr. Baobao Chang and Dr. Zhifang Sui in Institute of Computational Linguistics.

Shanghai Jiao Tong University, Sep. 2016 - Jun. 2020

Bachelor student at the School of Cyber Science and Engineering.
Member of Advanced Network Laboratory advised by Dr. Xiaofeng Gao.

Experience

Metabit Trading, November. 2022 – March. 2023

Topic: As a quant researcher
Advised by Bowei Ma, and An Ju.

ByteDance Search, January. 2022 – September. 2022

Topic: Search engine in Douyin Mall.
Advised by Shian Chen, Zhe Chen, and Pengcheng Yang.

Alibaba Damo Academy, Mar. 2021 – December. 2021

Research topic: Pre-trained Language Model and Fine-tuning.
Advised by Dr. Songfang Huang, and Fuli Luo.

ByteDance AI Lab, Nov. 2019 – Jan. 2021

Research topic: Information Extraction, Machine Translation.
Advised by Dr. Lei Li, Dr. Mingxuan Wang, and Jun Cao.

Microsoft C+AI, July. 2019 – October. 2019

Topic: develop a vscode code extension vscode-maven.
Advised by Rome Li, Jinbo Wang, and Yan Zhang.

Publications and Manuscripts

^* means equal contribution.

From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression. [PDF] [code]
Runxin Xu^*, Fuli Luo^*, Chengyu Wang, Baobao Chang, Jun Huang, Songfang Huang, Fei Huang.
AAAI2022 (Oral).

S⁴-Tuning: A Simple Cross-lingual Sub-network Tuning Method. [PDF]
Runxin Xu, Fuli Luo, Baobao Chang, Songfang Huang, Fei Huang.
ACL2022.

A Two-Stream AMR-enhanced Model for Document-level Event Argument Extraction. [PDF] [code]
Runxin Xu^*, Peiyi Wang^*, Tianyu Liu, Shuang Zeng, Baobao Chang, Zhifang Sui.
NAACL2022 (Oral).

An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labeling. [PDF] [code]
Peiyi Wang^*, Runxin Xu^*, Tianyu Liu, Qingyu Zhou, Yunbo Cao, Baobao Chang, Zhifang Sui.
NAACL2022 (Oral).

BERT Raises a Child: Towards Improving Generalization for Large Language Model Fine-tuning. [PDF] [code] [Report]
Runxin Xu^*, Fuli Luo^*, Zhiyuan Zhang, Chuanqi Tan, Baobao Chang, Songfang Huang, Fei Huang.
EMNLP2021 (Oral).

Behind the Scenes: An Exploration of Trigger Biases Problem in Few-Shot Event Classification. [PDF] [code]
Peiyi Wang^*, Runxin Xu^*, Tianyu Liu, Damai Dai, Baobao Chang, Zhifang Sui.
CIKM2021.

Document-level Event Extraction via Heterogeneous Graph-based Interaction Model with a Tracker. [PDF] [code] [talk]
Runxin Xu, Tianyu Liu, Lei Li, Baobao Chang.
ACL2021 (Oral).

Double Graph Based Reasoning for Document-level Relation Extraction. [PDF] [code]
Shuang Zeng^*, Runxin Xu^*, Baobao Chang, Lei Li.
EMNLP2020.

Volctrans Parallel Corpus Filtering System for WMT 2020. [PDF]
Runxin Xu, Zhuo Zhi, Jun Cao, Mingxuan Wang, Lei Li.
WMT@EMNLP2020.
(Win the first place of WMT20 Parallel Corpus Filtering tasks. Here is the result.)

Xiaomingbot: A Multilingual Robot News Reporter [PDF] [Report] [URL] [Youtube]
Runxin Xu, Jun Cao, Mingxuan Wang, Jiaze Chen, Hao Zhou, Ying Zeng, Yuping Wang, Li Chen, Xiang Yin, Xijin Zhang, Songcheng Jiang, Yuxuan Wang, Lei Li.
ACL2020, System Demonstrations.

TableIE: Capturing the Interactions among Sub-tasks in Information Extraction via Double Tables. [PDF]
jiaxing lin, Runxin Xu, Baobao Chang.
ICASSP2023.

Making Pre-trained Language Models End-to-end Few-shot Learners with Contrastive Prompt Tuning. [PDF]
Ziyun Xu^*, Chengyu Wang^*, Minghui Qiu, Fuli Luo, Runxin Xu, Songfang Huang, Jun Huang
WSDM2023.

Knowledgeable Salient Span Mask for Enhancing Language Models as Knowledge Base. [PDF]
Cunxiang Wang, Fuli Luo, Yanyang Li, Runxin Xu, Fei Huang, Yue Zhang
NLPCC2023.

Focus on the Target’s Vocabulary: Masked Label Smoothing for Machine Translation. [PDF] [code]
Liang Chen, Runxin Xu, Baobao Chang.
ACL2022.

Probing Structured Pruning on Multilingual Pre-trained Models: Setting, Algorithm, and Efficiency. [PDF]
Yanyang Li, Fuli Luo, Runxin Xu, Songfang Huang, Fei Huang, Liwei Wang.
ACL2022.

A Double-Graph Based Framework for Frame Semantic Parsing. [code]
Ce Zheng, Xudong Chen, Runxin Xu, Baobao Chang.
NAACL2022

ATP: AMRize Then Parse! Enhancing AMR Parsing with PseudoAMRs. [PDF] [code]
Liang Chen, Peiyi Wang, Runxin Xu, Tianyu Liu, Zhifang Sui, Baobao Chang.
NAACL2022.

ACMo: Angle-Calibrated Moment Methods for Stochastic Optimization. [PDF] [code] [URL]
Xunpeng Huang, Runxin Xu, Hao Zhou, Zhe Wang, Zhengyang Liu, Lei Li.
AAAI2021.

Explicit Interaction Network for Aspect Sentiment Triplet Extraction. [PDF]
Peiyi Wang^*, Lianzhe Huang^*, Tianyu Liu, Damai Dai, Runxin Xu, Houfeng Wang, Baobao Chang, Zhifang Sui.
Preprint.

Adaptive Gradient Methods Can Be Provably Faster than SGD after Finite Epochs. [PDF]
Xunpeng Huang, Hao Zhou, Runxin Xu, Zhe Wang, Lei Li.
Preprint.

Hornors & Awards

National scholarship. 2018, 2019, 2021.
华泰证券科技奖学金. 2022.
Outstanding Graduates in Shanghai Jiao Tong University. 2020
A-class scholarship in Shanghai Jiao Tong University (top 1 in the major). 2018.
B-class scholarship in Shanghai Jiao Tong University. 2017, 2019.
Cyrus Tang Scholarship (唐仲英德育奖学金). 2018, 2019
Arawana scholarship (金龙鱼奖学金). 2017.
Meritorious Winner in Interdisciplinary Contest In Modeling (top 8% of 11262 teams). 2018

Teaching Experience

Introduction to Computing (Category C), Teaching Assistant, Fall 2020

Contact Me

Email: runxinxu AT gmail DOT com
Links: GitHub