What doesn’t kill you makes you stronger.

I am Runxin Xu (许润昕), a master student at the Institute of Computational Linguistics in the School of EECS, Peking University, advised by Dr. Baobao Chang and Dr. Zhifang Sui. Prior to this, I earned my Bachelor’s degree at Shanghai Jiao Tong University advised by Dr. Xiaofeng Gao.

My research interests mainly lie in natural language processing, especially 1) document-level and few-shot information extraction, and 2) effective and efficient pre-trained language model.

I am actively seeking for engineer or researcher position (graduate in 2023). Please drop me an email (A@B,A=runxinxu,B=gmail.com) if you want to chat.

Education

Peking University, Sep. 2020 - Jun. 2023 (expected)

Master student at the School of EECS.
Advised by Dr. Baobao Chang and Dr. Zhifang Sui in Institute of Computational Linguistics.

Shanghai Jiao Tong University, Sep. 2016 - Jun. 2020

Bachelor student at the School of Cyber Science and Engineering.
Member of Advanced Network Laboratory advised by Dr. Xiaofeng Gao.

Experience

ByteDance Search, *December. 2021 – Now *

E-Commerce in Douyin Search.
Advised by Shian Chen, Zhe Chen, and Pengcheng Yang.

Alibaba Damo Academy, Mar. 2021 – December. 2021

Research Intern advised by Dr. Songfang Huang, and Fuli Luo.
Research topic: Pre-trained Language Model and Fine-tuning.

ByteDance AI Lab, Nov. 2019 – Jan. 2021

Research Intern advised by Dr. Lei Li, Dr. Mingxuan Wang, and Jun Cao.
Research topic: Information Extraction, Machine Translation.

Microsoft C+AI, July. 2019 – October. 2019

Software Design Engineer Intern advised by Rome Li, Jinbo Wang, and Yan Zhang.
Topic: develop a vscode code extension vscode-maven.

Publications and Manuscripts

^* means equal contribution.

From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression. [PDF] [code]
Runxin Xu^*, Fuli Luo^*, Chengyu Wang, Baobao Chang, Jun Huang, Songfang Huang, Fei Huang.
AAAI2022 (Oral).

S⁴-Tuning: A Simple Cross-lingual Sub-network Tuning Method.
Runxin Xu, Fuli Luo, Baobao Chang, Songfang Huang, Fei Huang.
ACL2022.

A Two-Stream AMR-enhanced Model for Document-level Event Argument Extraction. [PDF] [code]
Runxin Xu^*, Peiyi Wang^*, Tianyu Liu, Shuang Zeng, Baobao Chang, Zhifang Sui.
NAACL2022 (Oral).

An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labeling. [PDF] [code]
Peiyi Wang^*, Runxin Xu^*, Tianyu Liu, Qingyu Zhou, Yunbo Cao, Baobao Chang, Zhifang Sui.
NAACL2022 (Oral).

BERT Raises a Child: Towards Improving Generalization for Large Language Model Fine-tuning. [PDF] [code] [Report]
Runxin Xu^*, Fuli Luo^*, Zhiyuan Zhang, Chuanqi Tan, Baobao Chang, Songfang Huang, Fei Huang.
EMNLP2021 (Oral).

Behind the Scenes: An Exploration of Trigger Biases Problem in Few-Shot Event Classification. [PDF] [code]
Peiyi Wang^*, Runxin Xu^*, Tianyu Liu, Damai Dai, Baobao Chang, Zhifang Sui.
CIKM2021.

Document-level Event Extraction via Heterogeneous Graph-based Interaction Model with a Tracker. [PDF] [code] [talk]
Runxin Xu, Tianyu Liu, Lei Li, Baobao Chang.
ACL2021 (Oral).

Double Graph Based Reasoning for Document-level Relation Extraction. [PDF] [code]
Shuang Zeng^*, Runxin Xu^*, Baobao Chang, Lei Li.
EMNLP2020.

Volctrans Parallel Corpus Filtering System for WMT 2020. [PDF]
Runxin Xu, Zhuo Zhi, Jun Cao, Mingxuan Wang, Lei Li.
WMT@EMNLP2020.
(Win the first place of WMT20 Parallel Corpus Filtering tasks. Here is the result.)

Xiaomingbot: A Multilingual Robot News Reporter [PDF] [Report] [URL] [Youtube]
Runxin Xu, Jun Cao, Mingxuan Wang, Jiaze Chen, Hao Zhou, Ying Zeng, Yuping Wang, Li Chen, Xiang Yin, Xijin Zhang, Songcheng Jiang, Yuxuan Wang, Lei Li.
ACL2020, System Demonstrations.

Focus on the Target’s Vocabulary: Masked Label Smoothing for Machine Translation. [PDF] [code]
Liang Chen, Runxin Xu, Baobao Chang.
ACL2022.

Probing Structured Pruning on Multilingual Pre-trained Models: Setting, Algorithm, and Efficiency. [PDF]
Yanyang Li, Fuli Luo, Runxin Xu, Songfang Huang, Fei Huang, Liwei Wang.
ACL2022.

A Double-Graph Based Framework for Frame Semantic Parsing. [code]
Ce Zheng, Xudong Chen, Runxin Xu, Baobao Chang.
NAACL2022

ATP: AMRize Then Parse! Enhancing AMR Parsing with PseudoAMRs. [PDF] [code]
Liang Chen, Peiyi Wang, Runxin Xu, Tianyu Liu, Zhifang Sui, Baobao Chang.
NAACL2022.

ACMo: Angle-Calibrated Moment Methods for Stochastic Optimization. [PDF] [code] [URL]
Xunpeng Huang, Runxin Xu, Hao Zhou, Zhe Wang, Zhengyang Liu, Lei Li.
AAAI2021.

Making Pre-trained Language Models End-to-end Few-shot Learners with Contrastive Prompt Tuning. [PDF]
Ziyun Xu^*, Chengyu Wang^*, Minghui Qiu, Fuli Luo, Runxin Xu, Songfang Huang, Jun Huang
Preprint.

Explicit Interaction Network for Aspect Sentiment Triplet Extraction. [PDF]
Peiyi Wang^*, Lianzhe Huang^*, Tianyu Liu, Damai Dai, Runxin Xu, Houfeng Wang, Baobao Chang, Zhifang Sui.
Preprint.

Adaptive Gradient Methods Can Be Provably Faster than SGD after Finite Epochs. [PDF]
Xunpeng Huang, Hao Zhou, Runxin Xu, Zhe Wang, Lei Li.
Preprint.

Hornors & Awards

National scholarship. 2018, 2019, 2021.
Outstanding Graduates in Shanghai Jiao Tong University. 2020
A-class scholarship in Shanghai Jiao Tong University (top 1 in the major). 2018.
B-class scholarship in Shanghai Jiao Tong University. 2017, 2019.
Cyrus Tang Scholarship. 2018, 2019
Arawana scholarship. 2017.
Meritorious Winner in Interdisciplinary Contest In Modeling (top 8% of 11262 teams). 2018

Teaching Experience

Introduction to Computing (Category C), Teaching Assistant, Fall 2020

Contact Me

Email: runxinxu AT gmail DOT com
Links: GitHub