About Me
I’m currently a Ph.D. student in Computer Science advised by Prof. Jianbin Jiao, at Pattern Recognition and Intelligent System Development Laboratory, School of Emergency Management Science and Engineering, University of Chinese Academy of Sciences. My research interests include Reinforcement Learning, Multi-agent Learning, and Large Language Model (LLM) Agents. If you are interested with my experience or research, please feel free to contact me via Email.
Research
My research asks how agents can learn and make reliable decisions when their teammates, tasks, or environments change.
| Research direction | Selected and related papers |
|---|---|
| Multi-Agent Cooperation and Generalization How can agents adapt to unfamiliar teammates and sustain coordination? | RACA · IJCNN 2022 Oral HCL · ECML PKDD 2026 Oral DLCA, PD-MARL · CIKM 2026 Related: COLA, Local Observation Reconstruction |
| Efficient and Consistent LLM Reasoning How can models combine redundant reasoning paths and keep long-horizon decisions consistent? | RAC, AdaCon · CIKM 2026 Related: TC-RAG · ACL 2025 |
| Robust Sequential Decision-Making in Financial Markets How can portfolio policies generalize when market conditions change? | DRPO · IJCAI 2026 GLOW Workshop Related: Deep Black-Litterman · AAAI 2025 Oral, supplier order allocation |
Publications
Conferences
- Dual-Level Consensus Alignment for Multi-Agent Cooperation
Hao Chen, Meiqi Wu, Yang Yu, Kaiqi Huang, Jianbin Jiao
CIKM2026 · [Paper] - Prototype-Driven Multi-Agent Reinforcement Learning for Active Voltage Control via Contrastive Latent Conditioning
Hao Chen, Meiqi Wu, Yang Yu, Kaiqi Huang, Jianbin Jiao
CIKM2026 · [Paper] - Redundancy-Aware Self-Consistency for Efficient LLM Reasoning
Hao Chen, Xinke Jiang, Kaiqi Huang, Jianbin Jiao
CIKM2026 · [Paper] - AdaCon: Learning Adaptive Trust Regions for Consistent LLM Agent Reasoning
Hao Chen, Xinke Jiang, Kaiqi Huang, Jianbin Jiao
CIKM2026 · [Paper] - Hierarchical Cognitive Learning for Cooperative Multi-agent Reinforcement Learning
Hao Chen, Meiqi Wu, Yang Yu, Kaiqi Huang, Jianbin Jiao
ECML PKDD2026 (Oral) · [Paper] - TC-RAG:Turing-Complete RAG’s Case study on Medical LLM Systems
Xinke Jiang, Yue Fang, Rihong Qiu, Haoyu Zhang, Yongxin Xu, Hao Chen, Wentao Zhang, Ruizhe Zhang, Yuchen Fang, Xu Chu, Junfeng Zhao, Yasha Wang
ACL2025 · [Paper] [arXiv] [Code] [bibTeX] - Timeseries Suppliers Allocation Risk Optimization via Deep Black Litterman Model
Xinke Jiang, Wentao Zhang, Yuchen Fang, Xiaowei Gao, Hao Chen, Haoyu Zhang, Dingyi Zhuang, Jiayuan Luo
AAAI2025 (Oral) · [Paper] [arXiv] [Code] [Slides] [Poster] [bibTeX] - PDiT: Interleaving Perception and Decision-making Transformers for Deep Reinforcement Learning
Hangyu Mao, Rui Zhao, Ziyue Li, Zhiwei Xu, Hao Chen, Yiqun Chen, Bin Zhang, Zhen Xiao, Junge Zhang and Jiangjin Yin
AAMAS2024 (Oral) · [Paper] [arXiv] [Code] [bibTeX] - Uncertainty Quantification via Spatial-Temporal Tweedie Model for Zero-inflated and Long-tail Travel Demand Prediction
Xinke Jiang, Dingyi Zhuang, Xianghui Zhang, Hao Chen, Jiayuan Luo, Xiaowei Gao
CIKM2023 (Poster) · [Paper] [arXiv] [Code] [Poster] [bibTeX] - Consensus Learning for Cooperative Multi-Agent Reinforcement Learning
Zhiwei Xu, Bin Zhang, Dapeng Li, Zeren Zhang, Guangchong Zhou, Hao Chen, Guoliang Fan
AAAI2023 (Oral) · [Paper] [arXiv] [Code] [bibTeX] - Explicitly Learning Policy Under Partial Observability in Multiagent Reinforcement Learning
Chen Yang, Guangkai Yang, Hao Chen, Junge Zhang
IJCNN2023 (Oral) · [Paper] [Slides] [bibTeX] - Underexplored Subspace Mining for Sparse-Reward Cooperative Multi-Agent Reinforcement Learning
Yang Yu, Qiyue Yin, Junge Zhang, Hao Chen, Kaiqi Huang
IJCNN2023 (Oral) · [Paper] [Slides] [bibTeX] - RACA: Relation-Aware Credit Assignment for Ad-Hoc Cooperation in Multi-Agent Deep Reinforcement Learning
Hao Chen, Guangkai Yang, Junge Zhang, Qiyue Yin, Kaiqi Huang
IJCNN2022 (Oral) · [Paper] [arXiv] [Slides] [bibTeX] - Multi-Agent Uncertainty Sharing for Cooperative Multi-Agent Reinforcement Learning
Guangkai Yang, Hao Chen, Junge Zhang, Qiyue Yin, Kaiqi Huang
IJCNN2022 (Oral) · [Paper] [Slides] [bibTeX] - FGA-NAS: Fast Resource-Constrained Architecture Search by Greedy-ADMM Algorithm
Yifei Chen, Junge Zhang, Qiaozhe Li, Hao Chen, Kaiqi Huang
IJCNN2022 (Oral) · [Paper] [Slides] [bibTeX] - Layer-Wisely Supervised Learning for One-Shot Neural Architecture Search
Yifei Chen, Zhourui Guo, Qiyue Yin, Hao Chen, Kaiqi Huang
IJCNN2022 (Poster) · [Paper] [bibTeX] - Playing GuanDan with Large Language Models based on Prompt Engineering
Tianchang Zhao, Yabin Wang, Jianbin Jiao, Hao Chen
ICAITA2025
Journals
- Multi-Channel Spatio-Temporal Data Fusion of ‘Big’ and ‘Small’ Network Data Using Transformer Networks
Tao Cheng*, Hao Chen*, Xianghui Zhang, Xiaowei Gao, Lu Yin, Jianbin Jiao
ISPRS International Journal of Geo-Information · [Paper] [Issue Cover] - Exploration via Embracing Diversity in Reinforcement Learning for Sparse-Reward Procedurally-Generated Tasks
Pei Xu, Hao Chen, Wenjie Yang, Kaiqi Huang
IEEE Transactions on Systems, Man and Cybernetics: Systems · [Paper] - Local Observation Reconstruction for Ad-Hoc Cooperation
(面向Ad-Hoc协作的局部观测重建方法)
Hao Chen, Likun Yang, Qiyue Yin, Kaiqi Huang
Journal of University of Chinese Academy of Sciences · [Paper] [bibTeX] - Uncertainty-based Credit Assignment for Cooperative Multi-Agent Reinforcement Learning
(基于不确定度的多智能体信用分配方法)
Guangkai Yang, Hao Chen, Mingyi Zhang, Qiyue Yin, Kaiqi Huang
Journal of University of Chinese Academy of Sciences · [Paper] [bibTeX]
Workshop Papers
- Distributional RL for Generalizable Portfolio Optimization
Hao Chen, Xing Chen, Jianbin Jiao
IJCAI2026 (Workshop) · [GLOW Workshop] - RACA: Relation-Aware Credit Assignment for Ad-Hoc Cooperation in Multi-Agent Deep Reinforcement Learning
Hao Chen, Guangkai Yang, Junge Zhang, Qiyue Yin, Kaiqi Huang
IJCAI2022 (Workshop) · [Paper] [arXiv] [Slides] [bibTeX] · [Workshop on Ad Hoc Teamwork]
Pre-prints
- Multi-Channel Spatio-Temporal Data Fusion of Network-Wide “Big” and “Small” Flow Data
Tao Cheng*, Hao Chen*, Xianghui Zhang, Xiaowei Gao, Lu Yin, Jianbin Jiao
[Paper(SSRN)] - Transformer in Transformer as Backbone for Deep Reinforcement Learning
Hangyu Mao, Rui Zhao, Hao Chen, Jianye Hao, Yiqun Chen, Dong Li, Junge Zhang, Zhen Xiao
[arXiv] [Code] [bibTeX]
Patents
- Privacy-preserved Fully Decentralized Multi-agent Reinforcement Learning for Networked Social Systems
(多智能体通信方法、装置、存储介质和电子设备) · CN: CN117579358A · Junge Zhang, Dan Qiao, Hao Chen - Learning Stochastic Credit Assignment for Cooperative Multi-Agent Reinforcement Learning
(多智能体信用分配方法、装置、可读存储介质和智能体) · CN: CN115660110B · Junge Zhang, Mingyi Zhang, Guangkai Yang, Hao Chen, Kaiqi Huang, Dandan Chen, Lu Wang - Learning Ensemble Credit Assignment for Multi-Agent Reinforcement Learning
(基于集成学习的多智能体信用分配方法、系统、设备) · CN: CN115018017A · Junge Zhang, Kaiqi Huang, Hao Chen, Guangkai Yang
Education
- 2023.9 - 2024.8 : Visiting Scholar at SpaceTimeLab, University College London, advised by Prof. Tao Cheng
- 2022.9 - Present : Ph.D. in Computer Science, School of Emergency Management Science and Engineering, University of Chinese Academy of Sciences, advised by Prof. Jianbin Jiao
- 2019.9 - 2022.6 : M.S. in Pattern Recognition and Intelligent System, Institute of Automation, Chinese Academy of Sciences, advised by Prof. Kaiqi Huang
- 2015.9 - 2019.6 : B.E. in Computer Science, University of Chinese Academy of Sciences, advised by Prof. Yidong Gu
- 2012.9 - 2015.6 : Northeast Yucai School
Experiences
- 2022.7 - Present : Joint PhD Training Program at Institute of Automation, Chinese Academy of Sciences
- 2019.2 - 2019.7 : Research internship at Institute of Automation, Chinese Academy of Sciences, advised by Prof. Junge Zhang and Prof. Qiyue Yin
- 2019.1 : Winter camp at Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences
- 2018.3 - 2018.7 : Research internship at Institute of Software, Chinese Academy of Sciences, advised by Prof. Wensheng Dou
- 2016.7 - 2016.9 : Research internship at Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, advised by Prof. Yidong Gu
- 2014.7 : Summer camp at University of Chinese Academy of Sciences
Awards & Honors
- 2026 Gold Tier Reviewer, IJCAI-ECAI 2026 Primary Paper Initiative (PPI)
- 2024 Outstanding Merit Student of University of Chinese Academy of Sciences (中国科学院大学三好学生标兵)
- 2023 Zhu Li Yuehua Excellent Doctoral Student Award of Chinese Academy of Sciences (中国科学院朱李月华优秀博士生奖学金)
- 2023 CSC Scholarship (国家留学基金委奖学金)
- 2022, 2023, 2024 Merit Student of University of Chinese Academy of Sciences (中国科学院大学三好学生)
- 2019 - 2025 Academic Scholarship of University of Chinese Academy of Sciences (中国科学院大学学业奖学金)
- 2017 Merit Student of Chinese Academy of Sciences (中国科学院优秀共青团员)
- 2017, 2018 Merit Student of University of Chinese Academy of Sciences (中国科学院大学优秀共青团员)
- 2017 Third Prize of the National Scholarship
- 2018 Second Prize in China Undergraduate Mathematical Contest in Modeling
- 2017, 2018 Outstanding Individual of Students’ Association Union
- 2018 Third Prize of the “UCAS Cup” Innovation and Entrepreneurship Competition
- 2018 Outstanding Volunteer of IEEE UCAS Branch
- 2017 Outstanding Member of UCAS National Flag Guard
- 2017 Third Prize in the 4th Undergraduate National Flag Raiser Competition
Professional Services
Chair
- Session chair for AAG 2024
Invited Talks
- 2024.4.16 Invited talk “Calibrating Driving Flow Data through the Integration of Big and Small Data: The Graph Transformer Network Approach” at session SpaceTimeAI for Multi-Model Data Fusion of the 2024 annual meeting of the American Association of Geographers
- 2024.3.19 Invited talk “Spatio-Temporal Data Fusion” at Spatial-Temporal Data Analysis and Data Mining (CEGE0042), a core course for MSc Geospatial Science and MSc Spatio-temporal Analytics and Big Data Mining, led by Dr James Haworth
- 2023.9.29 Invited talk “Multi-Agent Deep Reinforcement Learning: Background and Recent Works” at SpaceTimeLab, University College London
- 2023.9.8 Invited talk “Research Experience Sharing” at School of Emergency Management Science and Engineering, University of Chinese Academy of Sciences
- 2022.8.25 Invited talk “Deep Reinforcement Learning: Background and Recent Works” at Institute of Mechanics, Chinese Academy of Sciences
- 2022.7.24 Invited talk “Relation-Aware Credit Assignment for Ad-Hoc Cooperation in Multi-Agent Deep Reinforcement Learning” at 2022 IJCAI workshop on Ad Hoc Teamwork
[Slides]
Program Committee Member / Conference Reviewer
ICLR 2026 · NeurIPS 2026 · AAAI 2025, 2026, 2027 · AAMAS 2025, 2026 · IJCAI 2023, 2024, 2025 · IJCAI-ECAI 2026 · ECML-PKDD 2026 · ICASSP 2026 · ICME 2025, 2026 · IJCNN 2027 · ECAI 2023 · MRS 2023 · ICML 2022 · CAC 2022, 2023 · DAI 2025, 2026
Journal Reviewer
TNNLS · ToG · IoT · TAGI · IS · CAAI TIT 2026 · TSMC: Systems
Other Activities
- 2024.10 - Present : AI Existential Safety researcher in Future of Life Institute
- 2022.7 The IEEE CIS Student and Early Career mentoring program
Media Coverage
- 2018 Repot by UCAS School Magazine
- 2017 Cover Person of UCAS School Magazine
- 2017 Talk on the Preparation of the College Entrance Examination
Maintained Projects
- Multi-Agent Reinforcement Learning Papers
- Multi-Agent Reinforcement Learning Papers with Code
- Multi-Agent Reinforcement Learning Resources Collection
- Adversarial Reinforcement Learning Papers
Student Activities
- 2017.9 - 2018.7 : President of the Students’ Association Union
- 2017.9 - 2018.7 : Vice President of the Student Union
- 2016.9 - 2018.7 : Vice Captain of UCAS National Flag Guard
- 2017 Book1 about student activities
- 2018 Book2 about student activities
