About Me
I’m currently a Ph.D. student in Computer Science advised by Prof. Jianbin Jiao, at Pattern Recognition and Intelligent System Development Laboratory, School of Emergency Management Science and Engineering, University of Chinese Academy of Sciences. My research interests include Reinforcement Learning, Multi-agent Learning, and Large Language Model (LLM) Agents. I am looking for cooperation opportunities. If you are interested with my experience or research, please feel free to contact me via Email.
Education
- 2023.9 - 2024.8 : Visiting Scholar at SpaceTimeLab, University College London, advised by Prof. Tao Cheng
- 2022.9 - Present : Ph.D. in Computer Science, School of Emergency Management Science and Engineering, University of Chinese Academy of Sciences, advised by Prof. Jianbin Jiao
- 2019.9 - 2022.6 : M.S. in Pattern Recognition and Intelligent System, Institute of Automation, Chinese Academy of Sciences, advised by Prof. Kaiqi Huang
- 2015.9 - 2019.6 : B.E. in Computer Science, University of Chinese Academy of Sciences, advised by Prof. Yidong Gu
- 2012.9 - 2015.6 : Northeast Yucai School
Experiences
- 2022.7 - Present : Research internship at Institute of Automation, Chinese Academy of Sciences
- 2019.2 - 2019.7 : Research internship at Institute of Automation, Chinese Academy of Sciences, advised by Prof. Junge Zhang and Prof. Qiyue Yin
- 2019.1 : Winter camp at Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences
- 2018.3 - 2018.7 : Research internship at Institute of Software, Chinese Academy of Sciences, advised by Prof. Wensheng Dou
- 2016.7 - 2016.9 : Research internship at Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, advised by Prof. Yidong Gu
- 2014.7 : Summer camp at University of Chinese Academy of Sciences
Publications
Conferences
- PDiT: Interleaving Perception and Decision-making Transformers for Deep Reinforcement Learning
Hangyu Mao, Rui Zhao, Ziyue Li, Zhiwei Xu, Hao Chen, Yiqun Chen, Bin Zhang, Zhen Xiao, Junge Zhang and Jiangjin Yin
AAMAS2024(Oral):the 23rd International Conference on Autonomous Agents and Multi-Agent Systems
[arXiv] [Code] [bibTeX] - Uncertainty Quantification via Spatial-Temporal Tweedie Model for Zero-inflated and Long-tail Travel Demand Prediction
Xinke Jiang, Dingyi Zhuang, Xianghui Zhang, Hao Chen, Jiayuan Luo, Xiaowei Gao
CIKM2023(Poster):the 32nd ACM International Conference on Information and Knowledge Management
[Paper] [arXiv] [Code] [Poster] [bibTeX] - Explicitly Learning Policy Under Partial Observability in Multiagent Reinforcement Learning
Chen Yang, Guangkai Yang, Hao Chen, Junge Zhang
IJCNN2023(Oral):the 2022 International Joint Conference on Neural Networks
[Paper] [Slides] [bibTeX] - Underexplored Subspace Mining for Sparse-Reward Cooperative Multi-Agent Reinforcement Learning
Yang Yu, Qiyue Yin, Junge Zhang, Hao Chen, Kaiqi Huang
IJCNN2023(Oral):the 2022 International Joint Conference on Neural Networks
[Paper] [Slides] [bibTeX] - Consensus Learning for Cooperative Multi-Agent Reinforcement Learning
Zhiwei Xu, Bin Zhang, Dapeng Li, Zeren Zhang, Guangchong Zhou, Hao Chen, Guoliang Fan
AAAI2023(Oral):the 37th AAAI Conference on Artificial Intelligence
[Paper] [arXiv] [Code] [bibTeX] - RACA: Relation-Aware Credit Assignment for Ad-Hoc Cooperation in Multi-Agent Deep Reinforcement Learning
Hao Chen, Guangkai Yang, Junge Zhang, Qiyue Yin, Kaiqi Huang
IJCNN2022(Oral):the 2022 International Joint Conference on Neural Networks
[Paper] [arXiv] [Slides] [bibTeX] - Multi-Agent Uncertainty Sharing for Cooperative Multi-Agent Reinforcement Learning
Guangkai Yang, Hao Chen, Junge Zhang, Qiyue Yin, Kaiqi Huang
IJCNN2022(Oral):the 2022 International Joint Conference on Neural Networks
[Paper] [Slides] [bibTeX] - FGA-NAS: Fast Resource-Constrained Architecture Search by Greedy-ADMM Algorithm
Yifei Chen, Junge Zhang, Qiaozhe Li, Hao Chen, Kaiqi Huang
IJCNN2022(Oral):the 2022 International Joint Conference on Neural Networks
[Paper] [Slides] [bibTeX] - Layer-Wisely Supervised Learning for One-Shot Neural Architecture Search
Yifei Chen, Zhourui Guo, Qiyue Yin, Hao Chen, Kaiqi Huang
IJCNN2022(Poster):the 2022 International Joint Conference on Neural Networks
[Paper] [bibTeX]
Journals
- Local Observation Reconstruction for Ad-Hoc Cooperation
(面向Ad-Hoc协作的局部观测重建方法)
Hao Chen, Likun Yang, Qiyue Yin, Kaiqi Huang
Journal of University of Chinese Academy of Sciences
[Paper] [bibTeX] - Uncertainty-based Credit Assignment for Cooperative Multi-Agent Reinforcement Learning
(基于不确定度的多智能体信用分配方法)
Guangkai Yang, Hao Chen, Mingyi Zhang, Qiyue Yin, Kaiqi Huang
Journal of University of Chinese Academy of Sciences
[Paper] [bibTeX]
Workshop Papers
- RACA: Relation-Aware Credit Assignment for Ad-Hoc Cooperation in Multi-Agent Deep Reinforcement Learning
Hao Chen, Guangkai Yang, Junge Zhang, Qiyue Yin, Kaiqi Huang
IJCAI2022(Workshop):the 31st International Joint Conference on Artificial Intelligence
[Paper] [arXiv] [Slides] [bibTeX]
[Workshop on Ad Hoc Teamwork]
Pre-prints
- TC-RAG:Turing-Complete RAG’s Case study on Medical LLM Systems
Xinke Jiang, Yue Fang, Rihong Qiu, Haoyu Zhang, Yongxin Xu, Hao Chen, Wentao Zhang, Ruizhe Zhang, Yuchen Fang, Xu Chu, Junfeng Zhao, Yasha Wang
[arXiv] [Code] [bibTeX] - Timeseries Suppliers Allocation Risk Optimization via Deep Black Litterman Model
Jiayuan Luo, Wentao Zhang, Yuchen Fang, Xiaowei Gao, Dingyi Zhuang, Hao Chen, Xinke Jiang
[arXiv] [Code] [bibTeX] - Transformer in Transformer as Backbone for Deep Reinforcement Learning
Hangyu Mao, Rui Zhao, Hao Chen, Jianye Hao, Yiqun Chen, Dong Li, Junge Zhang, Zhen Xiao
[arXiv] [Code] [bibTeX]
Patents
- Privacy-preserved Fully Decentralized Multi-agent Reinforcement Learning for Networked Social Systems
(多智能体通信方法、装置、存储介质和电子设备) CN: CN117579358A
Junge Zhang, Dan Qiao, Hao Chen
[Link] - Learning Stochastic Credit Assignment for Cooperative Multi-Agent Reinforcement Learning
(多智能体信用分配方法、装置、可读存储介质和智能体) CN: CN115660110B
Junge Zhang, Mingyi Zhang, Guangkai Yang, Hao Chen, Kaiqi Huang, Dandan Chen, Lu Wang
[Link] [Link] [Link] - Learning Ensemble Credit Assignment for Multi-Agent Reinforcement Learning
(基于集成学习的多智能体信用分配方法、系统、设备) CN: CN115018017A
Junge Zhang, Kaiqi Huang, Hao Chen, Guangkai Yang
[Link] [Link] [Link]
Awards & Honors
- 2024 Outstanding Merit Student of University of Chinese Academy of Sciences
(中国科学院大学三好学生标兵) - 2023 Zhu Li Yuehua Excellent Doctoral Student Award of Chinese Academy of Sciences
(中国科学院朱李月华优秀博士生奖学金) - 2023 CSC Scholarship
(国家留学基金委奖学金) - 2022, 2023, 2024 Merit Student of University of Chinese Academy of Sciences
(中国科学院大学三好学生） - 2019 - 2025 Academic Scholarship of University of Chinese Academy of Sciences
(中国科学院大学学业奖学金） - 2017 Merit Student of Chinese Academy of Sciences
(中国科学院优秀共青团员） - 2017, 2018 Merit Student of University of Chinese Academy of Sciences
(中国科学院大学优秀共青团员） - 2017 Third Prize of the National Scholarship
- 2018 Second Prize in China Undergraduate Mathematical Contest in Modeling
- 2017, 2018 Outstanding Individual of Students’ Association Union
- 2018 Third Prize of the “UCAS Cup” Innovation and Entrepreneurship Competition
- 2018 Outstanding Volunteer of IEEE UCAS Branch
- 2017 Outstanding Member of UCAS National Flag Guard
- 2017 Third Prize in the 4th Undergraduate National Flag Raiser Competition
Professional Services
Chair
- Session chair for AAG 2024
Invited Talks
- 2024.3.19 Invited talk “Spatio-Temporal Data Fusion” at Spatial-Temporal Data Analysis and Data Mining (CEGE0042), a core course for MSc Geospatial Science and MSc Spatio-temporal Analytics and Big Data Mining, led by Dr James Haworth
- 2023.9.29 Invited talk “Multi-Agent Deep Reinforcement Learning: Background and Recent Works” at SpaceTimeLab, University College London
- 2023.9.8 Invited talk “Research Experience Sharing” at School of Emergency Management Science and Engineering, University of Chinese Academy of Sciences
- 2022.8.25 Invited talk “Deep Reinforcement Learning: Background and Recent Works” at Institute of Mechanics, Chinese Academy of Sciences
- 2022.7.24 Invited talk “Relation-Aware Credit Assignment for Ad-Hoc Cooperation in Multi-Agent Deep Reinforcement Learning” at 2022 IJCAI workshop on Ad Hoc Teamwork
[Slides]
Program Committee Member
- AAMAS 2025：the 24th International Conference on Autonomous Agents and Multiagent Systems
- IJCAI 2024：the 33rd International Joint Conference on Artificial Intelligence
- IJCAI 2023：the 32nd International Joint Conference on Artificial Intelligence
- ECAI 2023：the 26th European Conference on Artificial Intelligence
- MRS 2023：the 4th International Symposium on Multi-Robot and Multi-Agent Systems
- CAC 2023: the Chinese Automation Congress
- ICML 2022: the 39th International Conference on Machine Learning
- CAC 2022: the Chinese Automation Congress
Journal Reviewer
- TNNLS: IEEE Transactions on Neural Networks and Learning Systems
- IoT: IEEE Internet of Things Journal
Other Activities
Media Coverage
- 2018 Repot by UCAS School Magazine
- 2017 Cover Person of UCAS School Magazine
- 2017 Talk on the Preparation of the College Entrance Examination
Maintained Projects
- Multi-Agent Reinforcement Learning Papers
- Multi-Agent Reinforcement Learning Papers with Code
- Multi-Agent Reinforcement Learning Resources Collection
- Adversarial Reinforcement Learning Papers
Student Activities
- 2017.9 - 2018.7 : President of the Students’ Association Union
- 2017.9 - 2018.7 : Vice President of the Student Union
- 2016.9 - 2018.7 : Vice Captain of UCAS National Flag Guard
- 2017 Book1 about student activities
- 2018 Book2 about student activities
For More Info
- Pattern Recognition and Intelligent System Development Laboratory
- Intelligence of Human-Computer Competition
- Research Group of Intelligent Gaming
- Center for Research on Intelligent System and Engineering
- Institute of Automation, Chinese Academy of Sciences
- University of Chinese Academy of Sciences
- SpaceTimeLab, University College London
Contact
- chenhao915@mails.ucas.ac.cn (Main)
- hao.chen@ucl.ac.uk (Valid from 2023.9 - 2024.8)
- chenhao2019@ia.ac.cn (Valid from 2019.9 - 2022.8)