About Me

I’m currently a Ph.D. student in Computer Science advised by Prof. Jianbin Jiao, at Pattern Recognition and Intelligent System Development Laboratory, School of Emergency Management Science and Engineering, University of Chinese Academy of Sciences. I’m always open to possible cooperation or visiting opportunities. If you are interested, please contact me by email.

Education

2023.9 - Present : Visiting Scholar at SpaceTimeLab, University College London, advised by Prof. Tao Cheng
2022.9 - Present : Ph.D. in Computer Science, School of Emergency Management Science and Engineering, University of Chinese Academy of Sciences, advised by Prof. Jianbin Jiao
2019.9 - 2022.6 : M.S. in Pattern Recognition and Intelligent System, Institute of Automation, Chinese Academy of Sciences, advised by Prof. Kaiqi Huang
2015.9 - 2019.6 : B.E. in Computer Science, University of Chinese Academy of Sciences, advised by Prof. Yidong Gu
2012.9 - 2015.6 : Northeast Yucai School

Experiences

2022.7 - Present : Research internship at Institute of Automation, Chinese Academy of Sciences
2019.2 - 2019.7 : Research internship at Institute of Automation, Chinese Academy of Sciences, advised by Prof. Junge Zhang and Prof. Qiyue Yin
2019.1 : Winter camp at Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences
2018.3 - 2018.7 : Research internship at Institute of Software, Chinese Academy of Sciences, advised by Prof. Wensheng Dou
2016.7 - 2016.9 : Research internship at Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, advised by Prof. Yidong Gu
2014.7 : Summer camp at University of Chinese Academy of Sciences

Publications

Conferences

PDiT: Interleaving Perception and Decision-making Transformers for Deep Reinforcement Learning
Hangyu Mao, Rui Zhao, Ziyue Li, Zhiwei Xu, Hao Chen, Yiqun Chen, Bin Zhang, Zhen Xiao, Junge Zhang and Jiangjin Yin
AAMAS2024(Oral):the 23rd International Conference on Autonomous Agents and Multi-Agent Systems
[arXiv] [Code] [bibTeX]
Uncertainty Quantification via Spatial-Temporal Tweedie Model for Sparse and Long-tail Travel Demand Prediction
Xinke Jiang, Dingyi Zhuang, Xianghui Zhang, Hao Chen, Jiayuan Luo, Xiaowei Gao
CIKM2023(Poster):the 32nd ACM International Conference on Information and Knowledge Management
[Paper] [arXiv] [Code] [Poster] [bibTeX]
Explicitly Learning Policy Under Partial Observability in Multiagent Reinforcement Learning
Chen Yang, Guangkai Yang, Hao Chen, Junge Zhang
IJCNN2023(Oral):the 2022 International Joint Conference on Neural Networks
[Paper] [Slides] [bibTeX]
Underexplored Subspace Mining for Sparse-Reward Cooperative Multi-Agent Reinforcement Learning
Yang Yu, Qiyue Yin, Junge Zhang, Hao Chen, Kaiqi Huang
IJCNN2023(Oral):the 2022 International Joint Conference on Neural Networks
[Paper] [Slides] [bibTeX]
Consensus Learning for Cooperative Multi-Agent Reinforcement Learning
Zhiwei Xu, Bin Zhang, Dapeng Li, Zeren Zhang, Guangchong Zhou, Hao Chen, Guoliang Fan
AAAI2023(Oral):the 37th AAAI Conference on Artificial Intelligence
[Paper] [arXiv] [Code] [bibTeX]
RACA: Relation-Aware Credit Assignment for Ad-Hoc Cooperation in Multi-Agent Deep Reinforcement Learning
Hao Chen, Guangkai Yang, Junge Zhang, Qiyue Yin, Kaiqi Huang
IJCNN2022(Oral):the 2022 International Joint Conference on Neural Networks
[Paper] [arXiv] [Slides] [bibTeX]
Multi-Agent Uncertainty Sharing for Cooperative Multi-Agent Reinforcement Learning
Guangkai Yang, Hao Chen, Junge Zhang, Qiyue Yin, Kaiqi Huang
IJCNN2022(Oral):the 2022 International Joint Conference on Neural Networks
[Paper] [Slides] [bibTeX]
FGA-NAS: Fast Resource-Constrained Architecture Search by Greedy-ADMM Algorithm
Yifei Chen, Junge Zhang, Qiaozhe Li, Hao Chen, Kaiqi Huang
IJCNN2022(Oral):the 2022 International Joint Conference on Neural Networks
[Paper] [Slides] [bibTeX]
Layer-Wisely Supervised Learning for One-Shot Neural Architecture Search
Yifei Chen, Zhourui Guo, Qiyue Yin, Hao Chen, Kaiqi Huang
IJCNN2022(Poster):the 2022 International Joint Conference on Neural Networks
[Paper] [bibTeX]

Journals

Local Observation Reconstruction for Ad-Hoc Cooperation
(面向Ad-Hoc协作的局部观测重建方法)
Hao Chen, Likun Yang, Qiyue Yin, Kaiqi Huang
Journal of University of Chinese Academy of Sciences
[Paper] [bibTeX]
Uncertainty-based Credit Assignment for Cooperative Multi-Agent Reinforcement Learning
(基于不确定度的多智能体信用分配方法)
Guangkai Yang, Hao Chen, Mingyi Zhang, Qiyue Yin, Kaiqi Huang
Journal of University of Chinese Academy of Sciences
[Paper] [bibTeX]

Workshop Papers

RACA: Relation-Aware Credit Assignment for Ad-Hoc Cooperation in Multi-Agent Deep Reinforcement Learning
Hao Chen, Guangkai Yang, Junge Zhang, Qiyue Yin, Kaiqi Huang
IJCAI2022(Workshop):the 31st International Joint Conference on Artificial Intelligence
[Paper] [arXiv] [Slides] [bibTeX]
[Workshop on Ad Hoc Teamwork]

Pre-prints

Timeseries Suppliers Allocation Risk Optimization via Deep Black Litterman Model
Jiayuan Luo, Wentao Zhang, Yuchen Fang, Xiaowei Gao, Dingyi Zhuang, Hao Chen, Xinke Jiang
[arXiv] [Code] [bibTeX]
Transformer in Transformer as Backbone for Deep Reinforcement Learning
Hangyu Mao, Rui Zhao, Hao Chen, Jianye Hao, Yiqun Chen, Dong Li, Junge Zhang, Zhen Xiao
[arXiv] [Code] [bibTeX]

Patents

Learning Ensemble Credit Assignment for Multi-Agent Reinforcement Learning
(基于集成学习的多智能体信用分配方法、系统、设备) CN: CN115018017A
Junge Zhang, Kaiqi Huang, Hao Chen, Guangkai Yang
[Link] [Link] [Link]
Learning Stochastic Credit Assignment for Cooperative Multi-Agent Reinforcement Learning
(多智能体信用分配方法、装置、可读存储介质和智能体) CN: CN115660110B
Junge Zhang, Mingyi Zhang, Guangkai Yang, Hao Chen, Kaiqi Huang, Dandan Chen, Lu Wang
[Link] [Link] [Link]

Awards & Honors

2024 Outstanding Merit Student of University of Chinese Academy of Sciences
(中国科学院大学三好学生标兵)
2023 Zhu Li Yuehua Excellent Doctoral Student Award of Chinese Academy of Sciences
(中国科学院朱李月华优秀博士生奖学金)
2023 CSC Scholarship
(国家留学基金委奖学金)
2022, 2023 Merit Student of University of Chinese Academy of Sciences
(中国科学院大学三好学生）
2020 - 2025 Academic Scholarship of University of Chinese Academy of Sciences
(中国科学院大学学业奖学金）
2017 Merit Student of Chinese Academy of Sciences
(中国科学院优秀共青团员）
2017, 2018 Merit Student of University of Chinese Academy of Sciences
(中国科学院大学优秀共青团员）
2017 Third Prize of the National Scholarship
2018 Second Prize in China Undergraduate Mathematical Contest in Modeling
2017, 2018 Outstanding Individual of Students’ Association Union
2018 Third Prize of the “UCAS Cup” Innovation and Entrepreneurship Competition
2018 Outstanding Volunteer of IEEE UCAS Branch
2017 Outstanding Member of UCAS National Flag Guard
2017 Third Prize in the 4th Undergraduate National Flag Raiser Competition

Invited Talks

2024.3.19 Invited talk “Spatio-Temporal Data Fusion” at Spatial-Temporal Data Analysis and Data Mining (CEGE0042), a core course for MSc Geospatial Science and MSc Spatio-temporal Analytics and Big Data Mining, led by Dr James Haworth
2023.9.29 Invited talk “Multi-Agent Deep Reinforcement Learning: Background and Recent Works” at SpaceTimeLab, University College London
2023.9.8 Invited talk “Research Experience Sharing” at School of Emergency Management Science and Engineering, University of Chinese Academy of Sciences
2022.8.25 Invited talk “Deep Reinforcement Learning: Background and Recent Works” at Institute of Mechanics, Chinese Academy of Sciences
2022.7.24 Invited talk “Relation-Aware Credit Assignment for Ad-Hoc Cooperation in Multi-Agent Deep Reinforcement Learning” at 2022 IJCAI workshop on Ad Hoc Teamwork
[Slides]