Chaoyi Xu | (Applying for 25Fall and 26Fall Ph.D.)

About Me

I am currently a research intern at PKU EPIC Lab and Galbot advised by Jaylon Wang and Prof. He Wang.

I may started from the bottom, but now I’m… well, still on my way up (slowly) ! And I really enjoy the journey on this (tough) way. I also play basketball and hit the gym a lot (but not really since becoming a research intern).

I have extensive experience collaborating with international teams, am fluent in English, and am enthusiastic about connecting with peers for academic exchange, as well as exploring new research and career opportunities. It would be my great honor to treat you to a coffee or a beer for an engaging face-to-face conversation! ☕🍻

Research Interests

I am passionate about exploring innovative technologies in robotics, artificial intelligence, and healthcare, particularly those with potential for real-world implementation and societal benefit.

Publications

QuadWBG: Generalizable Quadrupedal Whole-Body Grasping

Jilong Wang*, Javokhirbek Rajabov*, Chaoyi Xu, Yiming Zheng, He Wang

PDF Project Page
under review

IROS 2024

Open6DOR: Benchmarking Open-instruction 6-DoF Object Rearrangement and A VLM-based Approach

Yufei Ding*, Haoran Geng*, Chaoyi Xu, Xiaomeng Fang, Jiazhao Zhang, Qiyu Dai, Songlin Wei, Zhizheng Zhang, He Wang

Code Project Page
Oral Presentation at IROS 2024
Oral Presentation at CVPR 2024 @ VLADA
Spotlight Presentation at ICRA 2024 @ 3D Manipulation

ICRA 2024

GAMMA: Graspability-Aware Mobile MAnipulation Policy Learning based on Online Grasping Pose Fusion

Jiazhao Zhang*, Nandiraju Gireesh*, Jilong Wang, Xiaomeng Fang, Chaoyi Xu, Weiguang Chen, Liu Dai, He Wang

PDF Code Project Page

arXiv 2024

A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challenges

Xinrun Xu*, Yuxin Wang, Chaoyi Xu, Ziluo Ding, Jiechuan Jiang, Zhiming Ding, Börje F Karlsson

PDF Code

Projects

Simulately: Handy information and resources for physics simulators for robot learning research

Haoran Geng , Yuyang Li , Yuzhe Qin , Ran Gong , Wensi Ai , Yuanpei Chen , Puhao Li , Junfeng Ni , Zhou Xian , Songlin Wei , Yang You , Yufei Ding , Jialiang Zhang , Chaoyi Xu

Time: 2023

Overview: Simulately is a project where we gather useful information of robotics & physics simulators for cutting-edge robot learning research.

Open-source Project
Selected into CMU 16-831

Silent Speech Interface

Yemin Shi , Siwei Dong , Yu Shu , Wenhao Huang , Chaoyi Xu

Time: 2022

Overview: A facial EMG signal acquisition device designed for ALS patients to capture muscle activity during speech and an algorithm to reconstruct speech from EMG signals.

Autonomous Medicine Delivery Robot

Chaoyi Xu† , Yihang Ma , Jintao Jiang (†Team Leader)

Competition: Jiangsu Division of 2021 National College Students Electronic Design Competition of TI Cup

Award: First Prize

Overview: An autonomous robot with visual line tracking, ward number recognition, load detection, and automatic round-trip navigation for medicine delivery between hospital pharmacy and wards.

Wireless Motion Sensor Node Design

Chaoyi Xu† , Min Yang , Zhiwei Yuan (†Team Leader)

Competition: 2020 Jiangsu TI Cup College Student Electronic Design Competition

Award: First Prize

Overview: A wireless motion sensor node using the ADS1292 and LMT70 chips for real-time ECG, temperature, and motion tracking, with low-latency data transmission to mobile devices.

Experience

GALBOT
2024 - Present
Research topic: RL
Advised by: Jaylon Wang, He Wang

PKU
2023
Research topic: 3DV
Advised by: Jiazhao Zhang, He Wang

BAAI
Period 2
Research topic: LLM agent
Advised by: Börje F. Karlsson

BAAI
Period 1
Research topic: EMG
Advised by: Siwei Dong, Yemin Shi