Chenrui Gao
LLM infrastructure — inference & RL post-training systems.
MSCS, UT Austin (2026–)
BSE CE, Michigan (2026)
BE ME, SJTU (2026)
I’m Chenrui, an incoming M.S. student in Computer Science at UT Austin. I did my B.S.E. in Computer Engineering at the University of Michigan as part of a dual-degree program with Shanghai Jiao Tong University.
I work on LLM training and inference systems, mostly as an upstream contributor to open-source RL post-training and serving frameworks:
- verl-omni (committer) — RL post-training for diffusion and omni models: brought on-policy distillation to diffusion RL, from the teacher-anchored losses through multi-teacher routing, standalone teacher pools, and async teacher scheduling on the v1 trainer; also worked on rollout–training numerical consistency, profiling, and adapter correctness.
- sglang-omni — inference performance for Qwen3-Omni: batching the multimodal prefill path and removing host syncs on the way to CUDA-graph coverage.
- vllm-omni — parallelism and acceleration for video diffusion models: sequence, tensor, and CFG parallelism plus caching and offload for SANA-Video, regional
torch.compilefor MAGI-2 Preview, and attention-backend and offload bug fixes.
Before that I did robotics research at CMU’s ARCS Lab with Prof. Jiaoyang Li, where I built the SIMD-vectorized core of VAMP-MR (IROS 2026), and at UC Irvine with Prof. Sven Koenig on topological multi-agent pathfinding. Full details are on the cv page.
news
| Sep 08, 2026 | I became a committer of verl-omni. |
|---|---|
| Sep 07, 2026 | The multi-teacher on-policy distillation line is complete in verl-omni: teacher routing and standalone pools (#427), the v1 trainer port (#493), and async teacher scheduling (#495). |
| Sep 05, 2026 | The SANA-Video acceleration stack is merged in vllm-omni: TP + CFG parallelism (#5861), Cache-DiT + CPU offload (#5882), and sequence parallelism for linear attention (#5940). |
| Aug 10, 2026 | On-policy distillation for diffusion RL landed in verl-omni (#300, #325), the core of roadmap RFC #293. |
| Jun 17, 2026 | VAMP-MR, from my time at CMU’s ARCS Lab, is accepted at IROS 2026. |
selected publications
- VAMP-MR: Vector-Accelerated Motion Planning and Execution for Multi-Robot-ArmsIn IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2026