Chenrui Gao

LLM infrastructure — inference & RL post-training systems.

prof_pic.png

MSCS, UT Austin (2026–)

BSE CE, Michigan (2026)

BE ME, SJTU (2026)

I’m Chenrui, an incoming M.S. student in Computer Science at UT Austin. I did my B.S.E. in Computer Engineering at the University of Michigan as part of a dual-degree program with Shanghai Jiao Tong University.

I work on LLM training and inference systems, mostly as an upstream contributor to open-source RL post-training and serving frameworks:

  • verl-omni (committer) — RL post-training for diffusion and omni models: brought on-policy distillation to diffusion RL, from the teacher-anchored losses through multi-teacher routing, standalone teacher pools, and async teacher scheduling on the v1 trainer; also worked on rollout–training numerical consistency, profiling, and adapter correctness.
  • sglang-omni — inference performance for Qwen3-Omni: batching the multimodal prefill path and removing host syncs on the way to CUDA-graph coverage.
  • vllm-omni — parallelism and acceleration for video diffusion models: sequence, tensor, and CFG parallelism plus caching and offload for SANA-Video, regional torch.compile for MAGI-2 Preview, and attention-backend and offload bug fixes.

Before that I did robotics research at CMU’s ARCS Lab with Prof. Jiaoyang Li, where I built the SIMD-vectorized core of VAMP-MR (IROS 2026), and at UC Irvine with Prof. Sven Koenig on topological multi-agent pathfinding. Full details are on the cv page.

news

Sep 08, 2026 I became a committer of verl-omni.
Sep 07, 2026 The multi-teacher on-policy distillation line is complete in verl-omni: teacher routing and standalone pools (#427), the v1 trainer port (#493), and async teacher scheduling (#495).
Sep 05, 2026 The SANA-Video acceleration stack is merged in vllm-omni: TP + CFG parallelism (#5861), Cache-DiT + CPU offload (#5882), and sequence parallelism for linear attention (#5940).
Aug 10, 2026 On-policy distillation for diffusion RL landed in verl-omni (#300, #325), the core of roadmap RFC #293.
Jun 17, 2026 VAMP-MR, from my time at CMU’s ARCS Lab, is accepted at IROS 2026.

selected publications

  1. VAMP-MR: Vector-Accelerated Motion Planning and Execution for Multi-Robot-Arms
    Philip Huang, Chenrui Gao, and Jiaoyang Li
    In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2026