Hanyu Wang 王涵玉

Research Scientist at Luma AI

Multimodal AI · Embodied AI · Generative Models · Recursive Self-Improvement

About

I am a Research Scientist at Luma AI, where I work on multimodal and embodied AI. I am a founding researcher on Project Opal, Luma's open physical AI initiative, and a core contributor to Uni, Luma's unified multimodal reasoning and generation model. I received my Ph.D. in Computer Science from the University of Maryland, College Park, advised by Prof. Abhinav Shrivastava, in 2025.

My research focuses on model training and data curation for multimodal and embodied AI, visual generation and video representation learning, and recursive self-improvement for embodied agents. Most recently, I led the real-robot work for SEAR, including harness design and experiments.

Selected Work

SEAR: Self-Evolving Agentic Robotics
Xinyi Wang*,†, Bangzheng Li*,†, Hanyu Wang‡, Lin Zhang, Andrea Yaoyun Cui, Zhenggang Tang, Shyamal Buch§, Dejia Xu†,§
* Co-first authors · † Project leads · ‡ Real robot lead · § Co-last authors
2026 · Paper and code coming soon

A benchmark and framework for studying how LLM agents improve robot policies through execution feedback and carry skills and lessons across tasks, under controlled time budgets. I led the real-robot work for SEAR, including harness design and experiments.

Luma Uni-1 unified multimodal reasoning and image generation
Uni-1: Luma's Unified Multimodal Reasoning and Generation Model
Luma AI · core contributor to the Uni-1.x series
2026

Uni-1 is a multimodal reasoning model that understands intention, responds to direction, and generates pixels.

NeRV-Diffusion video synthesis through implicit neural representation weights
NeRV-Diffusion: Diffuse Implicit Neural Representations for Video Synthesis
Yixuan Ren, Hanyu Wang, Hao Chen, Bo He, Abhinav Shrivastava
ICLR 2026

Synthesizes videos by diffusing implicit neural representation weights, then decoding frames from their indices.

Bridge architecture for autoregressive visual understanding and image generation
Growing Visual Generative Capacity for Pre-Trained MLLMs
Hanyu Wang*, Jiaming Han*, Ziyan Yang, Qi Zhao, Shanchuan Lin, Xiangyu Yue, Abhinav Shrivastava, Zhenheng Yang, Hao Chen
ICLRW 2026

Adds image generation to pre-trained multimodal understanding models with a Mixture-of-Transformers architecture and semantic-to-pixel visual tokens.

Text-aligned representations for unified visual understanding and generation
Vision as a Dialect: Unifying Visual Understanding & Generation via Text-Aligned Representations
Jiaming Han, Hao Chen, Yang Zhao, Hanyu Wang, Qi Zhao, Ziyan Yang, Hao He, Xiangyu Yue, Lu Jiang
NeurIPS 2025
LARP video tokenization with a learned autoregressive generative prior
LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior
Hanyu Wang, Saksham Suri, Yixuan Ren, Hao Chen, Abhinav Shrivastava
ICLR 2025 Oral

Learns holistic video tokens with an autoregressive prior to align tokenization with downstream autoregressive video generation.

Policy-gradient posterior sampling for noisy inverse problems
Solving General Noisy Inverse Problem via Posterior Sampling: A Policy Gradient Viewpoint
Haoyue Tang, Tian Xie, Aosong Feng, Hanyu Wang, Chenyang Zhang, Yang Bai
AISTATS 2024
Multimodality-guided image style transfer examples
Multimodality-guided Image Style Transfer using Cross-modal GAN Inversion
Hanyu Wang, Pengxiang Wu, Kevin Dela Rosa, Chen Wang, Abhinav Shrivastava
WACV 2024
Chop and Learn object-state recognition and generation examples
Chop & Learn: Recognizing and Generating Object-State Compositions
Nirat Saini*, Hanyu Wang*, Archana Swaminathan, Vinoj Jayasundara, Bo He, Kamal Gupta, Abhinav Shrivastava
ICCV 2023
D-NeRV neural representations for diverse videos
Towards Scalable Neural Representation for Diverse Videos
Bo He, Xitong Yang, Hanyu Wang, Zuxuan Wu, Hao Chen, Shuaiyi Huang, Yixuan Ren, Ser-Nam Lim, Abhinav Shrivastava
CVPR 2023
NIRVANA adaptive neural representations for videos
NIRVANA: Neural Implicit Representations of Videos with Adaptive Networks
Shishira R Maiya*, Sharath Girish*, Max Ehrlich, Hanyu Wang, Kwot Sin Lee, Patrick Poirson, Pengxiang Wu, Chen Wang, Abhinav Shrivastava
CVPR 2023
Neural space-filling curves for ordering image pixels
Neural Space-filling Curves
Hanyu Wang, Kamal Gupta, Larry Davis, Abhinav Shrivastava
ECCV 2022
NeRV architecture for representing videos as neural networks
NeRV: Neural Representations for Videos
Hao Chen, Bo He, Hanyu Wang, Yixuan Ren, Ser-Nam Lim, Abhinav Shrivastava
NeurIPS 2021
Learned local shape descriptors for non-rigid dense correspondence
Learning local shape descriptors for computing non-rigid dense correspondence
Jianwei Guo, Hanyu Wang, Zhanglin Cheng, Xiaopeng Zhang, Dong-Ming Yan
Computational Visual Media, 2020
3D keypoint descriptors for non-rigid shape matching
Learning 3D keypoint descriptors for non-rigid shape matching
Hanyu Wang*, Jianwei Guo*, Dong-Ming Yan, Weize Quan, Xiaopeng Zhang
ECCV 2018