A NeurIPS 2026 Tutorial · Sydney, Australia

The Principles of Diffusion Models: Towards Fast and Scalable Diffusion LLMs

A NeurIPS 2026 tutorial on designing frontier diffusion-LLMs at scale, featuring live demos that attendees can adapt for their own research.

DateMon, Dec 7, 2026
Time9:00 AM AEDT
RoomTikTok Ent Centre
FormatLectures + live demos

01 Speakers

Three instructors.

CLPortrait of Chieh-Hsin (Jesse) Lai
Bio

Chieh-Hsin (Jesse) Lai received his Ph.D. in Mathematics from the University of Minnesota in 2021. He is currently a Staff Research Scientist at Sony AI and a Visiting Assistant Professor in the Department of Applied Mathematics at National Yang Ming Chiao Tung University (Taiwan). His research focuses on deep generative modeling (with an emphasis on diffusion models) and AI for science. Recently, he led and authored a book, The Principles of Diffusion Models, which provides a systematic treatment of the foundations of diffusion models.

SEPortrait of Stefano Ermon
Stanford University
Bio

Stefano Ermon is an Associate Professor of Computer Science at Stanford University, where he is affiliated with the Stanford Artificial Intelligence Laboratory. His research centers on probabilistic modeling and generative AI, and his group has made foundational contributions to score-based and diffusion models, including score matching with Langevin dynamics, Score SDEs, and DDIM. He is also a co-founder of Inception, which builds diffusion-based large language models.

Organizers

Jesse Lai (Sony AI), Subham Sahoo (MBZUAI · IFM), Yuki Mitsufuji (Sony AI), and Stefano Ermon (Stanford University)

02 Schedule

Three parts, three speakers.

The tutorial starts at 9:00 AM AEDT on Monday, December 7, in the TikTok Ent Centre and runs in the order below. Per-session times will be posted closer to the event.

Part I

Designing Frontier Diffusion-LLMs

This section examines where today's LLMs fall short and how diffusion and autoregressive LLMs can be combined to design superior LLMs.

InstructorSubham Sekhar Sahoo
I · 01 Introduction to diffusion-LLMs
  • Masked & Uniform-state Discrete Diffusion
Preliminaries
I · 02 Limitations of current diffusion-LLMs
  • Case Study: Llada, Nemotron-Labs Diffusion, and Diffusion Gemma
Case Study
I · 03 Diffusion-Augmented LLMs
  • Fixing the quality issues in standard diffusion-LLMs
  • Unlocking diffusion capabilities in standard LLMs
  • Speeding up post-training and inference in standard LLMs via discrete diffusion
Materials ↗
I · 04 Live Demo: Building a Diffusion-Augmented LLM Live demo
Part II

Continuous Diffusion for Discrete Data

Contents to be announced soon.

InstructorChieh-Hsin (Jesse) Lai
Part III

TBD

Contents to be announced soon.

InstructorStefano Ermon

Session times to be announced · shown in program order.