Bill Peebles

10 min read
Updated
Suggest editHistoryTalk
RawGraph

Last edited

Fact-checked

In review queue

Sources

11 citations

Revision

v2 · 1,901 words

Fact-checks are independent of edits: a reviewer re-verifies the article against its sources and stamps the date. How we verify

William "Bill" Peebles is an American machine learning researcher best known as the co-inventor of the Diffusion Transformer (DiT) architecture and as the head of Sora, OpenAI's text-to-video generation system. In 2022, with Saining Xie, Peebles introduced DiT, which replaced the convolutional U-Net backbone of earlier diffusion models with a pure transformer and became a foundation for a generation of image and video generators, Sora among them.[3] He earned his PhD at the University of California, Berkeley (Berkeley AI Research) and his undergraduate degree at the Massachusetts Institute of Technology (MIT).[1] Peebles joined OpenAI in 2023, co-led and then headed the Sora team, and oversaw the September 2025 launch of Sora 2 and its companion social app before leaving the company in April 2026 as OpenAI wound the product down.[1][8]

Who is Bill Peebles?

Peebles is a computer scientist and generative-modeling researcher whose work sits at the intersection of two threads that came to define mid-2020s AI media: transformer scaling and diffusion-based image and video synthesis. As the first author of "Scalable Diffusion Models with Transformers," he is credited, with co-author Saining Xie, as a co-creator of the Diffusion Transformer.[3] As head of the Sora team at OpenAI, he led the effort that brought that architecture into the video domain and into a consumer product.[1] On his personal website, Peebles described his role as "a research scientist at OpenAI and the Head of Sora, our video generation and world simulation effort."[1]

Early life and education

Peebles studied at MIT from 2015 to 2019, where he worked on computer vision and generative modeling in the lab of Antonio Torralba through MIT's SuperUROP undergraduate research program. His earliest publications date from this period, including "Seeing What a GAN Cannot Generate" (ICCV 2019) and "Semantic Photo Manipulation with a Generative Image Prior" (SIGGRAPH 2019), both rooted in the analysis and editing of images produced by generative adversarial networks.[1]

He then moved to the University of California, Berkeley for doctoral study, joining the Berkeley Artificial Intelligence Research (BAIR) lab from 2019 to 2023 under the supervision of Alexei "Alyosha" Efros. During his PhD he was supported by a National Science Foundation Graduate Research Fellowship and completed internships at Meta's Fundamental AI Research lab (FAIR), Adobe Research, and NVIDIA. His dissertation, "Generative Models of Images and Neural Networks," was filed in May 2023 and tied together three strands of his work: diffusion transformers, generative models trained on neural network checkpoints, and the use of pretrained GANs as a source of supervision for visual correspondence.[2]

What are Bill Peebles's main research contributions?

Peebles's graduate research centered on scaling generative models and extending them beyond their original domains. Before DiT, his most recognized result was "GAN-Supervised Dense Visual Alignment" (CVPR 2022), which used a pretrained GAN generator to learn dense correspondences across images without human annotation; the paper was named a Best Paper Finalist. He also explored meta-learning with "Learning to Learn with Generative Models of Neural Network Checkpoints," a system that trained a diffusion model over hundreds of thousands of optimizer trajectories so that it could sample neural network parameters meeting a target loss.[1][2]

What is the Diffusion Transformer (DiT)?

The work that made Peebles widely known is "Scalable Diffusion Models with Transformers," released on arXiv (arXiv:2212.09748) in December 2022 and co-authored with Saining Xie. The paper introduced the Diffusion Transformer, or DiT, a class of latent diffusion models that discards the U-Net architecture standard in image generators and instead processes sequences of latent image patches with a transformer. Conditioning information such as the diffusion timestep and class label is injected through an adaptive layer normalization scheme the authors call adaLN-Zero.[3]

DiT's central finding was a clean scaling relationship: as the transformer's compute, measured in Gflops, increases, sample quality improves predictably. The largest model, DiT-XL/2, set a new state of the art on class-conditional ImageNet generation, reaching a Frechet Inception Distance (FID) of 2.27 at 256x256 resolution and also outperforming all prior diffusion models at 512x512. The result demonstrated that the transformer scaling behavior already familiar from large language models also held for diffusion-based image synthesis.[3]

The paper had a notably rocky start. It was rejected from CVPR 2023 on the grounds of "limited novelty," with reviewers describing it as a straightforward combination of a transformer and a latent diffusion model. It was subsequently accepted to the IEEE/CVF International Conference on Computer Vision (ICCV) 2023 as an oral presentation. Xie later cited the episode publicly as evidence that peer review struggles to predict impact: DiT went on to underpin OpenAI's Sora and, through the related SiT formulation, influenced systems such as Stable Diffusion 3.[3][4]

The table below summarizes Peebles's principal publications.

YearWorkVenueNote
2019Seeing What a GAN Cannot GenerateICCVOral
2019Semantic Photo Manipulation with a Generative Image PriorSIGGRAPH
2020The Hessian PenaltyECCVSpotlight
2022GAN-Supervised Dense Visual AlignmentCVPRBest Paper Finalist
2022Learning to Learn with Generative Models of Neural Network CheckpointsarXiv
2022Scalable Diffusion Models with Transformers (DiT)ICCV 2023Oral

What is Bill Peebles's role at OpenAI?

Peebles joined OpenAI in 2023 to work on video generation, bringing the DiT recipe into the video domain. He co-led the Sora effort with Tim Brooks, a former Berkeley colleague who had helped start the project in early 2023. The two engineered a model that represented video as sequences of spacetime latent patches, allowing a single diffusion transformer to generate clips of varying resolution, duration, and aspect ratio.[5]

OpenAI first previewed Sora on February 15, 2024, accompanied by a technical report, "Video generation models as world simulators," that framed large-scale video models as a path toward general-purpose simulators of the physical world. Brooks left OpenAI for Google DeepMind in October 2024 to work on video and world simulation, after which Peebles continued as head of the Sora team. Sora became publicly available to ChatGPT Plus and Pro subscribers in the United States and Canada on December 9, 2024.[5][6][9]

What was Sora 2 and the Sora app?

Under Peebles, OpenAI released Sora 2 on September 30, 2025, alongside a standalone mobile application built around a vertical, TikTok-style feed of AI-generated clips. The app's signature feature, Cameo, let users insert a short verified selfie video of themselves, or of friends who granted permission, into generated scenes. The launch was an immediate consumer hit: Peebles announced that the Sora app surpassed one million downloads in fewer than five days, faster than ChatGPT had at its own debut, and it climbed to the top of Apple's App Store, where it remained for weeks.[7][8]

The app's success was short-lived as a business. Reports placed Sora's operating cost at roughly one million dollars per day in compute, and after peaking near one million active users the app declined to fewer than 500,000 by the time of the shutdown announcement; the product also drew intellectual-property complaints over generated likenesses and copyrighted material.[8][11] On March 24, 2026, OpenAI announced it would discontinue Sora as a standalone product. The web and app experiences shut down on April 26, 2026, and the company scheduled the Sora API for discontinuation on September 24, 2026. The underlying Sora 2 model was retained inside ChatGPT, and OpenAI redirected much of the Sora research team toward world-simulation work aimed at robotics.[8][10]

Why did Bill Peebles leave OpenAI?

Peebles announced his departure from OpenAI on Friday, April 17, 2026, on the same day as two other senior figures: Kevin Weil, the vice president who had led OpenAI for Science, and Srinivas Narayanan, an executive in the company's enterprise applications group. Commentators framed the simultaneous exits as part of a broader strategic shift in which OpenAI pared back consumer-facing "side quests" to focus on enterprise products and core research ahead of a potential public offering.[8][9]

In the note he shared with his team and posted publicly, Peebles called building Sora "zero-to-one" with his colleagues "the honor and adventure of a lifetime." He argued that Sora had spurred a large wave of investment in video across the industry and that ambitious research of that kind needs room to operate apart from a company's main lines of business, writing that "cultivating entropy is the only way for a research lab to thrive long-term."[8][9] OpenAI did not announce a successor for the Sora franchise, and Peebles did not immediately disclose his next venture; as of mid-2026 he is a former OpenAI research scientist and the former head of Sora.[8]

The timeline below captures the key dates of Peebles's public career.

DateEvent
2015-2019Undergraduate study at MIT (Torralba lab)
2019-2023PhD at UC Berkeley (BAIR, advised by Efros)
Dec 2022DiT paper released with Saining Xie
2023Joins OpenAI; co-leads Sora with Tim Brooks
Feb 15, 2024Sora previewed
Dec 9, 2024Sora launched to ChatGPT Plus and Pro users
Sep 30, 2025Sora 2 and Sora app released
Mar 24, 2026OpenAI announces Sora discontinuation
Apr 17, 2026Peebles announces departure from OpenAI
Apr 26, 2026Sora web and app shut down

How is Bill Peebles recognized in the field?

Peebles is regarded as one of the architects of the transformer-based diffusion models that came to dominate generative media in the mid-2020s. The Diffusion Transformer is widely cited and has been adopted or adapted across a range of open and commercial image and video systems, and its initial rejection followed by outsized influence is frequently used as a cautionary example about the limits of academic peer review. His earlier "GAN-Supervised Dense Visual Alignment" was a CVPR 2022 Best Paper Finalist, and his doctoral research was supported by an NSF Graduate Research Fellowship. Beyond the research itself, his stewardship of Sora placed him at the center of the commercial emergence of consumer AI video between 2024 and 2026.[1][3][8]

References

  1. "William Peebles." Personal website, wpeebles.com. Accessed 2026.
  2. Peebles, William. "Generative Models of Images and Neural Networks." PhD dissertation, UC Berkeley, Technical Report UCB/EECS-2023-108, May 11, 2023.
  3. Peebles, William, and Saining Xie. "Scalable Diffusion Models with Transformers." arXiv:2212.09748, December 2022; published ICCV 2023 (oral).
  4. Saining Xie, post on X (formerly Twitter) regarding the CVPR 2023 rejection of the Diffusion Transformer paper, February 2024.
  5. OpenAI. "Video generation models as world simulators." OpenAI research, February 15, 2024.
  6. "A co-lead on Sora, OpenAI's video generator, has left for Google." TechCrunch, October 3, 2024.
  7. "OpenAI's Sora hit 1 million downloads in less than five days." CNBC, October 9, 2025; OpenAI, "Sora 2 is here," September 30, 2025.
  8. "Kevin Weil and Bill Peebles exit OpenAI as company continues to shed 'side quests'." TechCrunch, April 17, 2026.
  9. "OpenAI loses product chief, Sora head, and enterprise CTO in single-day triple exit." The Next Web, April 2026.
  10. "What to know about the Sora discontinuation." OpenAI Help Center, 2026; "OpenAI sets two-stage Sora shutdown with app closing April 2026 and API following in September." The Decoder, 2026.
  11. "OpenAI loses multiple executives in latest leadership shakeup." CNBC, April 17, 2026.

Improve this article

Add missing citations, update stale details, or suggest a clearer explanation. Every suggestion is reviewed for sourcing before it goes live.

1 revision by 1 contributors · full history

Suggest edit