State of AI with Nathan Benaich - From driving the world to dreaming it

0:00from driving the world to dreaming it, with Jeff Hawke, co-founder and CTO of Odyssey at Rise 2026. Jeff Hawke thinks AI is missing a form of intelligence. Frontier research as he sees it runs on two macro bets, whether AI can bootstrap its own intelligence, the wager behind the lab's chasing recursive self-improvement, or whether it can, in his words, learn from the world directly. Odyssey, where Hawke is co-founder and CTO, takers the second.

0:30The aim is to model the world as it is seen and acted on. A representation that is richer than language, built from raw sights and sounds rather than from concepts a human has already written down. That was once a hard sell. When Odyssey pitched its seed round, he says, basically no one understood world models and convincing people was an uphill battle. The category has since shifted underneath him. The argument flipped around November 2025.

0:59money and researchers flooded in, and at NeurIPS 2025, world models were, by his count, the field's number one or two theme. Hawk came to the problem from self-driving as a founding engineer at Wave Teaching Cars to drive end to end. One of the few arenas, he says, where frontier AI has really been tested against reality. Not every world model is a world model. The term is loose enough to mean almost anything, so Hawk was careful to pin it down.

1:26Odyssey uses it in the precise sense inherited from model-based reinforcement learning, a learned transition dynamics model, the thing David Ha and Juergen Schmidhuber named in their 2018 World Models paper. In plain terms, a model that learns how the world evolves and then samples possible futures one step at a time, conditioned on the actions you feed it. That is distinct from spatial intelligence, which models the appearance and structure of a scene, the pitch at world labs and others.

1:55from behavior models, the decision-making brain of a self-driving car or a robot, which Hawke thinks is better named as such. And from the proxy world models, some researchers argue are already latent inside LLMs. Odyssey's version is what he calls a general-purpose neural simulator, an interactive stream of pixels that models physics that you can talk to and that talks back and that you can reach into and change.

2:23I have many questions about what this means for future products," he admitted. I have very few good answers. Generality wins. Two principles guide what Odyssey builds, both carried out of self-driving. First, end-to-end learning. A simple model trained purely from data almost always wins. It was an unpopular position in 2018 and is now the default in autonomy and in language alike. Second, generality wins. Narrow models built for a single vertical rarely keep their lead for long.

2:52He couldn't point to durable legal specific foundation models, for instance, because Claude just got better. The ambition that follows is unsubtle. Odyssey wants to build the GPT-3 of world models. The instruct GPT style moment when a category of model stops being a research demo and starts generating real commercial demand. Odyssey's research splits into four problems, each with a shipped model against it. Pixels that keep going.

3:20The foundation is autoregressive interactive pixels, embodied in Odyssey 2. The standard video model returns a fixed clip. This one streams frame after frame in real time, which is much harder because error compounds as the model generates in sequence. It is also interactive, absorbing text prompts midstream and adjusting to them. Scaling helps in the usual way. A 1 billion to a 15 billion parameter jump lifts the benchmarks.

3:47but the real difficulty is keeping the interaction open-ended instead of narrowing it to a single domain. Sound is part of the world. In May 2026, Odyssey released Star Child 1, named for 2001, a space Odyssey which generates pixels and audio jointly in one coherent stream rather than dubbing sound onto finished video. It was harder than expected, Hawke said. To his knowledge, no one else had shown one publicly. The obstacle is a clash of time scales.

4:16A single predicted video frame spans only half a phoneme of audio. So keeping the two coherent took a custom KV cache design, running on two clocks at once. Shared state, not stitched video. The third problem is multiplayer. Shared state across world models, which matters as much for a cell of robots working one environment as it does for a game. Odyssey's Agora, one demonstrates it and Hawk ran it live.

4:43The audience pointed their phones at a QR code and played a fully generated game of GoldenEye. Streamed off H100 was probably in Spain. Under the hood, it borrows a game engine split between rendering and simulation, except both halves are learned. A neural simulator and a neural renderer trained together. People had said multiplayer world models weren't possible, he noted, and we felt it was worth disproving. Learning by being broken. The fourth strand carries the freshest idea in the talk.

5:13Almost everyone who pairs agents with world models uses the agent to get smarter inside the model. Odyssey's Prowl turns that around. It uses a reinforcement learning agent to improve the model itself. The reasoning is garbage in, garbage out. Your agent will never really be better than the quality of your learned environment model. And yet, Hawk argued, almost no one had bothered to fix the model rather than the agent. Prowl drops an agent into a learned version of Minecraft and rewards it for finding the world model's failure modes, then folds those failures into a curriculum that patches them. The wrinkle is that reinforcement learning is very good at cheating. Left unleashed, the agent would sit on the spot, spin the camera around at very high speed to stall the model's learning, so the team added a KL leash to keep it close to an agent that actually plays the game. The payoff was a clear lift in the base model's performance, a world model that gets better by being systematically broken.

6:11Still the GPT-2 era. For all of that, Hawk was disciplined about where the work sits. World models, he said, are at the GPT-2 era, the pre-chat GPT stage where the outputs already look promising and the first commercial experiments are forming. He name-checked Jasper, the early GPT-3 copywriting startup, but mass adoption is still ahead. That is the gap between today and the GPT-3 of world models he wants to build. The honesty extends to limits.

6:41Asked from the floor whether a world model would have to encode general relativity and quantum mechanics, he declined the bait. Visual data is by far the highest volume and the right place to start, and these models earn their keep where conventional simulation struggles. For a precise definition of turbulent flow, use CFD. For crowds, contact, the messy texture of a scene, the neural simulator wins. Biology and harder physics are wanted, but he conceded nascent. The economics are gentler than the hardware implies. The multiplayer demo ran on a single H100, let's call it $1.50 an hour, close enough to a Netflix subscription that, by his estimate, $30 a month buys 10 to 15 hours of generated play. Where this goes on is telling is convergence. As a visual world model takes on audio and eventually text, it meets the language models arriving from the other direction through VLMs.

7:41And at some point, the two merge. None of that is solved, and he was candid that no one yet knows how. But the direction is set, and the market is caught up to the thesis that once needed an uphill seed pitch. On June 17th, 2026, days after raise, Odyssey raised a $310 million Series B at a $1.45 billion valuation, led by Natural Capital with Amazon, AMD Ventures, and GV.

8:09Air Street backed the company's seed in 2024 on the bet that learning the world directly would become its own category of model. The GPT-2 era doesn't last long.