Real-Time AI Video is Finally Here (And It’s Insane!)

Real-time video generation has arrived. Today, we are diving deep into PixVerse’s new R1 model—a narrative-controlled "world model" that lets you influence the video as it streams. From peaceful hikes to sudden avalanches and chaotic tornadoes, we push this real-time model to its absolute limits (and yes, it gets a little janky, but it is incredibly fun).

We also break down the release of Black Forest Labs' Flux 2 Klein, a smaller, faster version of their massive image model designed for consumer hardware. Plus, we look at Runway's new "Story Panels" feature, updates to Google Veo, and a fascinating open-source project called Wonder Zoom.

If you are interested in the future of generative media, world models, and open-source AI, you won't want to miss this one.

My Newsletter: https://theoreticallymedia.beehiiv.com/

🔗 Links Mentioned:
PixVerse R1 Beta: https://x.com/PixVerse_
Black Forest Labs (Flux 2 Klein): https://bfl.ai/
Runway Story Panels: https://runwayml.com/
Google Veo Updates: https://blog.google/innovation-and-ai...
Wonder Zoom Project: https://wonderzoom.github.io/



00:00 - Intro: Real-Time World Models Are Here
00:36 - The Current State of World Models
01:20 - Explaining PixVerse R1: Interactive Video Generation
02:09 - R1 Technical Specs: 1080p & Infinite Streaming
02:44 - Testing the Snow Peak Vlog Preset
03:35 - Triggering an Avalanche (Or Giant Snowball?)
04:17 - Ambient Mode: Waking Up the Sleeping Guy
05:00 - Dramatic Mode: Business Suits & Hot Dogs
05:50 - Chaos Unfolds: Tornadoes, Hitmen & Godzilla
06:32 - Cozy Cabin Test: Fireplaces & Bears
07:14 - Janky and Weird is Just for Now
08:07 - Is This the Future of AI Entertainment?
08:36 - Flux 2 Klein Released: Smaller & Faster
08:53 - It's Fast!
09:23 - Why Flux Matters
09:33 - Testing Image Gen
10:12 - Handling Text & Fantasy Art in Flux 2
10:56 - The Toast Test & Realism Checks
11:07 - Image Editing Test
11:30 - Comparison: Flux 2 Dev vs. Klein
12:05 - Runway Update: Story Panels Feature
12:26 - Testing the Detective Prompt (Cinematic Stacks)
12:43 - Comparing Stacks to Previous Method
13:06 - Cropping
13:25 -Creative Examples: 3-Up Video Generation
13:36 Other Runway Updates
13:55 - Google Veo 3.1: Vertical Video Update
14:18 - "Ingredients" for Social Media Shorts
14:37 - Character Consistency
15:08 - Is the Flow Platform Worth the Price?
15:37 - Wonder Zoom: The Infinite Zoom Tool
16:00 - Parallax Effects & Legacy AI Comparisons
16:27 - Code Availability & Outro