gen‑ai.news
← Back
Video

Meet Google DeepMind’s Genie 4: Real-Time World Model With Native Audio

Google DeepMind has made Genie 4 available as a research preview, building on its earlier world-modeling work with a set of additions that push the system closer to a fully interactive, real-time simulation environment. The most notable change is native audio generation - where previous iterations focused primarily on visual output, Genie 4 produces sound as a first-class part of the experience rather than as an afterthought layered on top.

The system also introduces live dialogue and text steering, meaning users can describe or direct what happens inside a simulated environment using natural language, and the model responds in real time. This positions Genie 4 less as a passive video generator and more as an interactive substrate - something closer to a controllable, generative game engine than a traditional diffusion-based image or clip tool.

A key architectural detail is the integration of Gemini 3.8 Flash as a planning model operating inside the simulation loop. Rather than generating moment-to-moment frames purely from learned patterns, Gemini 3.8 Flash reasons about events and their sequencing, giving the world model a layer of higher-order structure. This kind of nested architecture - where a language model guides a generative world model - reflects a broader trend in AI research toward combining fast, reactive generation with deliberate planning.

Genie 4 is currently a research preview rather than a public product, so access is limited and the system is likely still being evaluated for reliability and safety. DeepMind's earlier Genie models established the concept of learning interactive environments from video data without explicit action labels, and this release continues that trajectory while significantly expanding what the output can contain. For researchers and developers watching the space, the combination of real-time generation, audio, and language-driven control in a single model is worth tracking closely.

Enjoy this story? Get the next one in your inbox.

Twice a week: the most important stories in generative image and video AI, distilled into a 2-minute read.

Free. Unsubscribe any time. No spam, ever.

Your next read

China’s First Fully AI-Generated Film is Crashing and Burning at the Box Office
Video

China’s First Fully AI-Generated Film is Crashing and Burning at the Box Office

China's first fully AI-generated feature film has hit theaters nationwide, but early returns suggest audiences are not warming to the format. Despite an opening day that included 10,000 screenings, the film is struggling to find a meaningful box office foothold. The release marks a notable moment for generative video AI, even as the commercial reception raises questions about audience readiness.

MotionVFX Content is Coming to Final Cut Pro as Apple Creator Studio Gets Overhaul
Video

MotionVFX Content is Coming to Final Cut Pro as Apple Creator Studio Gets Overhaul

Apple has rolled out a significant update to its Creator Studio subscription suite, with the headline addition being MotionVFX content built directly into Final Cut Pro for Mac. The update also brings Pixelmator Pro integration, Logic Pro improvements, and expanded AI features across Apple's productivity apps.

Runway News | Runway Ads Is Generally Available
Video

Runway News | Runway Ads Is Generally Available

Runway has made its Ads product generally available across all paid plans, giving marketers a dedicated tool for generating on-brand creative variants from existing high-performing ads. The company reports that internal use of the tool grew weekly ad volume tenfold while reducing cost per subscriber by 41%. The release marks Runway's clearest move yet into applied advertising workflows.