Luma’s New AI Model Turns Two Images Into a Full Video

Luma Introduces Ray3 Modify for Controlled AI Video Creation

Luma, the a16z-backed AI video and 3D model startup, has released a new generative video model called Ray3 Modify. The model focuses on giving creators more control while editing or generating video using AI. It allows users to guide video creation using a start frame and an end frame, making transitions more predictable and consistent.

This release targets creative studios that want to use AI without losing the realism of human performance. According to Luma, Ray3 Modify closely follows the original footage, helping teams preserve natural motion and expressive details.

Preserving Human Performance With AI

One of the biggest challenges in AI video generation is maintaining authentic human movement. Luma says Ray3 Modify solves this by retaining the actor’s original motion, timing, eye line, and emotional delivery. As a result, creators can edit or transform footage without breaking continuity.

The model allows users to upload character reference images. These references help transform the actor’s appearance while keeping the original performance intact. This approach makes AI edits feel grounded rather than synthetic.

Character Transformation Without Reshoots

Ray3 Modify lets creators convert an actor into a different character using visual references. The system carries forward details such as costumes, likeness, and identity across scenes. This reduces the need for reshoots and complex post-production workflows.

Because of this, studios can experiment with new looks, settings, or creative directions after filming. The original performance stays the same, while the visual layer changes through AI.

Using Start and End Frames to Control Video

Another key feature of Ray3 Modify is start and end frame guidance. Users can define how a scene begins and ends, while the AI generates the transition between them. This helps maintain visual continuity and character behavior across scenes.

This feature is especially useful for controlled transitions, movement direction, and narrative consistency. It gives creators more predictable results compared to fully open-ended generative video models.

Available on Dream Machine Platform

Luma has made Ray3 Modify available through its Dream Machine platform. The company competes with players like Runway and Kling in the AI video space. Luma previously introduced video modification tools in June 2025.

The launch follows a major $900 million funding round announced in November, led by Saudi Arabia’s Humain. Luma is also planning a large AI infrastructure project in Saudi Arabia, signaling its long-term ambitions in generative media.

68 Views