Runway’s New Aleph Video Model Offers Insane New Ways for AI to Edit Your Videos

Introducing Runway Aleph

Introduced by Runway as “A new way to edit, transform, and generate video,” Aleph is an in-context video model that makes use of the latest (and, depending on your views, greatest) AI technology to deliver multi-task visual generations.

Of these multi-task visual generations, we’re talking about some pretty sophisticated object addition, removal, and transformation properties that are akin to what we’ve seen with photo-editing AI tools like Adobe Photoshop’s Object Object Removal and Generative Fill.

What’s crazier, though, might be the Aleph’s ability to generate new angles of a scene or modify style and lighting.

Runway Aleph Features and Capabilities

While there’s likely to be a lot more to explore here over the coming weeks and months (that is, unless some other new AI technology quickly outpaces Aleph, making it moot), here’s a breakdown of all of the new features and capabilities that Aleph is capable of.

• Generate New Camera Angles: With Runway Aleph, you can generate novel views of existing scenes with simple prompts. Whether you need a reverse shot or a low angle, you're now able to generate endless coverage.
• Generate the Next Shot: Create seamless continuations of your story. With Runway Aleph, you can easily generate the next shot in your sequence just by asking for it.
• Use Any Style to Transfer to a Video: Transform any video with your desired aesthetic. With Runway Aleph, you can easily apply any style to your footage just by asking for it.
• Change Environments, Locations, Seasons, and Time of Day: Turn ordinary footage into professional-grade visual effects. All while retaining as much, or as little, of your source footage as you'd like.
• Add Things to a Scene: Enhance your footage with anything you can imagine. Runway Aleph seamlessly integrates new elements into existing scenes – add crowds to empty streets, place products on tables, or insert props you forgot to film. Simply describe what you want or provide a reference image, and watch it appear naturally in your video with proper lighting, shadows, and perspective.
• Remove Things from a Scene: Never worry about cluttered scenes or distracting elements again. With Runway Aleph, you can easily remove unwanted objects and elements from footage just by asking for it.
• Change Objects in a Scene: Runway Aleph allows you to easily retexture or entirely replace objects, subjects, and more from existing videos. Either with a text prompt or a reference image of what you'd like to swap into your video.
• Apply the Motion of a Video to an Image: Take the motion of any video and apply it to a new first frame image for fine-grained camera control.
• Alter a Character's Appearance: Change the age and appearance of actors with simple prompting. No need for complicated practical makeup or costly visual effects work, just ask for what you want.
• Recolor Elements of a Scene: Easily change the color of objects in a scene by providing a color swatch or describing the palette you're looking for.
• Relight Shots: Transform the mood of any scene with completely new lighting. Shot at the wrong time of day? Runway Aleph lets you change harsh noon light to golden hour, brighten underexposed footage, or create dramatic sunset lighting from a cloudy day. The lighting adjusts naturally across your entire scene, updating shadows, reflections, and color temperature to match your vision.
• Green Screen Any Object, Person, or Situation: Pull any person or object from your footage and place them on a clean background. Runway Aleph automatically isolates your subject with precise edge detection, preserving every detail from hair strands to transparent fabrics. Export with green screen, transparent background, or any solid color for seamless integration into other projects.

.