Luma AI

Introducing Modify with Instructions in Dream Machine. Use natural language to direct changes across VFX, advertising, film, and design workflows. Native object removal, swapping, virtual sets, character refinements, and restyle will roll out soon to all subscribers.

BTS: Virtual Relighting Reimagined with #Ray2 Modify Video #aivideo #vfx #virtualproduction #lighting

Virtual Relighting Reimagined with #Ray2 Modify Video #aivideo #vfx #virtualproduction #lighting

How to Zero Gravity with Modify Video Transform the floor into space and float like an astronaut with #Ray2 Modify Video in #DreamMachine. Step 1: Capture a video of yourself or a friend lying on the ground with more friends puppeteering some objects on sticks to simulate floating space debris. Step 2: Open Dream Machine and create a new Board. Step 3: Select the Modify option in composer settings. Step 4: Import or drag and drop your edited video onto the blank Video Card in the composer. Step 5: Select the Video Card to open Trim View. Select the “Start Frame” button to download your Start Frame. Step 6: Import your Start Frame into Photoshop. Step 7: Using Gen Fill, replace elements of your scene to remove any unwanted details like feet or sticks holding floating objects to create the surrounding environment. Once completed, export your Edited Start Frame. Step 8: Import your Edited Start Frame into Midjourney Edit, or any image editor. Select the Retexture button. Step 9: In Midjourney, create a prompt to retexture your Start Frame. Include your envisioned details for the subject, environment, style, mood, lighting, and more. Select the Submit Retexture button to generate your New Start Frame. Once completed, download the image. Step 10: Import your video into After Effects. Pro Tip: Tint the background to contrast your performer. This will help shape the scene structure and motion. Step 11: Mask the subject’s face and any sticks or hands used to guide floating objects in the scene to clean it up. Step 12: In Dream Machine, import your Edited Video. Step 13: Import your New Start Frame onto the Start Frame Card next to your Edited Video. Step 14: Adjust Strength to select an intensity level. Pro Tip: Dial it low to preserve detail. Turn it up to dream bigger. Experiment with Strength intensity levels across the slider from Adhere, Flex, and Reimagine to see which Strength level works best for your idea and your video. Step 15: Select and lock in your preferred Strength level. Flex 2 was used for this video example. Step 16: Tap the Create button in the composer to make your zero gravity video come to life. #aivideo #tutorial #vfx #bts #virtualproduction

How to Dragon with Modify Video Turn a piggy back ride into a magical dragon flight with #Ray2 Modify Video in #DreamMachine. Step 1: Capture a video of a friend crawling with their child piggy back riding on their back. Step 2: Open Dream Machine and create a new Board. Step 3: Select the Modify option in composer settings. Step 4: Import or drag and drop your edited video onto the blank Video Card in the composer. Step 5: Select the Video Card to open Trim View. Select the “Start Frame” button to download your Start Frame. Step 6: Import your Start Frame into Midjourney Edit, or any image editor. Select the Retexture button. Step 7: In Midjourney, create a prompt to retexture your Start Frame. Include your envisioned details for the subject, environment, style, mood, and lighting. Select the Submit Retexture button to generate your New Start Frame. Once completed, download the image. Step 8: Import your Start Frame into Photoshop. Step 9: Using Gen FIll & Levels, refine your scene by cleaning up the frame details and fine tuning your color. Step 10: Import the original video into After Effects. Step 11: Using Puppet Tool, animate flapping movement on rough shapes to simulate the dragon’s wing motion. Pro Tip: Blur out the arms and legs of the person crawling. Your edits do not have to be exact. The goal is to roughly shape the overall look and general structure of your performer to map to your dragon’s movement. Step 12: In Dream Machine, import your Edited Video. Step 13: Import your New Start Frame onto the Start Frame Card next to your Edited Video. Step 14: Adjust Strength to select an intensity level. Pro Tip: Dial it low to preserve detail. Turn it up to dream bigger. Experiment with Strength intensity levels across the slider from Adhere, Flex, and Reimagine to see which Strength level works best for your idea and your video. Step 15: Select and lock in your preferred Strength level. Reimagine 3 was used for this video example. Step 16: Tap the Create button in the composer to make your animated dragon riding modified video come to life. #aivideo #tutorial #vfx #bts #virtualproduction

Image-to-Video with #Ray2 is now available on Amazon Bedrock. Learn more: https://lnkd.in/eABuYjyC

How to Levitate with Modify Video Create the illusion of floating up into a beam in the sky with #Ray2 Modify Video in #DreamMachine. Step 1: Capture a video of a friend holding and lifting up their child to simulate being levitated up into the sky. Step 2: Open Dream Machine and create a new Board. Step 3: Select the Modify option in composer settings. Step 4: Import or drag and drop your captured video onto the blank Video Card in the composer. Step 5: Select the Video Card to open Trim View. Select the “Start Frame” button to download your Start Frame. Step 6: Import your Start Frame into Photoshop. Step 7: Using Gen Fill, edit your scene to remove the person holding the floating character, then isolate them. Pro Tip: Preserve the original character in the scene. Step 8: Refine the scene design by adding elements to your scene. Create a darker background, and add in a beam of light shining down on the floating character. Step 9: Import the original video into After Effects. Step 10: Roto Brush to isolate the character in the video. Step 11: Using Content Aware, replace the person holding the floating character with a new background so they don’t show up. Once you’ve roughly removed the background subject,  save and export your Edited Video. Step 12: In Dream Machine, import your new Edited Video. Step 13: Import your New Start Frame onto the Start Frame Card next to your Edited Video. Step 14: Adjust Strength to select an intensity level. Pro Tip: Dial it low to preserve detail. Turn it up to dream bigger. Experiment with Strength intensity levels across the slider from Adhere, Flex, and Reimagine to see which Strength level works best for your idea and your video. Step 15: Select and lock in your preferred Strength level. Flex 1 was used for this video example. Step 16: Tap the Create button in the composer to make your levitating modified video come to life. #aivideo #tutorial #vfx #bts #virtualproduction

How to Outfit Swap with Modify Video Switch up your fashion look to different styles of outfits with #Ray2 Modify Video in #DreamMachine. Step 1: Capture a video of yourself or a friend hitting different poses, moving freely, or dancing to music. Step 2: Open Dream Machine and create a new Board. Step 3: Select the Modify option in composer settings. Step 4: Import or drag and drop your captured video onto the blank Video Card in the composer. Step 5: Select the Video Card to open Trim View. Select the “Start Frame” button to download your Start Frame. Step 6: Import your Start Frame into Photoshop. Step 7: Using Gen Fill, edit and replace elements of clothing in your scene into different stylish options. Step 8: Repeat Gen Fill to create outfit variations. Pro Tip: Create multiple variations to have more styles to transform into. Step 9: In Dream Machine, import your New Start Frame onto the Start Frame Card next to your original video. Step 10: Adjust Strength to select an intensity level. Pro Tip : Dial it low to preserve detail. Turn it up to dream bigger. Experiment with Strength intensity levels across the slider from Adhere, Flex, and Reimagine to see which Strength level works best for your idea and your video. Step 11: Select and lock in your preferred Strength level. Flex 2 was used for this video example. Step 12: Tap the Create button in the composer to make your outfit style video come to life. Step 13: Download your first modified video. Step 14: Repeat the process with each variation.  Step 15: Import modified videos into any video editor. Step 16: Stack the modified videos in your timelines. Step 17: Cut and create your outfit swapping video edit. #aivideo #tutorial #vfx #bts #virtualproduction

Ray2 Flash is now available for Modify Video & Modify Video API. Reimagine videos and build with even more speed & efficiency. Scale your creative AI products with higher rate limits and hands-on support from the Luma team. https://lnkd.in/grHvdNjg Available now API & SDKs. Python: https://lnkd.in/ghzdkUhT TS/JS: https://lnkd.in/gkwFrTu3 Ray2 Flash is 3x faster & cheaper than Ray2. https://lnkd.in/gRBXhc3y Learn more about Modify Video API. Doc: https://lnkd.in/giFWAtxw Ref: https://lnkd.in/gdVWzYPX

How to Slackline with Modify Video Turn outdoor park benches into a thrilling slackline walk with #Ray2 Modify Video in #DreamMachine. Step 1: Capture a video of yourself or a friend balancing on a bench or flat rail pretending to cross a wide canyon and balancing side to side with their arms out. Step 2: Open Dream Machine and create a new Board. Step 3: Select the Modify option in composer settings. Step 4: Import or drag and drop your captured video onto the blank Video Card in the composer. Step 5: Select the Video Card to open Trim View. Select the “Start Frame” button to download your Start Frame. Step 6: Import your Start Frame into Photoshop. Step 7: Using Pen, Object Selection & Gen Fill, edit your scene to shape a slackline and replace the background with an open space. Then add in a bit of detail for the surrounding environment. Once completed, export your Edited Start Frame. Pro Tip: Your edits do not need to be exact. The goal is to roughly shape the overall look and general structure you want to later be retextured with finer details. Step 8: Import your Edited Start Frame into Midjourney Edit, or any image editor. Select the Retexture button. Step 9: In Midjourney, create a prompt to retexture your Start Frame. Include your envisioned details for the subject, environment, style, mood, lighting, and more. Select the Submit Retexture button to generate your New Start Frame. Once completed, download the image. Step 10: In Dream Machine, import your New Start Frame onto the Start Frame Card next to your original video. Step 11: Adjust Strength to select an intensity level. Pro Tip: Dial it low to preserve detail. Turn it up to dream bigger. Experiment with Strength intensity levels across the slider from Adhere, Flex, and Reimagine to see which Strength level works best for your idea and your video. Step 12: Select and lock in your preferred Strength level. Flex 3 was used for this video example. Step 13: Tap the Create button in the composer to make your slackline modified video come to life. #aivideo #tutorial #vfx #bts #virtualproduction