I don't think I'm too late to the party. Here's my first Luma AI video (queued for 4-6 hours). I'm not very experienced with video generators, but I've been playing #RunwayML for the past few months. My first impression of prompt-to-video: (+) The video has much more movements and character action than anything I got with runway, like way more. (+) 6 seconds, instead of 4. (+) Runway has a protection against multiple types of scenes (some of which I definitely agree with, but some I find restrictive, if you want to explore the action and horror movie genre). This one is meant for an action movie and it wasn't blocked as too violent, which I appreciate. (-) a few more gen-ai defects than I was lead to expect, but still acceptable for now (if you're looking for that gen-ai style). (-) announced time-to-generate 120 seconds which is slower than runway (even for 50% longer sequence). https://lnkd.in/eeBgyStA Overall, the current developments pace in the field leads me to think that in a year, we'll have something like 3x faster generation and close to perfect cinematic videos every time. We'll see.
Frédéric Simard’s Post
More Relevant Posts
-
Runway introduced a new feature called 'Expand Video' which lets users extend video frames while keeping them visually consistent. The feature is part of the Gen-3 Alpha Turbo suite and is being rolled out gradually. Runway's CEO, Cristóbal Valenzuela, said on X that "Fridays are for releasing" when announcing this. This tool uses text prompts and guiding images to create new cinematic movements from static footage, and tutorials are available at Runway Academy. Valenzuela commented on a popular discussion about AI's impact on Hollywood, saying, "The history of cinema is the history of technology." Read more: https://lnkd.in/eyxmqN6v #ai #artificialintelligence #aistartup
To view or add a comment, sign in
-
Hollywood, watch out! AI videos are taking over. Runway AI’s new model, Gen-3 Alpha, is here to create amazing videos from text and images. It lets you make detailed and creative videos just by typing what you want to see. You can control everything from the look and style to the way things move. Plus, it has built-in safeguards to ensure quality and originality. This technology could change the film industry forever. Stock footage libraries might become outdated because anyone can now create unique visuals themselves. This opens up exciting new possibilities for creativity. Think about the incredible visuals and innovative stories we could see! AI isn't replacing human creativity; it’s a powerful tool that helps filmmakers bring their ideas to life more easily. The future of film will likely be a partnership—human imagination working with AI to create experiences we never thought possible. Get ready for a revolution. #techInnovation #futuretech #digitaltransformation #techtrends #innovativetech #aiadvancements #iotrevolution #techinsights #emergingtech #digitaldisruption #dataanalytics #robotics #techleadership #ai #innovation #tech
To view or add a comment, sign in
-
Runway just released Act-One, an AI feature that lets you transfer every grin, eyebrow raise, or side-eye into a digital avatar. Here's how it works: record yourself pulling your most expressive faces, and Act-One does the rest, mirroring your emotions in an animated character. It’s common for AI-generated videos to feel flat and a little dead-eyed—Runway’s Act-One could improve this by blending the lifelike expressions we know and love with AI's capabilities. So is this the end of Hollywood? Can we all just start making movies in our pajamas at home? #artificialintelligence #innovation #genai
To view or add a comment, sign in
-
Text-to-video models are getting seriously impressive—they can create videos that look like they were filmed with a real camera. I recently tried out Gen-3 Alpha by RunwayML and used the prompt "Close up shot of a pirate looking over the sea with worry." The result? A super realistic, cinematic clip that blew me away. AI is really changing the game in video production. Check out the video and see what Gen-3 Alpha can do! Runway amazing work guys! #AI #VideoGeneration #RunwayML #Innovation
To view or add a comment, sign in
-
This is the best AI-generated movie trailer I have personally done! I am happy to share my latest AI trailer, "BloodSpace," based on a feature film I am currently developing. Make sure you watch til the end! I had to sneak in at least one shot with Runway's new last-frame tool. That's the power of these AI films; you can edit them up to release within minutes. I used many AI tools to bring this vision to life, and I can geek out in the notes if anyone is interested. A few top of mind were Runway Gen 3, Midjourney 6.1, Kling, and Luma AI Dream Machine. I wanted vampires on the moon, and dammit, I got my vampires on the moon! Cheers!
To view or add a comment, sign in
-
Exciting new AI capabilities - video-to-video transformation! Nearly twenty years ago, we filmed a feature-length comedy "Gorilla: An Ape's Tale". We used a small camera with MiniDV tapes – I probably still have them stored somewhere. Recently, Runway, an AI video generation tool, released a new version of their video-to-video feature. You input 5-10 seconds of video, specify the style you want it transformed into via a prompt, and within minutes, you have the result. I decided to test it on an action scene where one of the characters faces off against their father in a lightsaber (and pitchfork) duel. (Back in the days, I rotoscoped this frame by frame over the course of a week) The first prompt was just "Cinematic star wars fight with lightsabers." The prompt for the second video was "Cinematic star wars movie fight with lightsabers inside a spaceship." The result is mixed, but the trajectory of development is clear. Imagine what could be done if this technology were five times better. Or ten times. Or a hundred times. Because one day, it will be. And it won't take long to get there. #generativeAI #generativevideo #artificialintelligence
To view or add a comment, sign in
-
Runway is AI video generator from image. It is compatible with images in input and generate video as ouput. As example you can add a camera movement effect for one of your image You can generate images with another AI like MidJourney.
Create Cinematic AI Videos with Runway Gen-3
https://www.youtube.com/
To view or add a comment, sign in
-
You'll encounter many #genai experts more experienced than myself on the network, but I like to have fun too. I've compiled a comparison using the same prompt across Runway gen3, Luma AI, and Leonardo.Ai. I'm particularly interested in action sequences rather than scenery and close-up captures, which I feel are often overlooked online. This is a one-time competition, and I've chosen the initial result from each platform. While #Runway often excels in scenery and close-ups, I find it falls short compared to the others in both image quality and how it handles physics. #LumaAI is impressive; but not flawless, it satisfactory results in context. In my opinion, the standout performer is #LeonardoAI, which surprisingly receives less attention online despite its impressive motion capabilities. Two details to consider: * For Runway, I used the 10 seconds default duration, I should have made it shorter, but I didn't notice. * Leonardo starts from an image generated by Leonardo. It might gives it a small advantage, although I got better results when using no image, in Luma. https://lnkd.in/ef9eaHa9 #video #genai #fun #movies
Comparing: Runway gen-3 vs. Luma AI vs. Leonardo AI - Two different action scenes
https://www.youtube.com/
To view or add a comment, sign in
-
Happy Monday! As someone who has a background in both engineering and film, I am convinced AI is going to be a huge asset for creative storytelling. I have been working diligently to push this new AI toolset to its limits. I'm excited to share a proof-of-concept video I created that demonstrates the incredible potential of AI in movie production. Inspired by Star Wars, I used AI to generate photorealistic cinematic elements, crafting the illusion of a brand-new Star Wars film. What sets this project apart is that AI video generators are now making it possible to produce movie-quality cinematic visuals that are nearly indistinguishable from live-action footage shot on set with actors in costume. The level of detail, realism, and dynamic creativity achievable through AI tools has reached new heights, and this video is just the beginning. In addition, every voice and piece of music in the video was created using AI. I successfully recreated the voices of iconic characters like The Mandalorian, Obi Wan Kenobi, and Darth Vader. 🎬 This video showcases how, in the very near future, AI will make it possible to produce films that rival Hollywood-level productions—but at a fraction of the cost. The true power of AI lies in how it can empower storytellers with big ideas but limited resources, providing them with cutting-edge tools to bring their visions to life. The possibilities are endless. I can't wait to see how this technology will reshape the creative landscape! #AI #Filmmaking #StarWars #Innovation #FutureOfStorytelling #ArtificialIntelligence #CinematicAI You can see the video here on my YouTube Channel: https://lnkd.in/gYDj_nxz (Please consider subscribing, as I will be doing more AI experiments in the future.)
Star Wars AI Test Film
https://www.youtube.com/
To view or add a comment, sign in
-
In this short audio field note I explore some of the challenges as well as some of the potential ways to create win-win scenarios with the use of AI in the motion picture industry and for filmmaking in general. This includes the formation of AI and creative team partnerships that could leverage AI-Human creative symbiosis and the exponential potentials of this approach based on my current lived inquiry research into AI.
AI and the Film Industry
markallankaplan.substack.com
To view or add a comment, sign in