Facebook owner Meta on Friday unveiled a new artificial intelligence model called Movie Gen that can produce realistic-looking videos using only text prompts. Meta’s announcement comes nearly six months after OpenAI took the AI industry by storm by introducing its text-to-video generator, Sora.
Movie Gen can also generate background music and sound effects that sync with the video content. The AI tool can generate up to 16 seconds of video (at 16 frames per second) in various aspect ratios and up to 45 seconds of audio.
The company also shared data from several blind tests in which Movie Gen outperformed its other competitors in the segment, such as Fugitive generation 3, Sora from OpenAI and Kling 1.5.
Movie Gen can also create personalized videos using an image or video of a person to create a video that shows that person in “rich visual detail” while preserving human identity and movement. Goal says that Movie Gen can also be used to edit existing videos by adding different transitions or effects. In a video shared on Meta’s blog post, Movie Gen was able to add clothing to the animals, change the video background, change the style of the video, and add elements that weren’t there before.
Chris Cox, Chief Product Officer at Meta, while sharing updates on Movie Gen in a post on Threads, wrote: “Today we are sharing our progress on Movie Gen, our project to develop the latest in AI video generation. As of today, our evaluations show that it is an industry leader in text-to-video quality across a number of dimensions, with 16 seconds of continuous duration, as well as a breakthrough in the state of the art in audio-to-video adaptation. , precise editing and character. coherence / personalization”
Cox also confirmed that Movie Gen is not yet ready to be released to the public because the model is “still expensive and the generation time is too long.”
Disclaimer:
The information contained in this post is for general information purposes only. We make no representations or warranties of any kind, express or implied, about the completeness, accuracy, reliability, suitability or availability with respect to the website or the information, products, services, or related graphics contained on the post for any purpose.
We respect the intellectual property rights of content creators. If you are the owner of any material featured on our website and have concerns about its use, please contact us. We are committed to addressing any copyright issues promptly and will remove any material within 2 days of receiving a request from the rightful owner.