Meta, the parent company of Facebook, announced on Friday the development of Movie Gen, a groundbreaking artificial intelligence model capable of generating realistic video and audio clips in response to user prompts. This innovative technology positions Meta alongside leading media generation startups such as OpenAI and ElevenLabs.
Samples provided by Meta demonstrate Movie Gen‘s ability to create vivid videos, including scenes of animals swimming and surfing, as well as dynamic clips featuring people engaged in activities like painting on a canvas. The AI model not only generates video content but also produces synchronized background music and sound effects, enhancing the overall immersive experience.
According to Meta, Movie Gen can produce videos up to 16 seconds long and audio clips lasting up to 45 seconds. In blind tests, the AI model reportedly performed favorably compared to offerings from competitors like Runway, OpenAI, ElevenLabs, and Kling.
The introduction of Movie Gen arrives at a pivotal moment as the entertainment industry explores the integration of generative AI video technologies. Earlier this year, OpenAI, backed by Microsoft, showcased Sora, a product capable of creating feature film-like videos from text prompts. While technologists are eager to leverage such tools to enhance and streamline filmmaking processes, concerns persist regarding the potential misuse of AI systems trained on copyrighted material without consent.
Global lawmakers have expressed apprehension about the rise of AI-generated deepfakes, particularly their influence on elections in countries such as the United States, Pakistan, India, and Indonesia. The ethical implications of artificially created content remain a topic of intense debate.
Meta’s representatives indicated that, unlike its Llama series of large-language models, Movie Gen is unlikely to be released for open use by developers due to the company’s careful assessment of risks associated with each model. Instead, Meta is collaborating directly with the entertainment community and content creators to develop applications for Movie Gen, with plans to integrate the technology into its own products in the coming year.
The development of Movie Gen utilized a combination of licensed and publicly available datasets, as detailed in Meta’s recent blog post and research paper. This strategic approach underscores Meta’s commitment to responsible AI innovation.
As the race to harness AI in filmmaking intensifies, other industry players are also making moves. OpenAI has engaged in discussions with Hollywood executives regarding potential partnerships involving Sora, although no official agreements have been announced. In a related development, Lionsgate Entertainment, the company behind “The Hunger Games” and “Twilight“, granted AI startup Runway access to its film and television library to train an AI model, aiming to empower filmmakers with advanced tools to augment their work.
Reference(s):
cgtn.com
