Six months after OpenAI launched Sora, a groundbreaking tool for generating videos from text prompts, Meta has introduced Movie Gen. This new software allows users to create realistic videos and professional-sounding audio using simple text inputs. In this article, we will discuss everything about the latest Meta Movie Gen 

Meta Movie Gen Overview

Features

Movie Gen is powered by a 30-billion parameter AI model, capable of generating 16-second HD videos from text prompts. The AI has been pre-trained on a large dataset of one billion images and 100 million videos, carefully selected to improve quality. In addition, users can input a photograph along with a scene description, enabling the AI to create a video of an animated actor and environment based on the provided information. The tool offers a range of camera movements and angles, including wide shots, tilts, and pans, allowing users to simulate virtual camera setups similar to real-world shots.

Sound Effects and Music with Movie Gen Audio

 In addition to video generation, Meta has introduced Movie Gen Audio, a 13-billion parameter AI model for generating sound effects and music. The model is pre-trained on one million hours of audio, producing 48 kHz sound effects and music based on text prompts. While Movie Gen Audio can generate several minutes of music, video clips are limited to 16 seconds due to computational demands.

• Also, read
  • The AI on Ray-Ban Meta is getting even better!
  • Meta announces its first-ever Orion AR glasses with holographic display
  • Meta Quest 3S — Just as capable as Quest 3, but cheaper!

This AI can create realistic on-screen and off-screen sounds, such as footsteps and background music, that align with on-screen action and support the scene's emotional tone.

Meta Movie Gen Availability

Meta researchers tested Movie Gen against other leading generative AI tools, including OpenAI's Sora. However, Meta is still working on adding safety measures before releasing the tool to the public.

• Meanwhile, check out our review of the S24 FE