Meta Unveils Movie Gen: AI-Powered Video Generator

Meta has introduced a new AI-driven video generator called Movie Gen, capable of producing high-definition videos complete with sound, as reported by the company. This announcement follows OpenAI’s earlier unveiling of their text-to-video model, Sora, though Movie Gen is not yet available for public use.

Movie Gen utilizes text inputs to automatically generate new videos and edit existing footage or still images. According to The New York Times, the AI-generated audio adds ambient noise, sound effects, and background music that align with the visual content. The generated videos can be created in various aspect ratios.

Beyond creating new clips, Meta indicates that Movie Gen can also generate custom videos from images or alter elements within an existing video. As an example, the company showcased a still headshot of a woman transformed into a video scene of her sitting in a pumpkin patch sipping a drink.

The tool can further modify existing footage by altering styles, transitions, or inserting new elements. One demonstration included an illustrated runner updated with text prompts to show him holding pompoms, standing in a desert background, or wearing a dinosaur costume.

In the broader landscape of AI advancements, nearly two years since AI-driven image and video generators became mainstream, significant progress continues. Within the past six months, major technology companies like Google, along with smaller startups, are also developing similar tools. Notably, OpenAI’s Sora, announced earlier this year, has not yet been publicly launched. Recently, a co-lead on the Sora project transitioned from OpenAI to Google.

Commenting on Threads, Meta’s chief product officer, Chris Cox, stated that the company is not ready to release Movie Gen as a product due to its high costs and lengthy generation times.

Concerns among creatives, such as filmmakers, photographers, artists, writers, and actors, have risen regarding the impact of AI generators on their professions. AI technology has been a significant factor in strikes, such as last year’s historic joint strike by the Screen Actors Guild – American Federation of Television and Radio Artists (SAG-AFTRA) and the Writers Guild of America (WGA).

Source link