Meta is bringing AI video tricks to Instagram, allowing users to change their video using text and just an image—from adding bangling to cropping and pretty much anything else you can imagine.
“I'm extremely excited about Movie Gen, as our early AI research model allows you to change any aspect of your video with a simple text message,” Instagram head Adam Mosseri said in a video announcement.
In the video, Moseri starts with his clothes and the place – a gray jacket and a formal-looking bedroom – and the scenery begins to change randomly, showing Paris, New York and a pool, and he changes his clothes into different things while in the Himalayas, such as a leather jacket or a sweater.
“You have to be able to change your clothes or change the context you're sitting in or add chains.”
Meta announced the Film Gen a few months ago, which surpassed the output of other models in terms of quality and speed for some generations. The company also showcased some AI-generated Instagram reels created by social media influencers like Peggy Piskin and social media brand 10pm Curfew's Girls and K5sh accounts.
Beyond generating video, Movie Gen handles video manipulation—changing certain elements in a video while leaving all other elements intact. This makes the model extremely versatile and gives users the ability to perform many different visual manipulations – from changing a person's clothing to changing the background and even using general styling to turn people into puppet-like cartoon versions of a scene.
The technology appears to build on the Gen AI model of last year's Meta Movie Decryption. It's the company's answer to similar tools from its competitors, such as OpenAI's recently announced Sora video generator, Ruway's Inject feature, and some open source tools like Propenter.
For Instagram, this is the first time Meta has brought video AI capabilities directly to users. Movie Gen can create entirely new 16-second videos or edit existing ones, complete with synchronized sound effects and music.
The generative video scene has been on a roll lately, with significant developments announced over the last few months after a somewhat quiet year.
Sora was finally out, but there were plenty of interesting alternatives—like Invideo V3 (which can generate entire scripts, scenes, and 10-minute long videos from a single idea), Dream Machine (which can generate consistent and realistic videos even in realistic situations), Google's Veo2 (very (which can generate highly realistic videos with quick tracking) and Showrunner (which can create small cartoon sketches).
Meta hasn't announced a specific opening date, but Mosseri says it's coming in 2024.
Edited by Andrew Hayward.
Generally intelligent newspaper
A weekly AI journey narrated by a generative AI model.
