Snapchat has unveiled its forthcoming in-device AI model, which leverages augmented reality (AR) to alter the user's surroundings based on text prompts.
According to the demonstration video, this AI model can transform the user's attire and background scenes in real-time according to prompts like "1950s sci-fi movie." In the coming months, users will be able to experience AR lens effects created with this new model. By the end of the year, creators will also be able to use this model to design custom effects for lenses.
Source: Snapchat
In addition to this groundbreaking AI model, Snapchat has introduced a new suite of AI tools that make it easier for lens creators to produce custom AR effects. The latest update to Lens Studio includes new facial effect tools, allowing creators to personalize changes to the user's face through text prompts or image uploads.
The "Immersive ML" feature can even transform the face, body, and environment in real-time with realistic effects. Creators can also use AI to generate 3D assets, create masks and textures, and craft 3D character heads that mimic the user's facial expressions based on text or images.
These AI innovations provide Snapchat creators with unlimited flexibility, enabling the creation of AR lens effects beyond the constraints of existing presets and allowing for imaginative and immersive virtual experiences based on text or images.
Over the past year, Snapchat has rolled out several new AI features, such as AI-generated snapshots and ChatGPT-powered chatbots. This latest update further demonstrates the company's innovative prowess in consumer-grade AI and AR.