URAvatar: Generate Personalized Virtual Avatars by Scanning with Your Phone

AIbase基地

Published inAI News · 4 min read · Nov 11, 2024

136

With the rapid development of virtual reality and augmented reality technologies, the demand for personalized virtual avatars has become increasingly urgent. Recently, researchers have introduced a new technology called URAvatar (Universal Relightable Gaussian Coding Avatar), which allows for the effortless generation of high-fidelity virtual avatars through mobile phone scanning.

This innovative achievement not only enhances the visual appearance of virtual avatars but also enables users to drive and adjust their avatars in real-time under different lighting conditions.

The working principle of URAvatar is based on a complex light transport model, which differs from previous methods that estimated reflection parameters through inverse rendering. URAvatar employs a learnable radiance transport model, allowing for efficient real-time rendering. The challenge of this technology lies in how to effectively transfer lighting across different identities. The research team has constructed a universal relightable avatar model by training hundreds of high-quality multi-view facial scans and combining them with controllable point light sources.

In practical applications, users only need to perform a simple scan in a natural environment using their phone, and the system can reconstruct the head's pose, geometry, and reflective textures, ultimately generating a personalized relightable avatar. After fine-tuning, the user's avatar can achieve natural performance and dynamic control under different environmental lighting conditions, ensuring consistency across various lighting scenarios.

Additionally, the URAvatar technology supports independent control of the avatar's gaze direction and neck movements, enhancing the expressiveness and interactivity of virtual avatars. The release of this technology will bring new opportunities to fields such as gaming and social platforms, allowing users to engage in the virtual world in a more vivid and personalized manner.

Key Points:
🌟 URAvatar generates personalized virtual avatars through mobile phone scanning, enhancing virtual performance.
💡 The technology uses a learnable radiance transport model for real-time rendering and lighting transfer.
🎮 Users can independently control the avatar's gaze direction and neck movements, improving virtual interaction experiences.

Apple's AR Smart Glasses Are Still in Development, Expected to Take 3-5 Years to Launch

Apple's augmented reality (AR) smart glasses have long been a hot topic in the tech world. Although there has been no official news about a launch, Bloomberg's Mark Gurman recently revealed in his 'Power On' newsletter that Apple's AR glasses are still in the development phase, with at least 3 to 5 more years needed before they are officially released. While Apple's Apple Vision Pro has already debuted and shares many similarities with the potential AR glasses, its relatively bulky design has raised questions about the future of Apple's offerings.

Google and Samsung Join Forces to Shake Things Up! New Mixed Reality Headset and AI Glasses Unveiled, Targeting Apple's Vision Pro

Tech giants Google and Samsung have recently unveiled a new generation of mixed reality headsets and smart AI glasses. These devices not only feature significant hardware upgrades but also integrate deeply with Google's latest Gemini AI model, showcasing their ambitious goals in the mixed reality field. Both devices support Virtual Reality (VR) and Augmented Reality (AR) functionalities, but their biggest highlight is the deep application of AI. With Gemini's powerful computing capabilities, these devices can understand user intentions.

Disney Formed New Team to Coordinate the Use of Artificial Intelligence and Augmented Reality

The Walt Disney Company is exploring applications in its film, television, and theme park divisions and is currently forming a new team to coordinate the company's use of emerging technologies such as artificial intelligence and mixed reality. The newly established technology support office will be led by Jamie Voris, the Chief Technology Officer of Disney Studios, who was responsible for developing Disney applications for the Apple Vision Pro mixed reality device. Eddie Drake will

Apple Launches New AI Model Depth Pro: 0.3 Seconds for Ultra-Fast 3D Depth Map Generation

Recently, Apple's AI research team released a new model called Depth Pro, marking a significant breakthrough in the field of depth estimation! This model can quickly generate high-resolution 3D depth maps from a single 2D image, and astonishingly, it does not require any camera metadata, which is a rarity in previous technologies. Depth Pro works incredibly fast, generating depth maps in just 0.3 seconds. The model can create maps with outstanding clarity at 2.25MP.