BakedAvatar
A neural network method for generating real-time 4D avatars from single-eye video recording
CommonProductImageAvatar SynthesisNeural Network
BakedAvatar is a novel representation for real-time neural avatar synthesis, deployable in a standard polygonal rasterization pipeline. The method extracts deformable multi-layer meshes from learned head iso-surfaces and computes appearance variations related to expression, pose, and viewpoint that can be baked into static textures, enabling real-time 4D avatar synthesis. We propose a three-stage neural avatar synthesis pipeline, including learning continuous deformation, manifold, and radiance fields, extracting layered meshes and textures, and refining texture details via differential rasterization. Experiments demonstrate that our representation achieves comparable results to other state-of-the-art methods while significantly reducing inference time. We further showcase diverse avatar synthesis results generated from single-eye video, including view synthesis, facial re-enactment, expression editing, and pose editing, all at interactive frame rates.