AnchorCrafter
A 2D video generation system based on diffusion models, achieving human-object interaction animations.
CommonProductVideoVideo GenerationHuman-Object Interaction
AnchorCrafter is an innovative diffusion model system designed to generate 2D videos that include target characters and customized objects, achieving high visual fidelity and controllable interactions through the integration of human-object interaction (HOI). The system enhances the ability to recognize object appearances from arbitrary viewpoints through HOI-appearance perception and separates the appearances of humans and objects. HOI-motion injection overcomes challenges in managing object trajectory conditions and occlusions, enabling complex human-object interactions. Furthermore, the reweighted loss for HOI areas serves as a training objective to enhance the learning of object details. This technology is significant to fields such as online commerce, advertising, and consumer engagement, maintaining the consistency of human appearance and movement while preserving the awareness of object appearance and shape.