Anything in Any Scene
A video generation framework for inserting real-world objects into videos in any scene, prioritizing physical realism.
CommonProductVideoVideo GenerationObject Insertion
Anything in Any Scene is a general-purpose framework for seamlessly inserting any object into existing dynamic videos, with an emphasis on physical realism. The framework comprises three key processes: 1) Combining real objects with the given scene video, ensuring geometric accuracy; 2) Estimating the sky and environment lighting distribution to simulate realistic shadows and enhance lighting realism; 3) Employing a style transfer network to improve the realism of the final video output. This framework generates synthetic videos with high geometric, lighting, and visual realism.