The Tongyi App has recently introduced an innovative role-playing feature that allows users to easily replace characters in videos with a single click. This functionality is made possible by the Motionshop model launched by the Alibaba Tongyi Lab earlier this year, which has garnered significant attention from creators worldwide since its release.
Currently, Motionshop has been productized and integrated into the Tongyi App, available for free to all users, thereby expanding the possibilities for innovation in video creation and animation production. To further enrich the user's creative experience, the Tongyi App plans to introduce a custom character feature in September.
Motionshop is an AI model developed by the Tongyi Lab, belonging to the popular AIGC (AI-Generated Content) field. The model integrates various advanced technologies such as video processing, character tracking/segmentation, pose estimation, and path tracing rendering, allowing users to easily achieve the transformation between reality and virtuality in dynamic videos.
Before the advent of Motionshop, traditional character replacement effects primarily relied on path tracing rendering technology, which, although realistic, was less efficient. If traditional real-time rasterization schemes that sacrifice rendering quality were used, performance would be improved, but rendering quality would be significantly compromised.