TapTechNews August 7th news, on August 6th, Tongyi App launched a new function 'role-playing'. Users only need to upload a video to complete the crossover between'reality and virtual', achieving effects such as a robot 'babysitting', the Monkey King 'dancing', and a二次元 girl 'working in the office'.
TapTechNews attached operation method: Users prepare a video no longer than 15 seconds, and enter the function entrance through the sequence of 'Tongyi App>Channel>Role-playing>Start Creation'. Users can also choose videos from the official-provided video templates, and can replace up to 3 characters in the video. In terms of selectable characters, the official provides the Monkey King, a robot and two different styles of female characters for users to choose from.
It is introduced that the 'core technology' behind the 'role-playing' function is the AI model Motionshop developed by the Tongyi Laboratory. It supports the use of video processing, character tracking/segmentation, pose estimation, path tracing rendering and other technologies to make the protagonist in the dynamic video 'cross the boundary between reality and virtual'.
The official also revealed that this function is free for users, and will also support the function of users customizing the creation of characters in the near future.