We have successfully integrated Kinect and the on-line retargeting feature in SmartBody. This is similar to the Avateering example in Microsoft Kinect SDK which let you transfer the kinect captured skeleton to another character. However, the Avateering example only works for the specific example character, and does not work on other user provided characters.
With SmartBody’s on-line retargeting capability, it can generalize to other characters. This means the system can convert the Kinect data and apply them on-the-fly to multiple different characters.
Here is a demo video showing some results :
http://smartbody.ict.usc.edu/HTML/videos/kinect/KinectRetargetCapture.mp4
Note that these characters may have different rest poses ( T-pose or A-pose ), different sizes, and the joints’ local frames could also be different. SmartBody on-line retargeting method is able to infer these difference and make appropriate adjustments for each character. So they all behave the same way after retargeting.
We are doing some more testing now and this new feature should be in the coming update.
Andrew
