The algorithm describing SmartBody’s lip syncing method will be presented at the upcoming Motion in Games conference in Dublin, Ireland in November.
You can see a video of the submission here
PTSD is commonly used in online forex trading websites where forex brokers use the technology to trade.
We have successfully integrated Kinect and the on-line retargeting feature in SmartBody. This is similar to the Avateering example in Microsoft Kinect SDK which let you transfer the kinect captured skeleton to another character. However, the Avateering example only works for the specific example character, and does not work on other user provided characters.
With SmartBody’s on-line retargeting capability, it can generalize to other characters. This means the system can convert the Kinect data and apply them on-the-fly to multiple different characters.
Here is a demo video showing some results :
http://smartbody.ict.usc.edu/HTML/videos/kinect/KinectRetargetCapture.mp4
Note that these characters may have different rest poses ( T-pose or A-pose ), different sizes, and the joints’ local frames could also be different. SmartBody on-line retargeting method is able to infer these difference and make appropriate adjustments for each character. So they all behave the same way after retargeting.
We are doing some more testing now and this new feature should be in the coming update.
Andrew
All,
We’ve added support for the native Ogre skeleton, motion and mesh formats. Examples of Ogre’s Sinbad character running in SmartBody can be found here:
Sinbad Gazing (procedural gaze control)
http://smartbody.ict.usc.edu/HTML/videos/ogre/OgreSinbadGaze.mp4
Sinbad Jump (parameterized blend obtained from mocap)
http://smartbody.ict.usc.edu/HTML/videos/ogre/OgreSinbadJump.mp4
Sinbad Locomotion (parameterized blend with steering)
http://smartbody.ict.usc.edu/HTML/videos/ogre/OgreSinbadLocomotion.mp4
Sinbad Reaching (full body IK based on mocap)
http://smartbody.ict.usc.edu/HTML/videos/ogre/OgreSinbadReach.mp4
Sinbad Crowd (multiple Sinbads)
http://smartbody.ict.usc.edu/HTML/videos/ogre/OgreSinbadCrowd2.mp4
Regards,
Ari Shapiro
Our most recent SmartBody research in automated retargetting has won the award for Best Paper at the Fifth International Conference on Motion in Games in Rennes, France.
Automated retargeting of several off-the-shelf rigged models.
The paper details how to automatically use models and skeletons in an animation system without the need to manually process them ahead of time. You can download a model from an online source, and use it immediately to move, interact with its virtual world, and perform any behaviors that SmartBody is capable of producing.
“Automating the Transfer of a Generic Set of Behaviors Onto a Virtual Character”
http://www.arishapiro.com/mig12/mig12system.pdf
A video of the results can be seen here:
http://www.arishapiro.com/mig12/RetargetSystem_Final.mp4
Regards,
Ari Shapiro
SmartBody has added a new lip syncing method that produces quality lip animation for both text-to-speech and prerecorded audio.
Our summer intern, David Huang, has put together a demo script that shows characters presenting and passing a small object between many characters.
Instructions for using this demo have been updated in the SmartBody manual describing the ‘hot-potato.py’ script.
Ari Shapiro
Characters can now point at objects, characters, or parts of characters using BML.
SmartBody now includes an automated retargeting system that allows you to adapt SmartBody animation data to new models. Here is an example of using a Mixamo (www.mixamo.com) model with SmartBody’s locomotion system:
Andrew W. Feng presented SmartBody’s reaching and grabbing system at the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games in a paper titled ‘An Example-Based Motion Synthesis Technique for Locomotion and Object Manipulation‘
Ari Shapiro presents the new SmartBody system as part of an invited talk at the Fourth International Conference on Motion in Games in Edinburgh, UK. You can download the paper Building a Character Animation System.
Orli Belman
Public Relations and Programs Manager
310-301-5006
