University of Southern CaliforniaUSC
USC ICT TwitterUSC ICT FacebookUSC ICT YouTube

SmartBody On-Line retargeting for Kinect | General SmartBody Discussion | Forum

Avatar

Please consider registering
guest

sp_LogInOut Log In sp_Registration Register

Register | Lost password?
Advanced Search

— Forum Scope —




— Match —





— Forum Options —





Minimum search word length is 3 characters - maximum search word length is 84 characters

sp_Feed Topic RSS sp_TopicIcon
SmartBody On-Line retargeting for Kinect
February 22, 2013
11:01 pm
Avatar
Admin
Forum Posts: 52
Member Since:
August 8, 2012
sp_UserOfflineSmall Offline

Hi All,

We have successfully integrated Kinect and the on-line retargeting feature in SmartBody. This is similar to the Avateering example in Microsoft Kinect SDK which let you transfer the kinect captured skeleton to another character. However, the Avateering example only works for the specific example character, and does not work on other user provided characters.

With SmartBody's on-line retargeting capability, it can generalize to other characters. This means the system can convert the kinect data and apply them on-the-fly to multiple different characters.

Here is a demo video showing some results :
http://smartbody.ict.usc.edu/H.....apture.mp4

Note that these characters may have different rest poses ( T-pose or A-pose ), different sizes, and the joints' local frames could also be different. SmartBody on-line retargeting method is able to infer these difference and make appropriate adjustments for each character. So they all behave the same way after retargeting.

We are doing some more testing now and this new feature should be in the coming update.
Andrew

April 23, 2013
5:56 pm
Avatar
James
Guest
Guests

Has this feature been released?

April 23, 2013
6:00 pm
Avatar
Admin
Forum Posts: 983
Member Since:
December 1, 2011
sp_UserOfflineSmall Offline

Yes, the code is in the repository.

 

Ari

 

 

 

April 23, 2013
6:13 pm
Avatar
James
Guest
Guests

Im sorry,

Can you be more specific? For the life of me I cannot find it.

Thank you so much,

James

April 23, 2013
6:31 pm
Avatar
Admin
Forum Posts: 52
Member Since:
August 8, 2012
sp_UserOfflineSmall Offline

Hi James,

 

The Kinect Viewer can be found at :

($SmartBodyDir)/lib/SBKinectViewer/

You need to first install Microsoft Kinect SDK to build and run it. 

 

To test it, you can run both the example script "KinectDemo.py" in /data/examples/ and SBKinectViewer together. Then you can use Kinect to drive the character created from the KinectDemo.py.

 

Let me know if there are any questions. 

Andrew

February 27, 2014
10:46 pm
Avatar
Member
Members
Forum Posts: 7
Member Since:
February 19, 2014
sp_UserOfflineSmall Offline

Hi

I have trouble to find the SBKinectViewer. Can someone tell me where the SBKinectViewer located? I've looked everywhere but cannot find it(did a SBKinectViewer search on Mac).  I have the SmartBody versionSDK-r5418-osx.dmg

Thank you in advance

February 28, 2014
10:16 pm
Avatar
Admin
Forum Posts: 983
Member Since:
December 1, 2011
sp_UserOfflineSmall Offline

It's in the source distribution in trunk/lib, but not in the SDK that you downloaded, so you'll have to use SVN to get the source from:

 

sourceforge.net/projects/smartbody

March 2, 2014
11:38 pm
Avatar
Member
Members
Forum Posts: 7
Member Since:
February 19, 2014
sp_UserOfflineSmall Offline

Thank You! got it