University of Southern CaliforniaUSC
USC ICT TwitterUSC ICT FacebookUSC ICT YouTube

Android based virtual companion using voice exchange | General SmartBody Discussion | Forum

Avatar

Please consider registering
guest

sp_LogInOut Log In sp_Registration Register

Register | Lost password?
Advanced Search

— Forum Scope —




— Match —





— Forum Options —





Minimum search word length is 3 characters - maximum search word length is 84 characters

sp_Feed Topic RSS sp_TopicIcon
Android based virtual companion using voice exchange
December 10, 2014
6:25 am
Avatar
Member
Members
Forum Posts: 52
Member Since:
December 9, 2014
sp_UserOfflineSmall Offline

Hi;

I am a newbie in using SmartBody, i would like to ask how to talk with my character?My main objective is to develop a virtual companion that will allow the user to talk with an avatar just like a normal conversation.

I am looking forward for immediate response on this as i am doing my master thesis.

Thank you very much.

December 10, 2014
6:12 pm
Avatar
Admin
Forum Posts: 983
Member Since:
December 1, 2011
sp_UserOfflineSmall Offline

SmartBody's role is to generate the appearance and movement of a virtual character given some instructions (say, to speak and gesture).  So, SmartBody can provide an animated character than can speak, gesture and move according to instructions, but it does not have a 'brain' that will control the flow of conversation or understand what is spoken. For that, you would need a separate component that handles things such as:

1) understanding of the meaning and nuance of conversation,

2) keep track of the dialogue turn,

3) know when to perform 'backchannelling' (nodding your head or raising your eyebrows at particular times to indicate acknowledgement of the other speaker's ideas, etc.)

In summary, you can instruct a SmartBody character to talk using a markup language called BML (Behavioral Markup Language). So Speaking would look something like this:

<speech id="myspeech" type="text/plain">hello, I am a talking virtual human.</speech>

And the SmartBody character will talk using text-to-speech and lip sync to the words spoken. There are more examples in the SmartBody documentation.

 

Ari

December 13, 2014
6:08 am
Avatar
Member
Members
Forum Posts: 52
Member Since:
December 9, 2014
sp_UserOfflineSmall Offline

Okay i have now some clear idea. So i can used NPCEditor as my tool in conversation between a virtual human and user via Android phone. 

Thank you for your quick answer. 

December 16, 2014
12:48 am
Avatar
Admin
Forum Posts: 983
Member Since:
December 1, 2011
sp_UserOfflineSmall Offline

Yes. I don't know if there is a version of the NPC Editor that is built for Android (my team has access to one and we do use it for some of our projects, but I do not know if such component has already been distributed).

You might be interested in our latest project: we are putting together SmartBody on an Android platform that can be controlled only by scripting. The idea being that you can script the virtual character and what happens when the user touches the screen (or talks), and all you need to do is write Python code to control the behavior and responses.

 

Ari

December 19, 2014
2:01 pm
Avatar
Member
Members
Forum Posts: 52
Member Since:
December 9, 2014
sp_UserOfflineSmall Offline

Do you have a sample source code or tutorial doing this? So that i could learn how to write it.

Thank you so much.

December 27, 2014
10:47 pm
Avatar
Admin
Forum Posts: 983
Member Since:
December 1, 2011
sp_UserOfflineSmall Offline

There are some Android SmartBody examples in the SmartBody SVN.

We'll probably release our easy-to-use SmartBody Android platform in the next month or so; still working out the problems.

 

Ari

January 1, 2015
2:21 pm
Avatar
Member
Members
Forum Posts: 52
Member Since:
December 9, 2014
sp_UserOfflineSmall Offline

I need it by February, just for final defense presentation only not for commercial used. Not exactly 100% perfect application.

I am now started using SmartBody, I would like to import my asset using SBGUI application. I am having the hard time following the SmartBody manual specifically importing my  character into SmartBody GUI.

January 2, 2015
3:40 pm
Avatar
Admin
Forum Posts: 983
Member Since:
December 1, 2011
sp_UserOfflineSmall Offline

There is already an example of using a virtual character with SmartBody on Android (look in the android/ folder in the source code from SVN, there are two projects, sbjni and sbmogreapp). You could try to use those in the meantime.

Ari

Forum Timezone: America/Los_Angeles

Top Posters:

jwwalker: 80

jyambao: 52

rbaral: 47

adiaz: 30

WargnierP: 29

lucky7456969: 28

mbarros: 28

avida.matt: 26

JonathanW: 24

laguerre: 23

Member Stats:

Guest Posters: 69

Members: 122211

Moderators: 3

Admins: 4

Forum Stats:

Groups: 1

Forums: 5

Topics: 531

Posts: 2495