University of Southern CaliforniaUSC
USC ICT TwitterUSC ICT FacebookUSC ICT YouTube

Using own TTS engine for SmartBody? | General SmartBody Discussion | Forum

Avatar

Please consider registering
guest

sp_LogInOut Log In sp_Registration Register

Register | Lost password?
Advanced Search

— Forum Scope —




— Match —





— Forum Options —





Minimum search word length is 3 characters - maximum search word length is 84 characters

sp_Feed Topic RSS sp_TopicIcon
Using own TTS engine for SmartBody?
September 6, 2015
8:09 am
Avatar
Member
Members
Forum Posts: 4
Member Since:
September 6, 2015
sp_UserOfflineSmall Offline

Hi! I was wondering if it's possible to integrate another TTS engine for Smartbody. I read about the TtsRelay interface, but I'm not sure if it's possible to integrate a different engine. Any thoughts? 🙂

 

Thanks!

September 6, 2015
3:09 pm
Avatar
Admin
Forum Posts: 983
Member Since:
December 1, 2011
sp_UserOfflineSmall Offline

Yes, you could write your own TTS relay and connect to a different engine (the code for the current TTS engines is in the source code repository under TTSRelay with implementations for Microsoft Speech (SAPI), Festival and Cerevoice.

The idea is that the speech engine receives a RemoteSpeechCmd message, and returns a RemoteSpeechReply message (or a RemoteSpeechTimeout message if the utterance could not be handled).

The RemoteSpeechReply message needs to contain:

1) A location on the filesystem of the synthesized sound file.

2) A set of timings for each word

3) A set of phonemes and their respective timings (for lip sync to work, these phonemes need to be the same or need to be mapped into SmartBody's recognized phonemes)

Requirement (3) is what prevents some speech engines from working properly; if they don't return the phoneme information, you can't effectively lip sync to them (like the Google voice engine).

Ari

Forum Timezone: America/Los_Angeles

Most Users Ever Online: 733

Currently Online: jiangringgaard7, mcclain06kearney, bugge59mackinnon, williamson15mogensen, raskrask1, JosephRoper17, heavenlyliar6390
97 Guest(s)

Currently Browsing this Page:
1 Guest(s)

Top Posters:

jwwalker: 80

jyambao: 52

rbaral: 47

adiaz: 30

WargnierP: 29

lucky7456969: 28

mbarros: 28

avida.matt: 26

JonathanW: 24

laguerre: 23

Member Stats:

Guest Posters: 69

Members: 122211

Moderators: 3

Admins: 4

Forum Stats:

Groups: 1

Forums: 5

Topics: 531

Posts: 2495