Hi !  is it possible to add option to use mouthcontrol with audiofile ( as a parameter like playfile(string,Mouthcontrol(0/1) ) ?

Usefull to lauch something like this : https://github.com/MyRobotLab/pyrobotlab/tree/master/home/hairygael/MP3

So no need to replace TTS mp3. And it can worky if we use MaryTTS.

Thank a lot

GroG

7 years 2 months ago

You should have access to AudioFile directly ?

if not you can get access ..

audioFile = Runtime.getService({audioFileName});

audioFile.playFile({filename})

Or did I misunderstand your question moz4r ?

 

Gael want the jaw move while c3po speaking :) . c3po is a custom mp3.
So usualy, he replace a cached natural mp3 by a custom mp3.
It is a little hack of natural.

I was thinking of something cleaner and universal : activate mouthcontrol with audiofile ( as an option ).

OnStartPlayin > mouthcontrolstart
OnStopPlayin > mouthcontrolstop

 

 

GroG

7 years 2 months ago

The cleanest way (and long overdue) - it to use DigitalSignalProcessing listen to the speaker line and generate events which MouthControl consumes.

For clarity you want a substitution of mp3 for text..

such that when :

mouth.onSpeakPlay("say 3cpo", "cp30.mp3);

so next time ...

mouth.speak("say 3cpo")  .. the mp3 file is played ?

mmm I like mouth.onSpeakPlay("say 3cpo", "cp30.mp3) !
This can worky too with marytts ? because mary don't use audiofile

About DigitalSignalProcessing I totaly agree, personaly I use it from long time but with arduino code.
Time to test it with mrlcomm !
I think I can simply use a dynamical map to jaw. like today. just an idea.
After calibration.

At second time we need to standardize the audio signal don't you think ? because of differents levels of output lines.
And if we need hardware like https://www.adafruit.com/product/987 : , better if a service java side service drive it.
A post will born soon I think !

@dom I will open a new post about arround audio signal processing and hardware amplifier inside mrlcomm. To talk about.
It will be great if you add your knowledges to it !