2017년 8월 16일 수요일

Can you use Image to generate speech?


I am trying to create an application for a class project.  I am trying to come up with an app that would allow children with speech problems to click on a picture to communicate.  My son had problems with speaking and before they attempted sign language, he would cry he would get so frustrated because he would ask for things and no one could understand him.  I would like to create an app with some basic symbols for "thirsty or drink", "hungry", I want what you are holding etc....

Is it possible fo do this?

--
The easiest would to use buttons with the desired image. Upon clicking a text is spoken. Here you can find a tutorial.


--
Hi Lynn,  this is a simple application about image to voice. 

--
There are quite a few apps on the market which do that, search forr AAC (Augmentative and Alternative Communication) apps.
See for example here: http://www.asha.org/public/speech/disorders/AAC/
I have spent a lot of time creating such an app. App Inventor is nice because there is good text-to-speach avaiable, also in Dutch, which is the language I needed it for.
I used a rather old visual language called Bliss and in modern times it has become less used, although there is still active development.
Look here for more information about Bliss: http://www.blissonline.se/
And here for more information about my Bliss app: http://www.squaringthecircles.com/ai2/
I can help you to use this app in your situation, or help you to make a similar app with more modern pictures.
--

As used in our school everyday to replicate picture exchange for children with autism and learning difficulties

--
The simple layout is :
When button1 clicked -> play sound 1
When button 2 clicked -> play sound 2
The buttons might also be below the pic.
You'll need the sound component and you need to upload the sound you want which might be your own voice.
Alternatively, you can use the text to speech component.
When button1 clicked -> speak text "hungry"

--

댓글 없음:

댓글 쓰기