Speaking devices on MSP430 for visually impaired

Hardware incubation. See also our in development projects wiki.

Speaking devices on MSP430 for visually impaired

Postby t0mpr1c3 » Thu Sep 20, 2012 9:43 am

I was really taken with SimpleAVR's port of the webbot speech synthesizer to the MSP4302553:
http://www.43oh.com/forum/viewtopic.php ... 547&p16369

The sound quality is fairly ropey but the there must be plenty of applications for embedding a talking microcontroller, especially for the recently visually impaired.

Yes a speaking word clock, weather station, newsreel, all that sort of stuff that hackers are already doing, but are there also new applications that can be specifically targeted at the visually impaired? I am thinking in particular of old people who may have recently lost their sight due to age related macular degeneration etc.
Magic Smoke projects
User avatar
t0mpr1c3
Jr. Member
Jr. Member
 
Posts: 98
Joined: Mon Sep 17, 2012 4:51 am

Re: Speaking devices on MSP430 for visually impaired

Postby t0mpr1c3 » Mon Nov 05, 2012 10:00 am

How about a talking calculator? Could be easily prototyped with something like Teensy + USB keypad.
Last edited by t0mpr1c3 on Mon Nov 05, 2012 10:50 am, edited 1 time in total.
Magic Smoke projects
User avatar
t0mpr1c3
Jr. Member
Jr. Member
 
Posts: 98
Joined: Mon Sep 17, 2012 4:51 am

Re: Speaking devices on MSP430 for visually impaired

Postby matseng » Mon Nov 05, 2012 10:07 am

I must say that it sounded like crap - at least compared to this http://syntensity.com/static/espeak.html javascript (converted from C++ code) speech synthesizer that runs in the browser.

I wonder how much "oomph" you really need to do this kind of processing - would a 32 bit PIC/AVR be enough? I think I have to try some day.
User avatar
matseng
Hero Member
Hero Member
 
Posts: 660
Joined: Sat Oct 15, 2011 12:29 pm
Location: Kuala Lumpur, Malaysia

Re: Speaking devices on MSP430 for visually impaired

Postby t0mpr1c3 » Mon Nov 05, 2012 10:53 am

Point taken. I think it actually sounds worse than the SP0256. I would think it is mostly a question of storing sufficiently high resolution speech samples. The webbot lib fits in 6K so there is plenty of room for improvement. Thanks for sharing the link to the other speech synth software, perhaps I should look around a bit more to see if there is something better that can easily be ported.
Last edited by t0mpr1c3 on Mon Nov 05, 2012 11:05 am, edited 1 time in total.
Magic Smoke projects
User avatar
t0mpr1c3
Jr. Member
Jr. Member
 
Posts: 98
Joined: Mon Sep 17, 2012 4:51 am

Re: Speaking devices on MSP430 for visually impaired

Postby matseng » Mon Nov 05, 2012 11:02 am

It seems like eSpeak doesn't have any speech samples. The project page at SourceForge says:

eSpeak uses a "formant synthesis" method. This allows many languages to be provided in a small size. The speech is clear, and can be used at high speeds, but is not as natural or smooth as larger synthesizers which are based on human speech recordings.

But looking at the javascript source there's still a plenty of tables with a lot of data.... http://syntensity.com/static/speakGenerator.js
User avatar
matseng
Hero Member
Hero Member
 
Posts: 660
Joined: Sat Oct 15, 2011 12:29 pm
Location: Kuala Lumpur, Malaysia

Re: Speaking devices on MSP430 for visually impaired

Postby t0mpr1c3 » Mon Nov 05, 2012 11:09 am

Worth a look. It sounds fine to me.

There's also Flite which is written in C and has been used on linux ARM7 architectures: http://www.speech.cs.cmu.edu/flite/

Maybe its all moot since you can get electronic calculators on ebay for $9.
Magic Smoke projects
User avatar
t0mpr1c3
Jr. Member
Jr. Member
 
Posts: 98
Joined: Mon Sep 17, 2012 4:51 am

Re: Speaking devices on MSP430 for visually impaired

Postby t0mpr1c3 » Tue Nov 06, 2012 10:43 am

iTead have very kindly offered to send me a 4x4 keypad Arduino shield to help develop this project. Thanks Wendy and everyone at @iteadstudio! :-D
Magic Smoke projects
User avatar
t0mpr1c3
Jr. Member
Jr. Member
 
Posts: 98
Joined: Mon Sep 17, 2012 4:51 am

Re: Speaking devices on MSP430 for visually impaired

Postby t0mpr1c3 » Wed Nov 07, 2012 2:11 am

I got the webbotlib speech library going on an Arduino just now. The speech is quality is indeed terrible, but I'll go with it for now. Once I have a prototype up I can try something else. Possibly real speech samples rather than phonemes.

A brief survey of youtube tells me that all talking calculators simply blurt out the digits. It might be nice to hear proper number strings like "four thousand two hundred forty one" rather than 4-2-4-1. Any opinions on that?

I have also found various implementations of the shunting yard algorithm for doing the calculations. Only fancy graphical calculators actually use this algorithm, but I'll go with it for now. It will be easy enough to dumb it down later to mimic cheap calculators.
Magic Smoke projects
User avatar
t0mpr1c3
Jr. Member
Jr. Member
 
Posts: 98
Joined: Mon Sep 17, 2012 4:51 am

Re: Speaking devices on MSP430 for visually impaired

Postby matseng » Wed Nov 07, 2012 2:16 am

t0mpr1c3 wrote:There's also Flite which is written in C and has been used on linux ARM7 architectures: http://www.speech.cs.cmu.edu/flite/


Yea, the speech from the Flite engine is definitely sounding good as well. http://www.youtube.com/watch?v=cXnHje8tv6g
User avatar
matseng
Hero Member
Hero Member
 
Posts: 660
Joined: Sat Oct 15, 2011 12:29 pm
Location: Kuala Lumpur, Malaysia

Re: Speaking devices on MSP430 for visually impaired

Postby t0mpr1c3 » Wed Nov 07, 2012 7:52 am

Yes. Flite on Raspi certainly would be a possibility. I'm looking into whether Flite could run on a Stellaris Launchpad.

Once I've got the Arduino prototype up and running I'll put up a video in a new project thread. I've got a full featured scientific calculator going over UART, just need to integrate it with the speech and format the output properly (sprintf useless in Arduino IDE.)
Magic Smoke projects
User avatar
t0mpr1c3
Jr. Member
Jr. Member
 
Posts: 98
Joined: Mon Sep 17, 2012 4:51 am

Re: Speaking devices on MSP430 for visually impaired

Postby t0mpr1c3 » Fri Nov 09, 2012 3:20 pm

Just had a quick look at what scientific calculators are available for the partially sighted, and they are in the $250+ range compared to $!0-$20 for cheapies. That's quite a price gap. I had no idea. I don't like the idea of partially sighted high school students sharing calculators.

http://www.tsbvi.edu/technology-math/23 ... t-research
Magic Smoke projects
User avatar
t0mpr1c3
Jr. Member
Jr. Member
 
Posts: 98
Joined: Mon Sep 17, 2012 4:51 am

Re: Speaking devices on MSP430 for visually impaired

Postby t0mpr1c3 » Sat Nov 10, 2012 11:41 am

Well, I now have an Arduino croaking out arithmetic like an asthmatic dalek. Now I'm looking at moving it over to 64 bit floating point arithmetic. Fortunately some Germans have done the heavy lifting.

I'll continue developing the project on a new thread.
Magic Smoke projects
User avatar
t0mpr1c3
Jr. Member
Jr. Member
 
Posts: 98
Joined: Mon Sep 17, 2012 4:51 am

Re: Speaking devices on MSP430 for visually impaired

Postby t0mpr1c3 » Fri Nov 16, 2012 12:13 pm

Talking thermometer?
Shouting alarm clock?
Magic Smoke projects
User avatar
t0mpr1c3
Jr. Member
Jr. Member
 
Posts: 98
Joined: Mon Sep 17, 2012 4:51 am


Return to Project development, ideas, and suggestions