Home Automation with Speech Recognition

Billy Overton2012-9-19

Controlling Your DevicesGetting back to software

Common Communication Methods

RS-232 HTTP GET/POST Infrared Custom

RS-232

Pros Many devices have RS-232 control Extremely simple Has common libraries Usually well documented

Cons Uncommon Hardware No common command set

RS-232 in PowerShell

http://files.support.epson.com/pdf/plhc87u/plhc87uug.pdf

HTTP GET/POST

Pros Uses pre-existing controls systems Can be as simple as an iframe Customizable

Cons Usually less documented

Infrared

Pros Almost everything has a remote Will cover all the functions a user wants Has premade tools: (Win)LIRC▪ http://lirc.sourceforge.net/remotes/

Cons Time consuming Hardware Dependent

Custom

Pros You can do anything you want

Cons More hardware

Speech Recognition with KinectFrom voice to code

Microsoft SDKs

Kinect for Windows Microsoft Speech Platform

Kinect Setup

Kinect Setup

Kinect Setup

Speech Recognition

Speech Recognition Engines Grammars Recognition Results

Speech Recognition Engines

There are two types We’ll use

SpeechRecognitionEngine();

Grammars

Define what we are looking for Have three methods of creation

GrammarBuilder class SrgsGrammar class Srgs XML file

GrammarBuilder

Allows you to add items such as strings and Choices objects to build a grammar

Used to create a Grammar object

GrammarBuilder Example

Adding a Grammar

recognitionEngine.LoadGrammar(g)

Listening for Speech

Two Methods Synchronous▪ recognitionEngine.Recognize()▪ Returns RecognitionResult

Asynchronous▪ recognitionEngine.RecognizeAsync()▪ recognitionEngine.RecognizeAsync(mode)▪ Raises SpeechRecognized event

RecognitionResult

Contains all data regarding one grammar match.

Most notably contains: Result.Text Result.Confidence

Full Example

Questions and Contact Information

Name: Billy Overton Email : overtonb@goldmail.etsu.edu IRC: logos on irc.freenode.net

Join us in the #etsuacm channel