lab book beti lula john. speech recognition robot problem and mission civilization’s great steps...
TRANSCRIPT
Lab BookBeti Lula John
Speech Recognition Robot
Problem and Mission
Civilization’s Great Steps Forward:1) Fire2) The Wheel3) The Printing Press4) The Steam Engine5) The Transistor6) Google7) ???
www.build-it-yourself.com
Speech Recognition Robot
Problem and Mission
Robots Will Rule!!!
However to make this next great leap forward, we need to make the interface between humans and machines more natural.
www.build-it-yourself.com
Speech Recognition Robot
Project Plan
Goal:Design, build and present a speech recognition robot that is worthy of media attention.
1) It must work.2) It must be engaging.
Deliverables:1) Power Point Lab book2) Working robot3) Presentation
www.build-it-yourself.com
Speech Recognition Robot
Project Plan
Tasks:1) Research2) Identify problem3) Specify solution functionality4) Build5) Test and modify6) Manage and document7) Market and present
www.build-it-yourself.com
Speech Recognition Robot
Teamwork
Assign specific tasks to focused specialists:
Marketing Engineering Programming-Market Demand - Technologies - Technologies- Competition - Inputs / Outputs - Inputs / Outputs- Sales Pitch - Specifications - Specifications- Project Mgm’t - Build - Program- Present - Test & Refine - Test & Refine
www.build-it-yourself.com
Speech Recognition Robot
Performance
www.build-it-yourself.com
Name 1 Name 2 Name 3Attendance 5 3 2Professionalism 5 3 2Teamwork 4 1 1Initiative 3 1 1Results 5 3 2Total 22 11 8
Attendance - Are you present?Professionalism - Are you respectful of your lab and your teammates?Teamwork - Did you help your teammates or participate in discussions? Initiative - Did you do something more than was expected?Results - Did you get a result?
Yes = 1 No = 0
Speech Recognition Robot
Project Management – 4 Phases
1) Discovery Research applications Research technology
2) Design Specify a talking robot
3) Development Build a talking robot
4) Deployment Document project Present project
www.build-it-yourself.com
Speech Recognition Robot
Speech Recognition Applications
Document useful applications of speech recognition robots.
1) Aviation2) Healthcare3) Administration4) Personal computers5) Production6) ???
www.build-it-yourself.com
Speech Recognition Robot
Robots … What are they good for?
Document what robots do better than humans.
Document what humans do better than robots.
www.build-it-yourself.com
Speech Recognition Robot
Problem and Mission
Document a problem that could be solved by a speech recognition robot.
Document the mission. (What must our speech recognition robot do to solve the problem?)
www.build-it-yourself.com
Speech Recognition Robot
Problem Solving Techniques
1) Identify the problem and focus.2) Build on the ideas of others.3) Break the solution into simple parts.4) Work with teammates.5) Document.
www.build-it-yourself.com
Speech Recognition Robot
Measures of Success
1) Does it work 9 times out of 10?2) Is it unique?3) Will it attract media attention?
www.build-it-yourself.com
Speech Recognition Robot
Program Primitives
1) Series vs. Parallel2) Iteration3) Conditional4) Variables5) Messaging
www.build-it-yourself.com
Speech Recognition Robot
Strategies for recognizing speech
What are 3 attributes of speech that can be detected and interpreted?
www.build-it-yourself.com
Speech Recognition Robot
Program Flow Chart to Detect Syllables
www.build-it-yourself.com
Start
Wait forsyllable
Wait
2nd syllabledetected
?
Display2 syllables
Display1 syllable
YesNo
start
Speech Recognition Robot
www.build-it-yourself.com
Start
Wait forsyllable
Volumelow?
Yes
No
start
Volumehigh
?
Yes
No
End
Program Flow Chart to Detect Syllables
Speech Recognition Robot
Tasks
www.build-it-yourself.com
Marketing:1) Develop an elevator pitch for your robot. Research what an elevator pitch is.2) Design a one page advertisement for your robot.3) Design signs that explain how your robot works.4) Build expressive eyes, mouth, arms, and body.5) Write and record the script you want your robot to lead (man - machine interaction)
Engineering:1) Build the structure.2) Build a gear train that drives two shafts.3) Build a mechanism that makes eyes, mouth and arms move.
Programming:1) Write a program to execute the script or man - machine interaction.
Document everything in your lab books.
Speech Recognition Robot
Robot / Human Script
www.build-it-yourself.com
When visitor is detected, say:Greetings! My name is ...
Welcome to Colegio Las Hayas.
While you are waiting, would you like to ...
Please answer, "Si" or "Huh, Huh" to my question.
If "Si" then say:
If "Huh, Huh" then say:
Speech Recognition Robot
Structure and components
www.build-it-yourself.com
Engineering:This structure is good for mounting motion modules and sensors at different levels.
The vertical shaft could make arms move left and right.
www.build-it-yourself.com
Robot Structure:Click on ‘Build-It-Blocks’Select ‘Presenting Ideas’Select ‘LEGO Tall Structure
Gear Train:Click on ‘Build-It-Blocks’Select ‘Spin, Rotate, Twirl’Select ‘Power Top Gear Train Mini”
Speech Recognition Robot
Structure and components
www.build-it-yourself.com
Engineering:The ‘Open ‘n Close’ module can drive many parts to move.
www.build-it-yourself.com
Robot Structure:Click on ‘Build-It-Blocks’Select ‘Shake, Dance, Flap’Select ‘Open ‘n Close’
Speech Recognition Robot
Structure and components
www.build-it-yourself.com
Engineering:The arms and the mouth move.
Speech Recognition Robot
Robots Made from Premium Quality Junk
www.build-it-yourself.com
Speech Recognition Robot
SpeechRecognitionProgram
www.build-it-yourself.com
Speech Recognition Robot
SpeechRecognitionProgram
www.build-it-yourself.com
Speech Recognition Robot
SpeechRecognitionProgram
www.build-it-yourself.com
Speech Recognition Robot
SpeechRecognitionProgram
www.build-it-yourself.com
Programming team:
Speech Recognition Robot
Robot Promo
www.build-it-yourself.com
Marketing team:
What can you say and show that will makecustomers want to buy your robot?
1) Write and perform a song that your robot will sing.2) Write and design an advertisement.3) Design a Web page or a Facebook page for your robot.
Speech Recognition Robot
References
www.build-it-yourself.com
Example of project web site http://www.build-it-yourself.com/support/support-workshops/wkshp-archive/wkshp-glts-2002/index.
Introduction to talking robots at Tokyo Universityhttp://www.youtube.com/watch?v=Li4w9DPPNYI&NR=1&feature=fvwp
Demo of MIT Kismet language vs expressionhttp://www.youtube.com/watch?v=dKZczUDGp_I
Demo of how engaging a talking robot can be.http://www.youtube.com/watch?v=HuqL74C6KI8&feature=related
Speech Recognition Robot
Project Summary
www.build-it-yourself.com
What you should know:• The problem and mission• 3 deliverables• 3 measures of success• 4 project management phases• 3 reasons for modular construction• 5 problem solving techniques• 5 program primitives• Effective use of Power Point, Google, Excel and
collaboration tools
Reference Slides Follow
Speech Recognition Robot
Presentation Outline
www.build-it-yourself.com
Project Presentation
1) Introduce team members and explain the parts of the project that were most interesting to you.2) State the problem and mission (PPT Lab Book)3) Describe the 4 phases of project planning and who did what. (PPT Lab Book) - Discovery - Design - Development - Deployment4) Present your research (PPT Lab Book)5) Present your robot.6) Grade your work on 5 measures of performance.
Questions
1) Why is modular construction valuable?2) Why is teamwork important?3) What do humans do well and what to robots do well?4) What are 5 computer programming structures?5) Describe how your program works?
Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex problems.
How many people are on the World of Warcraft team?
How many people to develop an animated feature film?
www.build-it-yourself.com
Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex problems.
How many people are on the World of Warcraft team? 60 developers / 400 employees when launched in 2001. 5000 employees in 2009.
How many people to develop an animated feature film? 75 artists using hand made frames. 27 animators made Toy Story using computer tools.
www.build-it-yourself.com
Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex problems.
How many people worked for NASA when we landed on the moon?
www.build-it-yourself.com
Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex problems.
How many people worked for NASA when we landed on the moon?36,000 NASA employees when man landed on the moon
www.build-it-yourself.com
Lab BookBeti Lula John
Can’t read from a distance. Image does not relate to content
Speech Recognition RobotLab BookBetiLula John
Average, boring, not engaging
Lab BookBeti Lula John
Direct, engaging