universiti teknikal malaysia melakaeprints.utem.edu.my/15427/1/voice controlled wheelchair by using...

UNIVERSITI TEKNIKAL MALAYSIA MELAKA

VOICE CONTROLLED WHEELCHAIR BY USING VISUAL

BASIC

This report submitted in accordance with requirement of the Universiti Teknikal

Malaysia Melaka (UTeM) for the Bachelor’s Degree in Electronics Engineering

Technology (Industrial Electronics) (Hons.)

by

`AFIF BIN MOHD MAAROF

B071110181

900114-87-5029

FACULTY OF ENGINEERING TECHNOLOGY

2015

UNIVERSITI TEKNIKAL MALAYSIA MELAKA

BORANG PENGESAHAN STATUS LAPORAN PROJEK SARJANA MUDA

TAJUK: VOICE CONTROLLED WHEELCHAIR BY USING VISUAL BASIC

SESI PENGAJIAN: 2014/15 Semester 2 Saya `AFIF BIN MOHD MAAROF mengaku membenarkan Laporan PSM ini disimpan di Perpustakaan Universiti Teknikal Malaysia Melaka (UTeM) dengan syarat-syarat kegunaan seperti berikut:

1. Laporan PSM adalah hak milik Universiti Teknikal Malaysia Melaka dan penulis. 2. Perpustakaan Universiti Teknikal Malaysia Melaka dibenarkan membuat salinan

untuk tujuan pengajian sahaja dengan izin penulis. 3. Perpustakaan dibenarkan membuat salinan laporan PSM ini sebagai bahan

pertukaran antara institusi pengajian tinggi.

4. **Sila tandakan ( )

SULIT

TERHAD

TIDAK TERHAD

(Mengandungi maklumat yang berdarjah keselamatan atau kepentingan Malaysia sebagaimana yang termaktub dalam AKTA RAHSIA RASMI 1972)

(Mengandungi maklumat TERHAD yang telah ditentukan oleh organisasi/badan di mana penyelidikan dijalankan)

Alamat Tetap:

No 8, Jalan 4/3K,

Bandar Baru Bangi,

43650 Selangor.

Tarikh: ________________________

Disahkan oleh:

Cop Rasmi: Tarikh: _______________________

** Jika Laporan PSM ini SULIT atau TERHAD, sila lampirkan surat daripada pihak berkuasa/organisasi berkenaan dengan menyatakan sekali sebab dan tempoh laporan PSM ini perlu dikelaskan sebagai SULIT atau TERHAD.

DECLARATION

I hereby, declared this report entitled “Voice Controlled Wheelchair By Using

Visual Basic” is the results of my own research except as cited in references.

Signature : ………………………………………….

Author’s Name : …………………………………………

Date : …………………………………………

APPROVAL

This report is submitted to the Faculty of Engineering Technology of UTeM as a

partial fulfillment of the requirements for the degree of Bachelor of Electronics

Engineering Technology (Industrial Electronics) (Hons.). The member of the

supervisory is as follow:

………………………………

(Project Supervisor)

i

ABSTRAK

Kerusi roda berkuasa dengan kawalan kayu ria, kawalan skrin tidak dapat dikawal oleh

kebanyakan orang. Jadi kerusi roda yang dikawal oleh suara boleh menyediakan akses

mudah untuk orang kurang upaya fizikal yang tidak dapat mengawal pergerakan badan

mereka terutama tangan. Projek ini boleh membantu untuk meningkatkan kemudahan

mobiliti untuk mereka yang kurang upaya, kecederaan yang teruk dan juga golongan

orang tua oleh itu reka bentuk ini boleh membantu mereka ini untuk menaik taraf

kehidupan mereka untuk hidup lebih selesa. Pengecaman suara merupakan teknologi

terbaru yang memberi alternatif kepada orang ramai untuk berinteraksi dengan mesin

atau peranti elektronik. Untuk menyelesaikan masalah ini ialah dengan melaksanakan

kawalan suara maka dengan menggunakan mikrofon untuk mengawal kerusi roda.

Sistem pengecaman suara akan menggunakan perisian Visual Basic 6.0. Sistem ini

adalah reka bentuk untuk mengawal kerusi roda menggunakan input suara dari

pengguna untuk melaksanakan pergerakkan kerusi roda, dengan itu ia dapat memberi

kawalan kepada pengguna ke atas kerusi roda tanpa memerlukan sebarang bantuan

daripada orang lain. Oleh itu Visual Basic digunakan untuk mengiktiraf suara

seterusnya mengawal pergerakkan kerusi roda. Projek ini menggunakan

mikropengawal PIC16F877A litar dan motor arus terus untuk mewujudkan pergerakan

kerusi roda.

ii

ABSTRACT

The powered wheelchairs with the standard joystick and screen control are unable to

control by many people. So a voice controlled wheelchair can provide easy access for

physical disabled person who cannot control their movement especially using hands.

This project can help to increase the ease of mobility for disable, injured and older

people as a result this design can help the people to upgrade their life to live more

independently. Voice recognition is a prominent technology which gives an alternative

to people to interact with machines electronic devices. Implementing voice control

interfacing over a microphone for the wheelchair can resolve this problem. The voice

recognition system will be using Visual Basic 6.0 software. The system is designed to

control a wheelchair using the voice inputs from the user to performing the

programmed motion, thereby giving a control to the user over the wheelchair without

need any help from other people. Therefore Visual Basic interface is for recognizes a

voice in turn controls the movement of wheelchairs. This project uses PIC16F877A

microcontroller circuit and Direct Current Motor to create the movement of

wheelchair.

iii

DEDICATION

To my beloved mother and father

iv

ACKNOWLEDGEMENT

First and foremost, I would like to take this opportunity to express my sincere

acknowledgement to my supervisor Mr. Khairul Azha Bin A.Aziz from the Faculty of

Engineering Technology Universiti Teknikal Malaysia Melaka (UTeM) for his

essential supervision, support and encouragement towards the completion of this

thesis. Special thanks to UTeM grant funding for the financial support throughout this

project.

Special thanks to all my friends, my mother, beloved father and sibling for their

moral support in completing this degree, lastly thank you to everyone who had been

to the crucial parts of realization of this project.

v

TABLE OF CONTENT

Abstrak i

Abstract ii

Dedication iii

Acknowledgements iv

Table of Contents v

List of Tables viii

List of Figures x

List of Abbreviations, Symbols and Nomenclatures xii

CHAPTER 1: INTRODUCTION 1

1.1 Introduction of Project 1

1.2 Project Background 2

1.3 Project Objective 5

1.4 Problem Statement 5

1.5 Scope of Project 6

1.6 Methodology 7

CHAPTER 2: LITERATURE REVIEW 8

2.1 Introduction 8

2.2 Wheelchair History 8

2.3 Visual Basic 10

2.4 Speech Recognition 11

2.5 Microsoft Speech SDK 5.1 12

2.6 RS232 Serial Port 12

2.7 Microcontroller PIC16F877A 15

2.8 Motor Driver MDD10A 16

2.9 DC Motor 16

2.10 Past Project 17

2.10.1 Wheelchair Movement Controlled by 18

Voice Recognition

vi

2.10.2 Voice Recognition Robotic Car 18

2.10.3 Smart Home Automation Using Voice 19

Recognition

2.13.4 Biometric Voice Recognition in Security 19

System

CHAPTER 3: METHODOLOGY 20

3.1 Project Development 20

3.2 Software Implementation 23

3.2.1 Installed Microsoft Speech SDK 5.1 24

3.2.2 Installed RS232 Serial Port 25

3.2.3 Create Graphic User Interface by Visual Basic 6.0 26

3.2.4 PIC Basic Pro 30

3.3 Electronic Implementation 32

3.3.1 SK40C 33

3.3.2 Motor Driver MDD10A 34

3.3.3 DC Motor 36

3.4 Mechanical Implementation 36

CHAPTER 4: RESULT AND DISCUSSION 40

4.1 Result 40

4.2 Accuracy of Voice Recognition 46

4.3 Accuracy of the system 57

4.4 Discussion 58

CHAPTER 5: CONCLUSION & RECOMMENDATIONS 60

5.1 Conclusion 60

5.2 Recommendation 61

REFERENCE 62

vii

APPENDICES

A Gantt Chart

B Coding Visual Basic

C Coding PIC16F877A

D Datasheet PIC16F877A

E Datasheet MDD10A

viii

LIST OF TABLES

2.1 Wheelchair History Timeline 9

2.2 RS232 pin assignment (DB9 PC Signal Set) 14

2.3 Advantages and Disadvantages of various type of DC motor 17

3.1 Type of character for data transmission 28

3.2 Truth table for the control logic for both motor 35

3.3 The Truth Table for Each Movement 35

4.1 Truth Table for the control for both motor 42

4.2 List of Voice Command 44

4.3 Visual Basic for Command and Value 46

4.4 PIC16F877A Value Receive and Action 46

4.5 List of Voice Command Participant 1 (Silent) 48

4.6 List of Voice Command Participant 1 (Noise) 48

4.7 Percentage of Accuracy Participant 1 48














ix















4.35 Percentage of Accuracy System 58

4.36 Total cost of Wheelchair 58

x

LIST OF FIGURES

1.1 Block Diagram for overview of project 4

1.2 Flowchart of Project 7

2.1 Handshake looping a PC serial connector 13

2.2 RS232 Pinout 13

2.3 MAX232 Interfacing with microcontroller 17

3.1 Flowchart of project 22

3.2 Software for software development 23

3.3 Installation of Microsoft Speech SDK 5.1 24

3.4 RS232 Prolific Serial Port 25

3.5 Visual Basic Operation 26

3.6 Introduction Interface 28

3.7 Program Interface 29

3.8 Component Microsoft Voice Commands 29

3.9 Component Microsoft Comm Control 6.0 and Microsoft

Command Dialog Control 6.0

30

3.10 Microcontroller flowchart operation 31

3.11 Microcontroller program 32

3.12 Electronic Flowchart 33

3.13 SK40C 33

3.14 MDD10A 34

3.15 Bicycle gear and timing chain gear 35

3.16 Sprocket timing chain weld to DC motor 36

3.17 DC motor plate holder 36

3.18 Controller Box 37

3.19 Switch and Serial Communication at Controller Box 37

3.20 The Wheelchair ready for testing 37

xi

4.1 Circuit Connection 38

4.2 Codes for initialize and enable voice control 39

4.3 Codes to show the status of wheelchair 40

4.4 Codes to show the available serial port 41

4.5 The program interface was respond 41

4.6 RS232 Connection 43

4.7 Coding in microcontroller 44

4.8 Silent and Noise according to participant 55

4.9 Silent and Noise average 55

xii

LIST OF ABBREVIATIONS, SYMBOLS AND

NOMENCLATURE

ADA - Americans with Disabilities Act

ADL - Activity if Daily Living

PDSS - Physical Disability Stress Scale

WWII - World War 2

DC - Direct Current

SDK - Software Development Kit

SAPI - Speech Application Programming Interface

VB - Visual Basic

GUI - Graphic User Interface

OLE - Object Linking and Embedding

API - Application Programming Interface

DTE - Data Terminal Equipment

DCE - Data Communication Equipment

PIC - Peripheral Interface Controller

RAM - Random Access Memory

ROM - Read Only Memory

UART - Universal Asynchronous Receiver/Transmitter

USART - Universal Synchronous Asynchronous

Receiver/Transmitter

RF - Radio Frequency

DC - Direct Current

1

Nowadays, more and more day people are suffering from losing the abilities to move

their hand and body. Wheelchair is a very important necessity for handicap. Many

organizations intend to design and create a more convenient high technology

wheelchair for the handicap. Most available wheelchair in the market is self-control

wheelchair. So it is not practical for person who lost the hands or legs or lost the

abilities to use their hand and lack of stamina such as older people. For those people

they still have their voice so they can use voice to control wheelchair without moving

their body.

1.1 Introduction of Project

The focus of this project is to design and develop a voice controlled wheelchair

for handicap, disability and older people. Today, more and more people are suffering

from losing their hand and losing their hand and losing capabilities to control their

hand or body. Wheelchair is a very important necessity for the handicap. Many

organizations intend to design and create a more convenient wheelchair for the

handicap such as joystick controller.

But this chair come with high price and most available wheelchair in the market

are self-control wheelchair. So it is not practical for person who lost their hands or lost

abilities to use their hand or body or lack of stamina such as older people, but for those

people they still have their voice so they can use their voice to controlled wheelchair

without moving their body.

INTRODUCTION

CHAPTER 1

2

1.2 Project Background

Electric wheelchair has given a lot of benefit of today technology make the life

of handicap and disabled people more quality and comfortable especially for people

or individual which have a problem of broken a leg or hand, paralyzed or elderly

people but by using power wheelchair it can be assistance or help them to improve

their capability to move independently. With a voice control wheelchair, it can help

people to move to any areas more easily and smoothly.

According Furlong M, Connor JP. (2007) to several studies have shown that

the independent transportability, which is included power wheelchair, manual

wheelchair and walker it all give the benefit to both children and adults. Independent

transportability increases career or employment opportunities, reduces dependence on

caregivers and family members, and promotes feelings of self-dependence.

According Linda Carter, J.D, Beth Loy (2013) from Americans with Disabilities

Act or known as ADA has make a studies about wheelchair users in the United States,

there are an estimated 1.4 million wheelchair users in the United States (Kraus, 1996).

People use the wheelchairs for a many of reasons, the most common reason are being

paralysis from spinal cord injuries. Current estimates indicate there are between 183,000

and 230,000 persons alive today in the United States with spinal cord injuries. The mean

age of injury is 38 (Spinal Cord Injury Information Network, 2008).

There are much type of wheelchairs on the market, including manual,

motorized, stand-up, elevating, reclining, sports, beach, and stair-climbing. Most

people who use wheelchair have some of limitation, but rarely have in all of them.

Beside that this limitation is depend on individual who use wheelchair need the

accommodations but may be few of the will need some of accommodations.

For a handicapped person, to be independent is a important condition of self-

confidence. For a case, usually handicap and older people has a problem with difficult

to walk or pull a wheel for themselves, so literally they might be do take easily about

their hygiene for example drink less mineral water to reduce a routine of urination.

3

According to Furling M, Connor JP (2007) Mobility limitations are the leading

cause of functional limitations among adults with an estimated prevalence of 40 per

1000 persons age 18 to 44 and 188 per 1000 at age 85 and older. Transportability

difficulties are also strong predictors of activities of daily living (ADL) and

instrumental ADL disabilities because of the need to move to accomplish many of

these activities. In addition, because of the limitation of the movement, it can affect a

result to an individual to join a social activity which can lead them into social isolation,

anxiety and depression

According to Furling M, Connor JP (2007) from the National Center for

Biotechnology Information is U.S studies state that from the 119 wheelchairs users

with acquired physical disability are participates state a result there is 4 main factors

of disability related stress, access accounted for 33.7% of the variance, physical for

8.4% of the variance, social for 7.9% of the variance and burden of care for 7.2% of

the variance

From the ZocDoc (2014), there are some disability people asking a question

that he felt so small and meaningless and helpless. Disable people will find that it there

is some element of post-traumatic stress disorder that accompanies any traumatic

event. Nowadays wheelchair has become popular among the elderly and disabled

people because the power wheelchair that they are easy and helpful which can be

controlled by the user in the chair by using their hands or other body parts useful. The

function is very important for some who need to be more independent and confident.

In fact, there is many varieties of power wheelchair is available in the market

which there is thousands of companies for wheelchair, online sites, shop and mall. But

most of the wheelchair must be control using hand, leg or any other body parts. Seeing

that people regularly communicates each other by voices, it is very beneficial if voice

is used to command robots.

Wheelchair is a very important vehicle for the handicapped or older people to

help them move around in spite of that for the people who has serious body injury or

paralysis or older people, the wheelchair with joystick are not productive device as a

4

control device. Lately the development in speech technology has becoming a focus

attention of researchers to establish a more great design, simple, reduce cost to support

and help the disabled community

This project describes a wheelchair which the user can control the wheelchair

only by using the voice command. This project will give contribute a great benefit to

disable people and elderly people to control a movement of a wheelchair.

The aims of this project is to help a movement of the disabled people who

cannot move properly or need help to move to have a more better and quality life and

help them build self-esteem. Speech recognition technology will give a great benefit

to human to interact with a machines or tools for controlling a wheelchair.

This project are divided to two part which software and hardware. For the

software, the program that will used required the computer that equipped with Visual

Basic and for the interaction between computer and user the project using the

microphone as an intermediary which is used as the input of human voice.

Furthermore this project also used a Programmable Integrated Circuit (PIC)

which is operate as a switch to control the movement of wheelchair based on the human

voice as an input with installing two DC motors as the driving force.

The power wheelchair equipped with five options for basic motion for user to

control the wheelchair. The five condition of the wheelchair can be described as the

following.

(a) Moving forward.

(b) Moving backward.

(c) Turning to the right.

(d) Turning to the left.

(e) Stop moving.

5

This project describes the design and development of the motion control using

voice recognition for a wheelchair application. Figure 1.1 shows the block diagram for

overall of the project.

Figure 1.1: Block Diagram for project

1.3 Project Objective

(a) To develop a wheelchair system that can be control by using voice.

(b) To develop a voice recognition system by using Visual Basic.

(c) To increase disabled people ability to live independently.

1.4 Problem Statement

People with disabilities meet barriers of all types. However the technology can

be a help to reduce of these barriers by creating the powered wheelchairs. Because

some wheelchairs may not fit enough for disable or older people to use their hands to

operate a joystick or move the wheel. So to overcome this problem, by using this

technology it can help to create and design this wheelchair to minimize disable people

difficulties.

The result of this design will allow certain people to live a life independently.

Speech Recognition technology including voice recognition is a key which may

provide a new way of human interaction with machines or tools. Thus the problem that

6

they are faced can be solved by using Voice Recognition Technology to move the

wheelchair. This can be realized with used the microphone as an intermediary.

Furthermore a handicapped people with locomotive disabilities needs a

wheelchair that can perform a function that require a person to move around and most

regular and low cost wheelchair need to be push by using hands. However there are

individual that have weak upper body or do not have strength to operate it manually.

So that it is desirable to provide them with the automatic motorized wheelchair

that can be control by moving joystick, but it is too mainstream and limit to person

who still have body capabilities to move hands. But for handicapped people how do

not have capabilities on upper body and elder people who find the manual mode is too

tiring, the voice control can be the answer of this problem.

With a lower cost and price that a current market and affordable for as many

handicapped people this wheelchair will have a potential to the market and future as

new technology that can help a people who need this type of service.

1.5 Scope of Project

This project is focus on handicap people who lose their hand or lose abilities

to move their body. For those people still have their voice can use this system to control

movement of the wheelchair. In this project, the software of Visual Basic 6 and SDK

5.1 will be used as an application to receive the voice input from user which is a user

can instruct the wheelchair by using a microphone to give a command to control the

movement of the wheelchair to any desire direction which is forward, backward, left

and right. The dc motor will be used to move the wheelchair and PIC16F877A will be

as a controller of the motor driver MDD10A.

7

1.6 Methodology

Methodology is the process used to collect information and data for the making

purpose of making decision. The methodology may include understand the problem,

research of information and data, design, decision and test and analysis. Figure 1.2

below shows the flowchart of methodology of this project.

Figure 1.2: Flowchart of project

8

This chapter includes the background study regarding voice recognition concept

from journal and related previous projects and thesis. It also discusses on the

component that have been research to use in this project.

2.1 Introduction

To start build this project, some research and collecting information had been

done. The information is collected from many sources such as books, journals, forum

and website. All this collected information were recorded and been discuss with

lecturer, students and public to collect and choose the best information and idea. All

information is very important and useful as a guide to build this project. All research

and studies is related to the topic such as type of component used, hardware and

software that used for this project.

2.2 Wheelchair History

It has been said that “necessity is the mother of all invention”, at some point in

human history something has been created to help disabled people to move from one

point to another point with some relaxation. From Erin Florence (2012) thus the

invention of the wheelchair sprung forth. Table 2.1 show the chronology of the

LITERATURE REVIEW

CHAPTER 2

universiti teknikal malaysia melakaeprints.utem.edu.my/15427/1/voice controlled wheelchair by using...

Documents