Phone Reader Project

By: Hossein and Hadi ShayestehSupervisor: Mr. James Connan

Introduction

Phone Reader

• Intended for Blinds and Illiterates

• People dealing with a Foreign Language

Potential Users

• Converting Image to text using OCR

• Reading out the text using TTS

Phone Reader Design / Phone Device

Generated Audio

Implementation / Phone Device

Implementation / Server

Implementation / Phone Device

Phone Reader Design / Server

Gray Scale

OCR engine

Thresholding

Server

Project Testing

Functionality Testing

• Ease of use

• Fulfillment of functionality

Usability Testing

• Unit testing

- Server - Phone Device

• Integration Testing

Functionality Testing / Server

15 different images captured from screen

Case 1 images captured by camera

Case 4 :

Noise and color applied to Case 1 images Case 2 :

Case 3 :

Case 1 :

Case 5 :

Case 2 images captured by camera

Image preprocessing applied to Case 1 images

Case 6 :

Case 7 :

Case 8 :

Image preprocessing applied to Case 2 images

Image preprocessing applied to Case 3 images

Image preprocessing applied to Case 4 images

Functionality Testing Results

1 2 3 4 5 6 7 8

0102030405060708090

100

OCR functionality test results15 different images captured from screen

Case 1 images captured by camera

4 :

Noise and color applied to Case 1 images 2 :

3 :

1 :

5 :

Case 2 images captured by camera

Image preprocessing applied to Case 1 images

6 :

7 :

8 :

Image preprocessing applied to Case 2 images

Image preprocessing applied to Case 3 images

Image preprocessing applied to Case 4 images

Functionality Testing Results (Contd)

• OCR engine produces near ideal results for high quality images

• Probable poor OCR results are due to noise, colored background or distractions

• OCR performance was greatly improved by applying image pre-processing techniques

What we understood from the test result

What we did to improve the performance

Functionality Improvement / Phone Device

Employing Phone’s Camera in Phone Reader

Improving the User Interface (Buttons,Options)

Usability Testing

Questionnaires

• 10 participants

• Task sheet provided

• Feedback analyzed

Usability Testing Result

1 2 3 4 5

0102030405060708090

100

OCR functionality test results

Successful completion of all the tasks

How well buttons were organized

4 :

How easy was working with Phone Reader 2 :

3 :

1 :

5 :

Function of each button was easy to understand

Overall impression of the Phone Reader application

Usability Testing Result (Continued)

What we understood from the test result

• Phone Reader is fairly easy to use

• The most challenging part was working with camera

• We tried to simplify the process of image capturing by eliminating unnecessary option buttons

What we did to improve the performance

User Manual

• Run the application

• Capture an Image

• Press OCR button

• Press TTS button

Demo

Question and Answer