herbs dictionary with augemented reality …2.1 kamus bergambar bestari that using ar 3d 8 2.2 herbs...
TRANSCRIPT
-
HERBS DICTIONARY WITH
AUGEMENTED REALITY
MUHAMMAD AIMAN BIN ABD GHANI
BACHELOR OF INFORMATION TECHNOLOGY
(INFORMATIC MEDIA) WITH HONOURS
UNIVERSITI SULTAN ZAINAL ABIDIN
2018
-
ii
DECLARATION
I hereby declare that this report is based on my original work except for quotations
and citations, which have been duly acknowledged. I also declare that it has not been
previously or concurrently submitted for any other degree at Universiti Sultan Zainal
Abidin or other institutions.
________________________________
Name : Muhammad Aiman Bin Abd Ghani
Date : 23 December 2018
-
iii
CONFIRMATION
This is to confirm that:
The research conducted and the writing of this report was under my supervision.
________________________________
Name :Pn. Rohana Binti Ismail
Tarikh : 23 December 2018
-
iv
DEDICATION
In the Name of Allah, the Most Gracious and the Most Merciful.
Alhamdulillah, I thank God for His grace and grace, I can prepare and
complete this report successfully.
First of all, I would like to thank my supervisor, Pn. Rohana Binti Ismail
because with guidance, the advice and the thoughtful ideas given g me the opportunity
to prepare this report successfully.
In addition, my gratitude is also to my colleagues who share ideas, opinions,
knowledge and reminders. They helped me answer every question that was important
to me in completing this report.
Thanks also to my beloved mother and father always encouraged me and
motivated me to prepare for this report.
I would like to take the opportunity to thank all lecturers of the Informatics and
Computing Faculty for their attention, guidance, and advice in helping and sharing
ideas and opinions in making this report successful.
May Allah SWT bless to all the efforts that have been given in completing this
report.
Thank you.
-
v
ABSTRACT
Herbs Dictionary with Augmented Reality has been developed for students and
lecturers to manage learning more efficiently. Existing learning methods are more
efficient. Existing learning methods changed by AR technology and using
smartphones. This app may be able to help students learn more interesting and
engaging object types. In addition, this app uses interactive 3-dimensional objects,
sound and display information for students interested in using this app. The ADDIE
method is divided into five main parts, namely the beginning of the analysis phase, the
design phase, the development phase, the implementation phase and the evaluation
phase. The use of the ADDIE method ensures the smooth development of the system
and according to planning.
-
vi
TABLE OF CONTENT
PAGE
DECLARATION ii
CONFIRMATION iii
DEDICATION iv
ABSTRACT v
CONTENTS
LIST OF TABLES
vi
viii
LIST OF FIGURES ix
CHAPTER I INTRODUCTION
1.1 Introduction 1
1.2 Background 1
1.3 Problement Statement 3
1.4 Objectives 4
1.5
1.6
Scopes
Activities, Milestone (Gantt Chart)
4
5
1.7 Limitation of work 6
1.8 Expected Result 6
1.9 Conclusion 6
CHAPTER II LITERATURE REVIEW
2.1 Introduction 7
2.2 Related Product 8
2.2.1 Kamus Bergambar Bestari AR 3D 8
2.2.2 Herbs List 9
2.2.3 Culpeper’s Herbal 10
2.3 Comparison table of the existing product with
5 element of multimedia
11
2.4 Comparison table of existing product 11
2.5 Conclusion 12
-
vii
CHAPTER III
METHODOLOGY
3.1 Introduction 13
3.2 Methodology Model 14
3.2.1 Analysis phase 15
3.2.2 Design phase 17
3.2.3 Development phase 21
3.2.4 Implementation phase 21
3.2.5 Evaluation phase 22
3.3 Hardware and Software Requirement 23
3.3.1 Hardware requirement 23
3.3.2 Software requirement 23
3.4 Conclusion 24
REFERENCE 25
-
viii
LIST OF TABLES
TABLE TITTLE PAGE
1.1 Gantt Chart 5
2.1 Comparison table of the existing products with 5 element
of multimedia
11
2.2
3.1
Comparision table of existing product
Comparison of AR picture dictionary applications and
existing herbs dictionary
11
15
-
ix
LIST OF FIGURES
FIGURE TITLE PAGE
2.1 Kamus Bergambar Bestari that using AR 3D 8
2.2 Herbs List 9
2.3 Culpeper’s Herbal 10
2.4 Kamus Bergambar Bestari AR 3D 10
3.1 ADDIE Model 14
3.2 Analysis Phases 16
3.3 Storyboard appllication 19
3.4 Storyboard book design 20
-
1
CHAPTER 1
INTRODUCTION
1.1 INTRODUCTION
This section is the introduction to the report for developed system. It will provide a basic
overview of the whole system. This chapter presents about the project background, problem
statement objectives, scope and project planning. Background of the system discuss about basic
information about this system. Problem statements discuss about related issues of the system.
Objectives state all main goal of this system. The scope shows who are using the system and
what the user can do
1.2 BACKGROUND
Augmented Reality (AR) hasbeen an emerging technologies in these recent years. AR
defined as immersion of virtual environment to the real environment which it enriches the vision,
audition or even taste, touch and smell (Daponte, et al., 2014). The significant timeline of AR
technology begun from a cinematographer, Morton Heiling which he thought cinema should
enable interaction between a human and the environment covering all the senses (Daponte, et al.,
2014). The first AR Head Mounted Display was developed by Sutherland (Sutherland, 1968)
-
2
while the ability to interact with virtual objects was first introduced by Myron Krueger (Golan,
2006).
Nowadays, smartphones have the core features to develop an AR applications such as
camera, touch screen, Inertia Measurement Unit (IMU), internet access and so forth (Daponte, et
al., 2014). The advancement of smartphone technologies which enable real-time image
processing camera and powerful performance from built-in Central Processing Unit (CPU) and
Graphics Processing Unit (GPU) made basic AR application development easier without external
supporting device.
This new technology, called augmented reality is a combination of what's real and what's
computer-generated by enhancing what we see, hear and feel. Its combines real and virtual
images both can be seen at the same time. When compared to other reality technologies,
augmented reality lies in the middle of the mixed reality spectrum between the real world and the
virtual world. Furthermore, augmented reality is changing the way we view the world or at least
the way its users see the world. Additionally, augmented reality adds graphics, sounds and haptic
feedback to the natural world as it exists. In contrast to the synthetic environment rendered onto
a virtual reality (VR) system, an AR system augments the physical environment (as seen through
the camera lens) with a synthetic representation. Thus, the environments co-existing together can
be viewed as a hybrid environment–one completing the other, and vise versa.
-
3
Herbal Dictionary With Augmented Reality Enhanced using AR technology is an
interactive dictionary that uses new era technology to help people, especially students and
teachers as an interesting dictionary reference. This Herbal Dictionary With Augmented Reality
is specially created for students at secondary and university level as well as to teachers and
lecturers. In addition, Herbal Dictionary With Augmented Reality is focused on some herbs that
can be used for health and in medicine. Users need to scan the images of the herbs found in the
dictionary using their mobile phones. Then, the herbal pictures and their description will appear
on the phone automatically. Additionally, users can click on the audio button available to hear
the herb name's correctly.
1.3 PROBLEM STATEMENT
As we can see, people today are too open to the technology around them. Therefore, it
makes the book or dictionary no longer main focus as their reference material. In addition, books
or dictionaries that exist especially about herbs have only words and pictures, this makes the
reader feel bored because it unattractive. In addition, scientific names of herbs that are hard to
read cause readers do not know how to spell it properly .Beside, not many mobile apps provide
for herbs reference. Ultimately, the previous herbal dictionary is no longer the main reference for
people especially for students and teachers.
-
4
1.4 OJECTIVE
The objectives of the Herbal Dictionary With Augmented Reality are:
1. To study the AR technology to be used in Herbs Dictionary With Augmented Reality.
2. To design and develop Herbs Dictionary that enable users can learning with augmented
reality.
3. To evaluate function augmented reality of Herbs Dictionary.
1.5 SCOPE
The main scopes of the system:
1. Admin
The admin can use this interactive dictionary to make a maintenance on the application and
update a new version. Next, the admin also needs to look the responses to the feedback which
comes from the users.
2. User (Students)
This interactive dictionary is invented especially for student on school and university.
Students can use this Herbs Dictionary with AR as reference about herbs in an interesting
way.
-
5
1.6 ACTIVITIES, MILESTONE (GANTT CHART)
Task name
SEPTEMBER OCTOBER NOVEMBER DECEMBER
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
Topic Discussion and
Determination
Project Title Proposal
Proposal writing
Proposal writing –Literature
Review
Proposal Progress
Presentation & Evaluation
Discussion
Correction Proposal
Proposed Solution
Methodology
Proof of Concept
Drafting Report of the
Proposal
Submit draft of report to
supervisor
Seminar Presentation
Correction Report
Final Report Submission
-
6
1.7 LIMITATION OF WORK
There are several limitations and constraint that occurred throughout the development of this
interactive flashcard. These problems and limitations in conducting this study are:
1. The user can use Herbs Dictionary With Augmented Reality using mobile phone only.
2. This Herbs Dictionary With Augmented Reality is build only for android version.
3. This Herbs Dictionary With Augmented Reality is developed exclusively for Herbs
that can use in medicine only.
1.8 EXPECTED RESULT
At the end of this project, the expected result following the development of the proposed project
is as follows:
1. The user will be able to gain herbs knowledge with the AR support.
2. System will be function after developed.
1.9 CONCLUSION
With the technological advances of today’s increasingly fast-growing, it is hoped that this
project will help to learn for a student to get gain knowledge. I hope this picture dictionary can
get more published in markets shop.
-
7
CHAPTER 2
LITERATURE REVIEW
2.1 INTRODUCTION
Augmented reality is a combination of what's real and what's computer-generated by
enhancing what we see, hear, feel and smell. Its combines real and virtual images both can be
seen at the same time. When compared to other reality technologies, augmented reality lies in the
middle of the mixed reality spectrum between the real world and the virtual world. Furthermore,
augmented reality is changing the way we view the world or at least the way its users see the
world. Additionally, augmented reality adds graphics, sounds and haptic feedback to the natural
world as it exists.
This chapter will focus on literature study of related works from other researcher. This
helped to generate ideas on how to carry out this project with reference to researchers’ study.
Then will be comparing existing augmented reality and herbs Dictionary.
https://www.realitytechnologies.com/mixed-reality#sec2
-
8
2.2 RELATED PRODUCTS
2.2.1 Kamus Bergambar Bestari AR 3D
Figure 2.1 : Kamus Bergambar Bestari that using AR 3D Technology
This dictionary can enhance the mastery of the three-language vocabulary (BM-BI-BA)
as well as advanced jawi texts according to the latest spelling. Preschoolers and primary schools,
teaching staff or parents can use this dictionary as a complete supplementary reference as it
relates to the current learning process. The index along with the page number is provided as the
fastest reference to find the desired entry without having to flip the sheet on the sheet. Beside
that, this dictionary also have Illustration and colorful picture, clear and interesting for kids. It
consists of 16 major themes covering daily themes and there is an Augmented Reality (AR) for
the selected entries.
-
9
2.2.2 Herbs List
Figure 2.2: Herbs List
This Herbs List Dictionary focus on herbs that can be used for health and medicine only. This
dictionary contains information on herbs that are very comprehensive where it has a very clear
scientific name, common name, type of herb family, part used, habitat and description of the
herb and the warning that the reader should know. But unfortunately it does not have the pictures
of the herbs, so it difficult for people to identify the types of herbs contained in this dictionary.
-
10
2.2.3 Culpeper’s Herbal
Figure 2.3: Culpeper’s Herbal
Culpeper's Herbal book is a very popular herbal reference book. This is because the book is
written by a very popular herbalist named Nicholas Culpeper who lives in Spitalfields. The
Culpeper herb has been continuously printed since he published it in the seventeenth century. In
Culpeper's Herbal book there are 456 types of herbs and herbal names. However, he has no
detailed description of the herbs. It makes hard for people to know the advantages and uses of the
herb.
-
11
2.3 COMPARISON TABLE OF THE EXISTING PRODUCTS WITH 5 ELEMENT
OF MULTIMEDIA
Title text image video audio animation
Kamus Bergambar Bestari -
Herbs List - - - -
Culpeper’s Herbal - - - -
2.4 COMPARISON TABLE OF EXISTING PRODUCT
Product Platform function Method Advantage Drawback
Kamus
Bergambar
Bestari
Android /IOS
phone
Creative learning
with 3D
Augmented
Reality.
Marker based
method
The pictures are brightly coloured
Versatile and multi-functional
No specific topic
Herbs List Book Reference - Have detail description about
herbs
Don’t have herbs
picture
Culpeper’s
Herbal Book Reference - Have a lot of
herbs picture
Don’t have details and description about
herbs
-
12
2.5 CONCLUSION
In this whole chapter, this chapter discusses a product that uses a picture dictionary to
develop an augmented reality. This chapter also discussed the technique used in the new system
and the technique used in the previous research articles and journal. The comparison with the
previous research is done so that the right choice will be selected. The weaknesses of the three
product are solved in this project.
-
13
CHAPTER 3
METHODOLOGY
3.1 INTRODUCTION
In this chapter, will talk about methodology and the process of developing “Herbs Dictionary
With Augmented Reality”. By the way, the methodology that has been used to develop this
interactive flashcards is described. The methodology will guide the system to solve the problem
smoothly and complete the project within the given time. There are many types of methodology
that can be applied and used in the development of AR technology. The approach must be
chosen correctly for the project. It is important to guide the researcher to manage the given task.
Hence, the ADDIE model is used for this project. Furthermore, every details about each phase
that involve in the development of this project will be explained later in this chapter. Beside that
also rates this chapter describes the software and hardware requirement that will be used for
development process.
-
14
3.2 METHODOLOGY MODEL
It is important to know and understand the ADDIE model if a developer want to develop
a successful project. The ADDIE model is the generic process traditionally used by instructional
designers and training developers. The five phases are Analysis, Design, Development,
Implementation, and Evaluation. ADDIE is an extremely effective tool in training development
that addresses instruction. Therefore, the ADDIE model could be quite helpful for many in
planning a course of action that would lead to the successful implementation of a project. When
dealing with projects that involve instruction or steps, the approach fits nicely.
In order to ensure effective learning outcomes from augmented reality (AR) education
development, careful planning are required before the development process begins. ADDIE
Instructional Design Model is used in this mobile AR application development methodology.
The ADDIE model for instructional system design (ISD) is a basic model that can be applied to
any kind of learning solution. The ADDIE model has five steps processes as illustrated in the
Picture 3.2.
Figure 3.1 : ADDIE Model
ANALYSIS
DESIGN
DEVELOPMENT
IMPLEMENTATION
EVALUATION
-
15
3.2.1) Analysis Phase
In this phase, an analysis has been done to identify the need to develop the Herbs
Dictionary With AR. The analysis phase involves requirement analysis, task analysis and
teaching analysis. Activities involving identifying problem statements, goals and goals of mobile
AR applications to be developed, student needs, existing knowledge and any other relevant
features and content of AR mobile applications. Mobile AR applications are developed by
focusing on herbal content that can be used in specialized health for students and lecturer
references. This analysis is also done by making a research on the application of the AR picture
dictionary and the existing herbs dictionary. Through analysis, the weakness of the dictionary
and existing product can be identified. Comparison of AR picture dictionary applications and
existing herbs dictionary as illustrated in Table 3.1. All the information collected is used to
develop goals and objectives for developing mobile AR applications. Software and hardware
requirements are also specified in this phase. The flow analysis phase is shown in Picture 3.2.1.2.
EXISTING
PRODUCT
MEDIUM AUGMENTED
REALITY
CONTENT WEAKNESS
Kamus
Bergambar
Bestari
Mobile App Yes colorful picture -
Herbs List Book No Detail about
Hebrs
No Herbs
Picture
Culpeper’s
Herbal
Book No Picture of Hebrs No Herbs
Description
Table 3.1
-
16
Figure 3.2
Analysis Problem
Statement
Objective
Target User
Content
Strategy
Requirement
1) The existing dictionary is unattractive
2) Nott many mobile apps provide for Herbs
Reference
1) To approve AR method for learning
2) To attract more user to learn about herbs
1) Student
2) Lecturer
1) Herbs Picture and Description
1) Use Augemented Reality
Software :
1) Unity 3D
2) Adobe Illustrator
3) Adobe Photoshop
Hardware :
1) Laptop
-
17
3.2.2) Design Phase
The Design phase endeavors to identify specific learning objectives, topic content, presentation
methods and media, learner exercises and assessment criteria to be used. During the design
phase, the information gathered during the analysis phase is reviewed and compiled to build the
project. In design phase, flowchart and storyboard were developed.
Flowchart
Start
Home Page
SCAN
EXIT
Herbs
Picture &
Description
Choose Herbs
Herbs
Dictionary
Choose Audio
Scientific
Name of
Herbs
End
Yes
Yes
Yes
Yes
Yes
No
-
18
Figure 3.3 Storyboard Application
Code 01
Title Home page
Code 02
Title Help page
Description:
A: Button - Help
B: Apps logo
C: Button- Scan
D: Button- Exit
A
B
Herbs
Dictionary
Logo
C
D
B
A
Description:
A: Button - Home
B: Help information
-
19
Code 03
Title Before scan page
Code 04
Title After scan page
A
D
C
B
Description:
A: Button - Help
B: Button -Home
C: Scan
D: Button- Scan
C
Herbs
Picture
D
Description of
Herbs
A
E
B
F
Description:
A: Button - Help
B: Button – Home page
C: Herbs Picture
D:Herbs Description
E: Button – Audio
F: Button - Back
-
20
Figure 3.4 Storyboard Book Design
Code 05
Title Book page
A
Herbs
Picture
A
Herbs
Picture
A
Herbs
Picture
A
Herbs
Picture
B B
B B
Description:
A: Herbs Picture
B: Herbs Name
-
21
3.2.3) Develop phase
Development is the third phase of the training planning process. During the development phase,
the actual course materials are created. A successful development phase uses the information
collected in the analysis phase and the decisions made in the design phase.
3.2.4) Implement phase
The Implementation phase refers to the actual delivery of the instruction, whether it's classroom-
based, lab-based, or computer-based. The purpose of this phase is the effective and efficient
delivery of instruction. This phase must promote the students 'understanding of material, support
the students' mastery of objectives, and ensure the students' transfer of knowledge from the
instructional setting to the job.
i) Test Run Project
The developer test runs the project herself. This is to ensure that the project can be used
and is running accordingly.
ii) User Test Run
Developer give to the user to test the project and give the feedback before the presenting
the final product. Criticisms and constructive feedback is taken to be implemented later
on.
-
22
3.2.5) Evaluate phase
This phase consists of formative and summative evaluation. Formative evaluation is present in
each stage of the ADDIE process. Summative evaluation consists of tests designed for criterion-
related referenced items and providing opportunities for feedback from the users. Revisions are
made as necessary. Rapid prototyping (continual feedback) has sometimes been cited as as a way
to improve the generic ADDIE model.
-
23
3.3 HARDWARE AND SOFTWARE REQUIREMENTS
This section will show that the all hardware and software that involve in the development
process. All of these elements are important in the process of development of the system. List
of hardware and software are shown as below:
3.3.1 Hardware requirement
i. Laptop ACER
• To create the sketches for the characters, background and create scripts or documents
related to “Mercy”. Also used for on the go coding and 3D modelling.
• Processor : Intel Core i5-2450M CPU @ 2.50GHz
• Operating System : Windows 10 Pro – 64 bit
• Memory : 8GB RAM
ii. WACOM Tablet
• For drawing and digital painting on the Laptop or PC. Also used to design
merchandise.
iii. Pen drive
• To store the backup file
• Storage : 32GB
iv. Printer Canon MP287
• To print out the documentation
• To print picture dictionary
vi. Android Mobile Phone: Huawei nova 2 lite
• Used to run and testing the application
-
24
3.3.2 Software requirement
i.Unity3D
• Used to create the Virtual Reality app and overall project and modelling 3D object
ii. Autodesk Maya
• Used to create 3D character models
iii. Vuforia
• To create augmented reality
• Detects and tracks the features of images. For best result, aim for target with 4 or 5 stars
3.4 CONCLUSION
Methodology is very important in a system development. It helps to make sure the system
develop correctly from phases to phases. In this system, ADDIE Model had been chosen as a
guide to build system. It also helps to ensure all the objectives can be achieved. Besides, this
chapter also explains the hardware and software requirements for this system.
-
25
REFERENCE
1. Nicholas Culpeper’s. (1998). Culpeper’s English Physician & Complete Herbal. 4
Stationer’s Court: C. Stalker Publications.
2. Miranda & Bill Barros. (2008). Healing Herbs and Medicinal Plants List. Nottingham:
Delectable Publications.
3. Alan B. Craig. (2007). Understanding Augmented Reality Concepts and Application.
United State of America: Library of Congress Cataloging in Publication Data.