CHAPTER III

RESEARCH METHODOLOGY

3.1 Research Methodology

In achieving the objective of this study, I used qualitative descriptive

analysis as the research methodology. The aim of the qualitative descriptive

analysis is to find out the teacher’s perception toward the application of Question

Writer quiz maker for testing reading comprehension.

According to Burns and Grove (2003:201), descriptive research “is

designed to provide a picture of a situation as it naturally happens”. Descriptive

research can be either quantitative or qualitative. AECT (2001) wrote in their

website that “descriptive research does not fit neatly into the definition of either

quantitative or qualitative research methodologies, but instead it can utilize

elements of both, often within the same study. The term descriptive research

refers to the type of research question, design, and data analysis that will be

applied to a given topic. Descriptive statistics tell what is, while inferential

statistics try to determine cause and effect.”

Glass & Hopkins states in AECT (2001) that descriptive research

involves gathering data that describe events and then organizes, tabulates, depicts,

and describes the data collection. If the researcher need to describe the data, then

he/she should use the descriptive method. The description functions as a tool to

38

39

organize data into patterns that emerge during analysis. Those patterns can aid the

mind in understanding a qualitative study and its implications.

There are a number of researchers who believe and support the fact that ‘qualitative descriptive’ is a viable and acceptable label for a qualitative research design. While phenomenology, grounded theory, and ethnography also are descriptive qualitative approaches, by nature, they are not exclusively in the descriptive domain because they also tend to explain phenomena. Thus, a basic/fundamental qualitative descriptive design is a valuable method in and of itself. Clinton & Vicky (2012).

The goal of qualitative descriptive studies is a comprehensive

summarization, in everyday terms, of specific events experienced by individuals

or groups of individuals. Qualitative descriptive studies are the least “theoretical”

of all of the qualitative approaches to research. a qualitative descriptive study may

have grounded theory overtones, because it used constant comparative analysis

when examining the data. However, a qualitative descriptive studyis not grounded

theory, because it does not produce a theory from the data that were generated.

3.2 Focus of the Study

The focus of the study is the teacher’s perception toward the application

of Question Writer quiz maker application in designing a test of reading

comprehension for eleventh grade students in SMA N 1 Kajen academic year

2013/2014.

3.3 Role of the Researcher

The researcher takes the role as observer, advisor, data collector and data

analyzer to know how the application of Question Writer quiz maker as a test for

40

reading comprehension. As data observer, I observed the process when the teacher

and students are using the computerized test which is created by using Question

Writer quiz maker application. I observed the way the teacher utilizing the quiz

maker on creating the computerized test.

As advisor, I assisted the teacher in designing the test and help the

teacher to solve any problem that they found during the using of the quiz maker

application.

As data collector, I collected the data from observation sheet, teacher’s

interview, and questionnaires. As data analyzer, the writer analyzes the data which

is collected using a qualitative desciptive research method.

3.4 Source of the Data

The source of the data in this project was taken from observations,

questonaires, and interview with two English teachers in SMA N 1 Kajen. The

English teachers who become the object in this research are Mr. Suwito and Mrs.

Wiwik. Additional feedback is also taken from the students of XI Science class

which is handled by them.

3.5 Instrument for Collecting the Data

Sugiyono (2009: 102) defined instrument as tools used to measure the

natural and social phenomena are observed. Instruments used in this research are:

a. Observation Sheet

Observation sheet is used to take notes of the teachers’ activities in the

process of creating and using computerized quiz and also students’ activities

during the process of testing reading comprehension using the computerized quiz.

41

Furthermore, it is used to record what happen in the class, such as: a) teacher’s

response to the use of Question Writer Quiz Maker 4.2 b). students’ response to

the computerized quiz b) What happen during the process of testing reading

comprehension using computerized quiz which the teachers made by using

Question Writer Quiz Maker 4.2.

Here are the observation sheets which is used in the research

Table 3.1 Phase 1 Observation Sheet

Observed teacher’s name: ............................................

NO POINTS OF OBSERVATION YES NO ADDITIONAL INFORMATION

1. The teacher has a computer/laptop

2.

The teacher installs question writer

quiz maker 4.2 in his/her

computer/laptop.

3.

The teacher read the quick tutorial

and the manual book of question

writer 4.2.

4.The teacher signs up a Question

Writer Tracker account.

5.

The teacher create a his/her first

computerized test using the quiz

maker application by following the

steps in the quick tutorial book

6. The quiz worked properly

7.

The teacher really understands what

Question Writer 4.2 is and its

usage.

42

Table 3.2 Phase 2 Observation Sheet

Observed teacher’s name: ............................................

NO POINTS OF OBSERVATION YES NO ADDITIONAL INFORMATION

1.The teacher has decided what

material will be tested.

2.

The teacher designed his/her

computerized test using question

writer quiz maker 4.2.

3.The computerized test can work

properly

4.The teacher can use the question

writer tracker database properly.

5.

The teacher uploads their

computerized test in the

questionwritertracker.com properly.

6.The teacher posted the quiz link on

their own blog

7. The teacher owned a blog.

8.

The teacher makesures that the

computers and internet

connection in the IT lab are

available and work properly.

Table 3.3 Phase 3 Observation Sheet

Observed teacher’s name: ............................................

NO POINTS OF OBSERVATION YES NO ADDITIONAL INFORMATION

1. All the students are present.

2.The students can acces the teacher’s

blog

3.The students can open the

computerized test

43

4. The students do the test

5.The students finish the test whithin or

before the given time limit.

6.The quiz can upload the test result to

the online database

8.The teacher and the studets discuss

the test material together

b. Questionnaire

The questionnaire is used to find out data information from the teachers

and students after they are using the computerized quiz. Then, the information

collected from the questionnaires is used to determine the teachers and students

perception towards the application of Question Writer Quiz Maker 4.2 for testing

reading comprehension.

Here are the questionnaires which are used in this research:

Table 3.4 Questionaire for Teacher

Name : .......................................................

Instruction : Please answer the questions below by giving check mark

in the yes/no column and write the reason or any additional information in

the reason/add. infomation column.

NO. QUESTIONS YES NO REASON/ADDITIONAL INFOMATION

1Do you use computer/laptop to assist your teaching in class?    

2Have you ever used a computerized test before?    

3Have you ever design a computerized test before?    

4Have you ever used a quiz maker website or application before?

5Do you know about Question Writer Quiz Maker?

6 Do you think this quiz maker is    

44

easy to use?

7Do you have any difficulty in using the quiz maker?    

8Do you think this quiz maker can help you to create your desired test?    

9Do you think Question Writer can reduce human errors in test?    

10

Do you think the quiz made by Question Writer is effective for testing your students' reading comprehension skill?    

11

Do you think this quiz maker can help you to improve your students' reading comprehension skill?    

12Does Question Writer quiz maker make your testing activity more efficient? Explain    

13Does Question Writer makes your test report collecting easier?    

14Do you want to use this quiz maker to create tests in the future?    

15Do you the think the presentation in the test made by Question Writer is good?    

Table 3.5 Questionaire for Students

Name : .............................................

Class : .............................................

Student number : .............................................

Instruction: Answer the question below by giving check mark (√) in the collumn

Yes or No, And please add your reason or additional information in the most right

collumn. Please answer the question honestly based on your own thought.

No. Question Yes No Reason/Add. Info

1 Have you ever experienced online learning in class?2 Have you ever seen a computerized test before?

3Do you want computerized test to be used more frequent in the future learning?

4 Do you think that computerized test is better than the

45

manual one?

5Do you think that the online system in the test is beneficial?

6 Is the instruction given in the test easy to understand?

7Is it easy to navigate through the test (e.g., moving to the next page, choosing answer, typing answer, etc.)?  

8Are the material tested in the test proper with what you have learned in class so far?  

9Do you think this test can help you improve your reading comprehension?  

10 Is the test’s visualization good?  

3.6 Procedures of Collecting The Data

This research is divided into four phases. They are, coaching, preparation

for creating the test, Implementation of the test, and feedback collection

In coaching phase, I introduced the quiz maker application to the teachers

and assisted them in learning how to use it. The teachers were provided with a

quick tutorial guide book to help them design their own computerized test. They

were also given a manual guide book, which contains the complete information

about the quiz maker application. In this phase, I took role as observer, and

advisor. The phase was ended when the teachers have been able to create their

first computerized test using Question Writer qui maker. The teachers’

performance, ability, attitude towards the using of the quiz maker were observed

here.

In preparation for creating the test, the teachers created another

computerized test which will be used for testing reading comprehension. My role

here was as advisor and observer. The teachers’ performance, ability, attitude

towards the using of the quiz maker were observed here.

46

In this phase, I also gave a demonstration to the students on how the

computerized test work and how to use it. The demonstration is done in the

classroom using LCD projector. Each class get one meeting of demonstration

which was carried out in the first 30 minutes of the English class hour.

In the implementation of the test phase, teachers used the computerized

test as a “daily test”. The purpose of the test was to test students’ reading

comprehension.

In the feedback collection phase, the writers collect the teachers feedback

about their experience in using the quiz maker application. They are interviewed

and asked to fill questionaires. After students do the evaluation using the

computerized test, they are also asked to fill questionaires for additional feedback.

Here are the steps of the 4 phases:

3.5.1 Phase 1 : Coaching

The activities done in the preparation phase were:

a. I introduced the quiz maker application to the teachers.

b. The teachers learned how to design the computerized test by using the tutorial

book and the manual guide book.

c. The steps that the teachers should do in this phase were:

1. Installing Question Writer Quiz Maker 4.2 in their laptop/PC.

2. Signing up an account in questionwritertracker.com.

3. Creating their first computerized test by following the guide in the quick

tutorial book.

4. Verifying if the quiz worked properly.

47

After all the steps were done, the research moved on to the next phase. All

the teachers’ activities during the coaching phase was observed and resumed in

Phase 1 observation sheet.

3.5.2 Phase 2: Preparation for creating the test

The activities done in the preparation phase were:

a. Choosing the material for the reading comprehension evaluation.

b. Designing the computerized test for the reading comprehension evaluation.

c. Verifying if the quiz worked properly.

d. Try out the online database properly.

e. Uploading the quiz into the question writer tracker database.

f. Posting the quiz link on their own blog.

g. Verifying if the computer lab facility and the internet connectivity can

work properly.

After all the steps were done, the research moved on to the next phase. All

the teachers’ activities during the Preparation phase was observed and resumed in

Phase 2 observation sheet.

3.5.3 Phase 3: Implementation of the test

The activities done in the implementation phase were:

a. Gathering the students in the computer lab.

b. Ordering the students to open the blog from the computer.

c. Starting the evaluation all together.

d. Finish the evaluation within the time limits.

48

e. Verifying that the result of the evaluation has been collected in the question

writer tracker database.

f. Discuss the evaluation material together.

I observed the process of test and resumed it in phase 3 observation sheet.

3.5.4 Phase 4: feedback collection

In this phase, the teachers’ feedback on the use of the quiz maker

application was taken by using questionaires and interview. The questions asked

in the interview are:

1. What’s your opinion about the use of ICT in teaching?

2. What ICT media do you often use in class?

3. Can you tell me how do the students response to the use of ICT in your

class all this time?

4. What advantage did you get from using ICT in class?

5. Is there any difficulties in teaching using ICT? What are they?

6. What do you think the impact of using ICT in teaching and learning

activities?

7. Dou you have any experience dealing with quiz maker applications or

computerized tests before? Please tell me the detail!

8. What difficulties did you found in using Question Writer Quiz Maker to

create your test? Explain!

49

9. What benefits do you get from using Question Writer for testing? Explain!

10. Do you find any problems or difficulties in using Question Writer for

tests? What are they?

11. What did you do to overcome the problems?

12. In your opinion, does Question Writer can be utilized as an alternative test

for reading comprehension?

13. Is there any suggestion or advises for the application of Question Writer in

a test?

14. Which one do you choose, The Computerized test using Question Writer

or Paper Based Testing? Please, give your reason!

15. In your opinion, does this quiz maker is suitable to be used in teaching and learning activity?

3.7 Procedures of Analyzing the Data

50

In analyzing the data, there were several steps that should be administered.

The steps are as follows:

1. First, I interpret the notes and documents on the whole process during

designing the test using Question Writer quiz maker application.

2. Second, I describe the process of reading comprehension testing using the

computerized test.

3. Third, I analyzed the feedback of the teachers and from the students which

was taken using questionnaire. The result from the teacher’s questionnaire are

analyzed using the following formula:

N / NQ x 100 = P %

N = Total of “Yes” answers

NQ = Total of questions

P = Percentage

While the result from the students’ questionnaire is analyzed by this

formula:

NY / NS x 100 = P %

NY = Total of “Yes answers from all students on the specific question.

NS = Total numbers of students

P = Percentage