Jose Luis SanchezAugust 20, 2016

Liberty UniversityEDUC798

Dr. Russ Yocum

Note: This presentation was part of an assignment submitted to Liberty University and should not be copied or reused.

Research Methodology of the Perceived Reliability of High Stakes Testing (HST)

Without Test Preparation Using 21st Century Technological Advancements

The purpose of this research study is to test the reliability of using 20 th century summative

assessments without the use of 21st century test preparation methodologies (Beckers, Dolmans, &

Merriënboer, 2016). Rote memorization of the unquantifiable information needed to excel in the 21st

century does not build the empowerment our students need to sustain, protect, and improve our way of

life (113th Congress, 2014). This research study delves on a twofold principle, to uphold our American

Education Laws and to assist education systems in need of improvement, by demonstrating how 21st

century technological methodologies help meet and exceed the mandates of education and performance

accountability behind NCLB (Commission of No Child Left Behind: The Aspen Institute, 2016).

Introduction

Image Retrieved from: Http://cn.bing.com/images/search?q=a+picture+of+a+student+worried+about+a+math+test&view=detailv2&&id=ADAB1D81190B59CF9D39EF07DE77051E0A2FFA0C&selectedIndex=16&ccid=mr7db6BK&simid=608033732334587457&thid=OIP.M9abedd6fa04a16928112f1dc3f7d64ceo0&ajaxhist=0

Other Benefits of this Research Study Teachers can become co-researchers (Beckers, Dolmans, & Merriënboer, 2016)

Can increase a “measure of teacher competence” (Kubiszyn & Borich, 2013, p. 18)

Can facilitate the use of formative evaluations that helps teachers stay informed on the “day-to-day instructional

decision making" (Kubiszyn & Borich, 2013, p. 4)

Is non-intrusive and provides fast feedback of students’ performances to teachers

Makes use of the wealth behind data collection mechanisms accepted by the California Assessment of Student

Performance and Progress (CAASPP) (California Department of Education, 2016)

Focuses on a student population “poverty level” below 14% with a “high school completion” rate of 77% (Gall,

2010, p. 266)

Teachers, Researcher, Co-researchers, and Students receive professional support from two Education Specialists

in the subjects of English and Mathematics (Lipscomb University, 2016)Image Retrieved from:http://cn.bing.com/images/search?q=picture+of+education+working+together&view=detailv2&&id=A40BD87580904E15BBA2800437023750FB8192BC&selectedIndex=25&ccid=rSUXcFOO&simid=607994386143251586&thid=OIP.Mad251770538e7229d92be8e4a1ebae45o0&ajaxhist=0

The Researcher assumes being able to secure a study research grant from (U.S. Department

of Education, 2016) and permission to conduct the study by an appropriate review board

Teachers and Students have access to a computer network and have devices capable of

accessing the Internet (i.e., cell phone, tablet, portable computer)

The education district leadership where this research will take place is willing to follow

state mandated curriculum standards for the duration of the study for one high school year

Research Design Assumptions

Image Retrieved from:http://cn.bing.com/images/search?q=picture+of+the+Holy+Spirit+Presence&view=detailv2&&id=1D4756D07DD6C545325BE94150BCACAD614DA8D8&selectedIndex=99&ccid=8iypHbwV&simid=608010921754300163&thid=OIP.Mf22ca91dbc152542700ca5393cdadea8o0&ajaxhist=0

Literature Reviews

Relying on High-Stakes Standardized Tests to Evaluate Schools and Teachers (Morgan, 2016)

Further study on high stakes testing anxiety at school districts located in impoverish areas are

needed (Brom, 2016)

A Phenomenological Study of Middle School Teachers Implementation of Formative Assessment

Practices in a Semi-Rural Northwest Georgia District (Thacker, 2016)

e-Portfolios Enhancing Students’ Self-Directed Learning (Beckers, Dolmans, & Merriënboer,

2016)

Image Retrieved from: http://cn.bing.com/images/search?q=picture+of+a+literature+review&view=detailv2&&id=B7CF848CB525FF82A4AEA5FF96C37535CDC120EE&selectedIndex=0&ccid=H91JQjQs&simid=608035905578796712&thid=OIP.M1fdd4942342c4982191a14882a5a41d0o0&ajaxhist=0

Research Study Hypotheses

• Hypotheses:• Teachers that employ e-Portfolios as part of their homework methodology help students score

higher in their state mandated summative evaluations (California Department of Education, 2016)

• Null Hypotheses:• There is no statistical significance on students state mandated summative evaluations scores

(California Department of Education, 2016) by employing e-Portfolios as part of their homework

methodologyImage Retrieved from:http://cn.bing.com/images/search?q=picture+of+a+hypothesis+and+null+hypothesis&view=detailv2&&id=5DC64556585BF5C30B509535894C84008491BB9B&selectedIndex=52&ccid=YakSeTVf&simid=607995842133755963&thid=OIP.M61a91279355fa1aefe0ec7458c55785co0&ajaxhist=0

Research Design Pilot

• A pilot study will be conducted lasting no longer than 30 days to assess the amount

of instruction needed to teachers and students on accessing and using e-Portfolios• Rules of conduct

• State and district policies on the usage of government owned computers and technology

• Formulating student and teacher expectations and informed consent

• Plagiarism guidelines

• All students learn initiative (Commission of No Child Left Behind: The Aspen Institute, 2016)

• Creating an e-Portfolio member account (Foliotek, 2016)Image Retrieved from:http://cn.bing.com/images/search?q=Pictures+of+guidelines+using+computers&view=detailv2&&id=C1FB1028F52EE7F9527FDD1557A92E77F0F14FA1&selectedIndex=160&ccid=bAIlTjIf&simid=608035622114757898&thid=OIP.M6c02254e321f6be6b53906429da7d4f6o0&ajaxhist=0

Research Design Proposal

Image Retrieved from: http://cn.bing.com/images/search?q=picture+of+a+research+design&view=detailv2&&id=5087A56509051D016807677D04D2C899FD07E0DF&selectedIndex=4&ccid=Q6cJsKoO&simid=608045539190505751&thid=OIP.M43a709b0aa0e47b5a36a78ad9310fdefo0&ajaxhist=0

• A nonexperimental correlational research will be used for this study in four English and four

Mathematics classes taught by the same instructor respectively, selected at random from a high

school in an impoverished district in California (Gall 2010) that uses a state mandated curriculum

objectives (California Department of Education Publication, 2014)

• Four classrooms (i.e., two English and two Mathematics) will remain controlled using the current

methodology for homework assignments

• Four classrooms (i.e., two English and two Mathematics) will use the e-Portfolio methodology

(Foliotek, 2016) for homework assignments monitored by two co-researchers Ed. S. (Lipscomb

University, 2016)

Research Design All Groups Top View

Images Retrieved from: http://cn.bing.com/images/search?q=Students+Taking+Exams&view=detailv2&&id=FB97AA7F1B957E49533CC3E4B392097BFE22B165&selectedIndex=109&ccid=ql8xl%2bk0&simid=608023677811887303&thid=OIP.Maa5f3197e934b42c1242d45998d61cf1H0&ajaxhist=0

Ed. Specialist English

e-Portfolioe-Po

rtfol

io

Ed. Specialist Mathematics

Research Design Data Collection

Image Retrieved from: http://cn.bing.com/images/search?q=picture+of+a+data+collection&view=detailv2&&id=77347EE7D2835A6D99700D111654743B7D53F82F&selectedIndex=16&ccid=zFBERQDw&simid=607996808501266516&thid=OIP.Mcc50444500f013c5fb93d9853502ddcfo0&ajaxhist=0

• Current school district student assessment for formative and/or summative evaluations grading

systems are sufficient for this research and will be replicated through the eight school district classes

participating in this study

• Data collection from grades and performances of students using e-Portfolios homework assessment

methodology will obtain a pass/fail assessment and students who fail will obtain remedial instruction

by the appropriate Education Specialist

Research Design CompletionThree Distributions for Correlation

Image Retrieved from: http://cn.bing.com/images/search?q=picture+of+a+correlation+study+data+collectrion&view=detailv2&&id=EFC92D667E719836D7A4A9EBC1FEF62E38BAD567&selectedIndex=45&ccid=s0RDYE4N&simid=608031786716430375&thid=OIP.Mb34443604e0d0ed446f88f7356abdd18o0&ajaxhist=0

• Data from students in the control group will be correlated with data from students using e-Portfolios

• Data from students in the control group will be correlated with data from their assessment through

states standards (California Department of Education, 2016)

• Data from students using e-Portfolios will be correlated with the data from their assessment through

states standards (California Department of Education, 2016)

Research Design Workflow for Students Using e-Portfolios

S11

S2

S S S4S

S S S S S8

If students do not make corrections to their original or subsequent journals, the Ed. Specialist informs the teacher before the next class.

Students who post in e-Portfolio are able to see peer postings after their initial post. Students can add to their initial post to make corrections to their original post.

If students meet lesson objectives, the Ed. Specialist Assign a Passing grade

If the students attain part of the lesson but do not make corrections to journals, they receive a pending revision or fail and the Ed. Specialist asks them to look at a peer’s work

Teachers receive weekly summary and daily reports when students do not meet lesson objectives, to optionally enact group work, peer tutoring, or differentiated instruction

The Teacher Interacts with Students during Class and Assign Students to Reiterate Lessons Learnt through Journals Utilizing e-Portfolios after Class

An Ed. Specialist in English and/or Mathematics Reviews Students Journals

Students Write Lessons Learnt in Journals after Class and Before the Next Class

e-Portfolio Interface Program

The use of e-Portfolio is synonymous to the system that schools in Finland use to keep track of students’

homework, provide feedback, and create differentiated instruction when students need it (Beckers, Dolmans, &

Merriënboer, 2016) A myriad of empirical research studies helps create a sound learning environment for all students and lack of

money is no longer a problem (Foliotek, 2016) Paper and pencil homework methodologies are now complemented by 21st century technological advances

(Beckers, Dolmans, & Merriënboer, 2016) Teachers want to work with state standards and are willing to do it if they get the help they need (Lipscomb

University, 2016) Reflecting on what is learnt on a daily basis through e-Portfolios helps build critical thinking empowerment

(Beckers, Dolmans, & Merriënboer, 2016) and is a biblical principle (Isa. 1:8 NIV)

Research Design Summary

Image Retrieved from:http://cn.bing.com/images/search?q=picture+of+a+research+summary&view=detailv2&&id=6679861BE6529E5833F9E24056F9FAFB490D0103&selectedIndex=146&ccid=fBYul8e0&simid=608023737938149413&thid=OIP.M7c162e97c7b4f6ad7dfeb647a071ae1eo0&ajaxhist=0

References

113th Congress. (2014, July 14). H.R.5031 - 113th Congress (2013-2014): STEM Education Act of 2014 |

Congress.gov | Library of Congress. Retrieved August 6, 2016, from Congress.gov:

https://www.congress.gov/bill/113th-congress/house-bill/5031/text

Beckers, J., Dolmans, D., & Merriënboer, J. V. (2016). e-Portfolios enhancing students’ self-directed learning: A

systematic review of influencing factors. Australasian Journal of Educational Technology 32(2), 32-46.

doi:10.14742/ajet.2528

Brom, M. W. (2016). A correlational analysis of test anxiety and response time on a computerized adaptive math test

among seventh grade students (Doctoral dissertation). Retrieved from

http://digitalcommons.liberty.edu/doctoral/1185/

California Department of Education. (2016). CAASPP Student Score Report Information - California Assessment of

Student Performance and Progress (CAASPP) System (CA Dept of Education). Retrieved August 18, 2016, from

http://www.cde.ca.gov/ta/tg/ca/caasppssrinfo.asp

California Department of Education Publication. (2014). No Child Left Behind assessment requirements - Taking

Center Stage - Act II (TCSII) (CA Dept of Education). Retrieved August 18, 2016, from Cde.Ca.gov:

http://pubs.cde.ca.gov/tcsii/ch2/nclbassessrequire.aspx

Commission of No Child Left Behind: The Aspen Institute. (2016). Improving achievement for all students: Is

NCLB accountability producing results? Georgia Institute of Technology, 1-8. Retrieved August 18, 2016, from

http://www.aspeninstitute.org/events/2011/03/22/teacher-evaluation-accountability-support-lessons-leading-

efforts

Foliotek. (2016). Dashboard - FolioSpaces. Retrieved August 4, 2016, from Foliospaces.org:

https://www.foliospaces.org/

Gall, M. D. (2010). Applying educational research: How to read, do, and use research (6th ed.). Boston: Pearson

Education.

Kubiszyn, T., & Borich, G. D. (2013). Educational testing & measurement: Classroom application and practice

(10th ed.). Hoboken: John Wiley & Sons, Inc.

Kubiszyn, T., & Borich, G. D. (2013). Educational testing & measurement: Classroom application and practice (10th ed.).

Hoboken: John Wiley & Sons, Inc.

Lipscomb University. (2016). Ed. S. in English language learning coursework - College of Education | Lipscomb University.

Retrieved August 18, 2016, from http://www.lipscomb.edu/education/eds-in-english-language-learning-coursework

Morgan, H. (2016). Relying on high-stakes standardized tests to evaluate schools and teachers: A bad idea. The Clearing House

89(2), 67-72. doi:10.1080/00098655.2016.1156628

U.S. Department of Education. (2015, December 10). Every Student Succeeds Act (ESSA) | U.S. Department of Education.

Retrieved August 18, 2016, from Ed.gov: http://www.ed.gov/essa

U.S. Department of Education. (2016). ED-GRANTS-080816-001 Office of Elementary and Secondary Education (OESE):

Enhanced Assessment Instruments Grant Program. Retrieved August 20, 2016, from Grants.gov:

http://www.grants.gov/search-grants.html?fundingCategories%3DED%7CEducation