getting real about the impact of digital resources on learning (288383302)
TRANSCRIPT
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 1/45
Getting Real about the Impact of
Digital Resources on Learning
Julie Evans, Project Tomorrow, @JulieEvans_PT
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 2/45
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 3/45
“I think that students who used the (digital tool)
and performed well with the digital assignments
had a deeper understanding of the material.They did better on the class exams, engaged
more readily in class discussions, and had
interesting ideas about the topics.”
- Psychology Instructor
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 4/45
Today’s Discussion Topics:
About Project Tomorrow
Our research studies on digital resources
What we learned
More information
Your questions
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 5/45
About Project Tomorrow
Programs:
• Research & efficacy studies
• STEM education programs
• Advocacy for digital learning within
K-12 and higher education sectors
Internat ionally recogn ized education nonpro f i t organizat ion
www.tomorrow.org
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 6/45
About Project Tomorrow
Eff icacy Studies w ith in higher educat ion
o 7 separate mixed methods studies with 168 institutions
o Variety of institutions – public R1, private, communitycolleges, trade schools
o 185 instructors, 6,800 students
o
2/3rds of students rate their tech skills as averageo Partnership with Cengage Learning
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 7/45
About Project Tomorrow
Eff icacy Studies w ith in higher educat ion
o Variety of content discipline areas:• Business Law
• Chemistry• Computer Applications
• Developmental Math
• Psychology
o Variety of digital resources and Cengage products:• E-books• Homework support tools
• Student organizers
• Online curriculum
• Project based learning tools
• Supplemental digital content
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 8/45
About Project Tomorrow
Eff icacy Studies w ith in higher educat ion
o Standard methodology used in each study:
• Mixed methods with control and treatment groups• Pre and post surveys
• Student focus groups
• Instructor interviews
• Grades, test scores, homework grades• Other assessment measures
• Published study reports
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 9/45
About Project Tomorrow
Eff icacy Studies w ith in higher educat ion
o Key research question within each study:
What is the impact of the use of digital
tools, content and resources on the
learning experience?
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 10/45
5 key student outcomes that define the
impact of digital tools, content and
resources on the learning experience
What we learned
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 11/45
5 key student outcomes:
Increased engagement in content
Extension of learning process beyond
classroom
Development of workplace skills
Scaffolding for self-directed learning
Stronger self-efficacy for course success
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 12/45
5 key student outcomes:
Increased engagement in content
Extension of learning process beyond
classroom
Development of workplace skills
Scaffolding for self-directed learning
Stronger self-efficacy for course success
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 13/45
1. Increased engagement in content
oHow do instructors evaluate student engagement?
New engagement metr ics:
Quality of student work
Percentage of assignments completed
Class participation and attendance
Timeliness of assignment completions
In class attentiveness
Evidence of use of digital materials
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 14/45
1. Increased engagement in content
o Students’ perceptions on what would negatively
impact their course performance
Understand ing the relationsh ip between
performance and course work
Not understanding key concepts
Falling behind in course work
Doing poorly on tests, quizzes – not being well
prepared for those exams
Not doing homework *
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 15/45
1. Increased engagement in content
“(Digital tool) provided a way to track study
and homework. Without this tool, some
students would skip doing their homework and
earn lower grades. In my class, the digital
tools worked to improve student learning and
raise student quiz and exam grades overall.”
Business Law Instructor
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 16/45
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 17/45
1. Increased engagement in content
“The (digital content) within this course has
given me a personalized level of content and
helped me with my studying. It improved mycourse experience.”
StudentStudy within Psychology Courses - 2012
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 18/45
Double bottom line benefits
“Ensures that students get instant feedback
on whether they are solving problems
correctly or not. It gives them the practicethey need to be successful while saving the
instructor the burden of thousands of hours of
unnecessary grading work.”
Development Math Instructor
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 19/45
Increased engagement
Increased usage ofdigital content
Increased reported benefits
Better achievement results
The new engagement outcomes
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 20/45
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 21/45
2. Extension of learning process
Sample sequence of student behavior in a course
with a digi tal support too l :
Attend lectureRead textbook (digital or print)
Take pre-test to self-assess knowledge
Review personalized study plan
Do homework assignmentReview feedback
Attack areas where remediation is needed
Prepare for class discussion
Changes in student learning behavior – new paradigms
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 22/45
2. Extension of learning process
“(Digital tool) was very beneficial to me
because it made me sit down and slow down
my studying to really focus on what I was
learning. It increased my grade by creating
good study habits as well as learning the
material.”
Student
Study within Psychology courses - 2012
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 23/45
2. Extension of learning process
0% 10% 20% 30% 40% 50% 60% 70% 80% 90%
Go to class more
Better grades
Increased engagement
Better comprehension
Extends learning
Reinforces learning
Average Tech User Nontrad'l Comm College Females
Study within Computer Applications courses - 2014
Variations in how cohorts of students approach digital
learning benefits
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 24/45
2. Extension of learning process
“(Digital tool) was a great way to learn outside ofthe classroom. When a student does homework
from a textbook there’s no instant feedback to
help guide them or explain their mistakes which
means waiting to talk to a professor or waiting
until the next class to follow up.” Student
Study within Chemistry courses - 2013
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 25/45
5 key student outcomes:
Increased engagement in content
Extension of learning process beyond
classroom
Development of workplace skills
Scaffolding for self-directed learning
Stronger self-efficacy for course success
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 26/45
3. Development of workplace skills
Students identified workplace skills mostimportant to their future success:
Critical thinking skills
Problem-solving skills
Verbal communications
Leadership skills
Written communications
Computing skills
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 27/45
3. Development of workplace skills
0% 10% 20% 30% 40% 50% 60% 70% 80%
All treatment students
Male
Female
Traditional
Non-traditional
Face-to-face Class
Online Class
Average/Beg Tech
Advanced Tech
Agree Strongly Agree
“Digital solutions help me develop critical thinking skills “
Study within Business Law courses - 2014
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 28/45
5 key student outcomes:
Increased engagement in content
Extension of learning process beyond
classroom
Development of workplace skills
Scaffolding for self-directed learning
Stronger self-efficacy for course success
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 29/45
4. Scaffolding for self-directed learning
What types of self-directed learning isenabled by digital tools?
Students say:
o Practice
o Remediation
o
Tracking progress
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 30/45
4. Scaffolding for self-directed learning
Students: how often do you complete practice problems
using a digital homework tool when those problems are
not graded or assigned?
Always/Often 27%
Sometimes 44%Rarely 14%
Never 12%
I was able to learn outs ide of the classroom at my
own pace – 75% of s tudents agreed
Study within Developmental Math courses - 2013
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 31/45
4. Scaffolding for self-directed learning
“It was valuable when it came to exams.
Taking the online quizzes, using the glossary,
and using the flashcards helped me to learn the
materials much more and better prepare for the
exam as a whole.”
Student
Study within Psychology courses - 2012
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 32/45
4. Scaffolding for self-directed learning
Study within Developmental Math courses - 2013
42%
48%
7%
2% 1%
29%
44%
20%
3% 3%
Strongly Agree Agree Neither Agreenor Disagree
Disagree Strongly Disagree
Treatment Group Control Group
“I have the resources I need to be successful in this course.”
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 33/45
4. Scaffolding for self-directed learning
Study within Developmental Math courses - 2013
“I am able to track my progress during this course.”
32%
51%
11%
3%2%
20%
42%
22%
10%
3%
Strongly Agree Agree Neither Agreenor Disagree
Disagree Strongly Disagree
Treatment Group Control Group
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 34/45
5 key student outcomes:
Increased engagement in content
Extension of learning process beyond
classroom
Development of workplace skills
Scaffolding for self-directed learning
Stronger self-efficacy for course success
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 35/45
5. Stronger self-efficacy for course success
58%
67%
68%
70%
44%
53%
56%
59%
Less anxiety
More motivated
More confident
Develop workplace skills
Control Treatment
Study within Business Law courses - 2014
Results of using digital content within learning
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 36/45
5. Stronger self-efficacy for course success
“The value of using the (digital resources) was
that it reinforced that material for me and
helped me locate my weakest areas.
Therefore, I was able to understand what I
needed to study more clearly before the test.”
Student
Study within Psychology courses - 2013
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 37/45
About Project Tomorrow
Eff icacy Studies w ith in higher educat ion
o Key research question within each study:
What is the impact of the use of digital
tools, content and resources on the
learning experience?
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 38/45
Review: 5 key student outcomes:
Increased engagement in content
Extension of learning process beyond
classroom
Development of workplace skills
Scaffolding for self-directed learning
Stronger self-efficacy for course success
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 39/45
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 40/45
What we learned that can impact your p lans
2. For instructors to appreciate the value of digital
resources on student learning, instructors must
develop a personal value proposition with the tools
or content.
o Digital tools must demonstrate time savings for
most instructors to establish that value
proposition.
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 41/45
What we learned that can impact your p lans
3. Students’ expectations and aspirations for digital
learning are still evolving – and may surprise you.
o Higher education leaders and instructors need to
appreciate that students’ ideas should be a keycomponent of digital learning planning today.
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 42/45
About Project Tomorrow
Addi t ional informat ion and access to repor ts
f rom these eff icacy s tud ies
http://blog.cengage.com/cengage-learning-white-papers/
http://www.tomorrow.org/publications/publications.html
Want this presentation?
Sure, contact me at [email protected]
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 43/45
Your questions, comments, ideas
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 44/45
Thank you for the discussion today!
Julie Evans [email protected]
949-609-4660 x15Twitter: JulieEvans_PT
Copyright Project Tomorrow 2015
This work is the intellectual property of the author. Permission is granted
for this material to be shared for non-commercial, educational purposes,
provided that this copyright statement appears on the reproduced
materials and notice is given that the copying is by permission of the
author. To disseminate otherwise or to republish requires written
permission from the author.
8/20/2019 Getting Real About the Impact of Digital Resources on Learning (288383302)
http://slidepdf.com/reader/full/getting-real-about-the-impact-of-digital-resources-on-learning-288383302 45/45
Help Us Improve and Grow
Thank you for participating
in today’s session.
We’re very interested in your feedback. Please take
a minute to fill out the session evaluation found within
the conference mobile app, or the online agenda.