1

Instructional Innovation and Quality Year End Report FY 2019

Table of Contents Table of Contents 1

Appendices 2

Instructional Innovation and Quality (13.25 FTE) 2 IIQ Highlights 3 Total Number of IIQ Professional Development Events 4 Academic Technology (4 FTE) 4

Highlights 4 Academic Technology Training Events 4 Support Emails 5 Canvas: Active Academic Sections and Student Count 5 Adobe Connect 5 Academic Technology Workshops 6 Basic Online Course Check 6 Percentage of AT Workshop Hours by College/Organization 7

Distance Education (3.25 FTE) 8 Highlights 8

2

NMSU Online/ DE Website Inquiries 8 Distance Education Website Inquiries by College 8 DE Exam Proctoring 9 NMSU Online 9

Instructional Media Services (1 FTE) 10 Highlights 10 Teleconferences 10 Telecourses 10

Number of Events and DE Student Enrollments Hosted in FY19 12 Online Course Improvement Program (4.5 FTE) 13

Highlights 13 Professional Development Programs 13

Participation by Program 14 Participants by College 15

Professional Development Workshops and Hours 16 Workshops by Type 16 Workshop Attendance by College 17 Workshops Year-by-Year 18

Completions of Strategies for Teaching Online by NMSU Campus 19 IIQ/OCIP Partnerships 19

Quality Matters (.5 FTE) 20 Highlights 20 2016-2019 Implementation Progress (NMSU Las Cruces Campus Only) 20

Events 20 QM Activities 20

Appendices Appendix A: IIQ Presentations, Committees and Partnerships Appendix B: Academic Technology Appendix C: Distance Education Website Degree Program Contacts Appendix D: Exam Proctoring Appendix E: Instructional Media Services Appendix F: Online Course Improvement Program Appendix G: Quality Matters

Instructional Innovation and Quality (13.25 FTE) Instructional Innovation and Quality (IIQ) encompasses Academic Technology, Distance Education/NMSU Online, Instructional Media Services, and the Online Course Improvement Program. The unit focuses on administration of, and support for, delivering education via non-traditional formats of online, hybrid, and Interactive Television (ITV) as well as sharing best practices in online education through services, resources, workshops, and professional development programs (instruction.nmsu.edu). See Appendix A.

3

IIQ supports both the former New Mexico State University Strategic Plan Vision 2020 and the current Leads 2025 Strategic Planning Framework, as follows: Vision 2020 (plan.nmsu.edu), benchmarks as follows:

1. Academics and Graduation Provide stellar programs, instruction, and student services to achieve timely graduation. 1.B Promote, realize, and commend innovative and stellar teaching, learning, and leadership 1.B.1 Provost and Deans will provide educators with opportunities for professional development, training, mentoring, and networking supportive of exceptional teaching, learning, and leadership

Leads 2025 (https://nmsu.edu/LEADS/) Goal 1 Enhance Student Success and Social Mobility Objective 1.1 Diversify, optimize, and increase system-wide enrollment

H. Create and promote robust online learning programs (fully online degrees, blended programs, online courses, support services)

Objective 1.2 Increase student learning, retention, and degree attainment E. Expand options for curricular delivery to include fully online programs, blended programs, and online courses

Goal 4 Build A Robust University System Objective 4.2 Cultivate faculty and staff excellence

E. Develop professional development programs that foster academic and professional excellence and diversity.

Objective 4.3 Establish operational excellence through a metric-driven, service-oriented approach F. Value and promote customer service and continuous improvement and establish professional development and management training programs where and as needed

IIQ Highlights

● TurnItIn originality checker software integrated into Canvas (learning management system). ● Four $500 student technology scholarships awarded from the Steve Leask Memorial Technology

Fund - Bryan Ratel, Derrick Platero, Erycka Hufford Mazzi, and Joel Clymore. ● 58 online courses meeting Quality Matters Internal Review. ● Provided 203 professional development sessions. ● Awarded fifth “Leading the Way” award to Dr.Henrietta Pichon College of Education. ● Mentored 327 unique faculty through OCIP programs and services. ● 74 faculty and 8 administrations of Strategies for Teaching Online a two-week online course. ● NMSU Online, a one-stop portal for online/distance education programs offered system wide,

launched. ● NMSU Online flat per credit rates established for Undergraduate, Graduate, and Active Duty

Military students. ● Partnered with two ACES’ departments (FWCE and HRTM) on grant applications.

4

Total Number of IIQ Professional Development Events

Unit Events Participants Unique Hours

Academic Technology 125 493 231 772

Online Course Improvement Program 78 718 327 4547

Total 203 1211 558 5319

Academic Technology (4 FTE) Academic Technology (AT) supports a variety of educational technologies including Canvas, Adobe Connect, EvaluationKIT, Panopto, Respondus Lockdown Browser, i>clickers and Turnitin (learning.nmsu.edu). See Appendix B.

Highlights ● Hired 1 new Instructional Consultant (September 2018). ● Bryan Ratel, Derrick Platero, Erycka Hufford Mazzi, and Joel Clymore awarded the Steve Leask

Memorial Technology Fund. ● Partnered with OCIP on Course Development Summer

Ihttps://docs.google.com/document/d/1ZgQvi9zxzce5AUTkgwOMhsExK8Z_ho93KA2NhCaIVKs/edit?usp=sharingnstitute.

● Turnitin pilot and full release during the Spring - Summer 2019 semester. ● Learning.nmsu.edu page views for July 1, 2018 - June 30, 2019 were 52,542.

Academic Technology Training Events Year Canvas Adobe Connect i>clicker EvaluationKIT Panopto Tota

l 2018-19 146* 29* 12* 10* 1* 198*

2017-18 128* 15 5 3 0 151*

2016-17 97 9 2 2 0 110

2015-16 98 16 3 8 3 128

2014-15 90 15 3 7 3 118 *These numbers include all scheduled events and special sessions not in the NMSU Training Management System.

5

Support Emails Year Jun/Jul Aug/Sep Oct/Nov Dec/Jan Feb/Mar Apr/May Total 2018-19 628 2,856 1,297 1,702 1,444 1,091 9,018

2017-18 872 2,479 1,139 1,306 1,127 1,104 8,027

2016-17 725 2,253 1,222 1,555 1,662 1,234 8,651

2015-16 700 1,835 1,837 1,643 1,486 1,272 8,773

2014-15 653 1,551 955 1,086 946 943 6,134

Canvas: Active Academic Sections and Student Count Campus Courses Students

18-19 17-18 16-17 15-16 14-15 18-19 17-18 16-17 15-16 14-15

Alamogordo 554 579 553 593 610 3,624 3,702 3,761 4,094 4,481

Carlsbad 443 452 406 366 389 2,735 3,012 2,895 2,604 2,631

DACC 2,233 2,260 2.232 2,185 2,234 15,265 15,814 16,142 15,894 16,130

Grants 323 336 307 312 307 1,814 1,876 1,737 1,767 1,857

Las Cruces 4,464 4,591 4,601 4,580 4,483 28,637 29,712 30,626 31,784 32,450

NMSU Online 20 - - - - 150 - - - -

Total 8,037 8,218 8,099 8,036 8,023 52,225 54,116 55,161 56,143 57,549

Adobe Connect

Hosts Total Users Meeting Rooms

Total Meeting Time (hrs)

Storage (GB)

2019 Canvas Integrated 658 13,592 2,184 25,884 152.7

2018 Canvas Integrated 723 8,555 2,086* 15,831 101.7

2017 Canvas Integrated 621 1,877 2,251 10,692 75.2

2019 Named Host 30 3,766 193 7,372 54.3

2018 Named Host 78** 3,758 234 8,260 58.0

2017 Named Host 52 3,750 353 7,486 40.0 *Transition from Conferences integration to LTI changed meeting room best practices. Meeting rooms are now created once and re-used throughout the semester. **Number of host licenses was reduced to 30 in April, 2018 as a cost-saving measure.

6

Academic Technology Workshops Total Participants Unique Participants Number of Hours

2018-19 493 231 772

2017-18 448 219 741.5

2016-17 434 214 679.5

2015-16 537 285 674

2014-15 573 305 750

Basic Online Course Check Spring 2019 No. M7X-8X Courses No. Reviewed No. Meet No. Not Meet First Review (wk 3) 563 153 (27%) 72 (47%) 81 (14%)

Second Review (wk 6) 563 71 36 (51%) 35 (6%)

Fall 2018 No. M7X-8X Courses No. Reviewed No. Meet No. Not Meet First Review (wk 3) 532 124 (23%) 73 (59%) 51 (9.6%)

Second Review (wk 6) 532 37 12 (32%) 25 (4.7%)

Spring 2018 No. M7X-8X Courses No. Reviewed No. Meet No. Not Meet First Review (wk 3) 469 180 (38.4%) 112 (62.2%) 68 (14.5%)

Second Review (wk 6) 469 54 24 (44.4%) 30 (6%)

Fall 2017 No. M7X-8X Courses No. Reviewed No. Meet No. Not Meet First Review (wk 3) 477 175 (36.7%) 85 (48.6%) 90 (18.9%)

Second Review (wk 6) 477 90 57 (63.3%) 33 (6.9%)

Spring 2017 No. M7X-8X Courses No. Reviewed No. Meet No. Not Meet First Review (wk 3) 483 270 (55.9%) 178 (65.9%) 91 (33.7%)

Second Review (Wk 6) 483 91 46 (50.5%) 45 (14.5%)

Fall 2016 No. M7X Courses No. Reviewed No. Meet No. Not Meet

First Review (Wk 3) 451 310 (64.8%) 201 (64.8%) 109 (35.2%)

Second Review (Wk 6) 451 109 67 (61.5%) 42 (13.5%)

Spring 2016 No. M7X-8X Courses No. Reviewed No. Meet No. Not Meet First Review (Wk 3) 425 249 (58.5%) 55 (22%) 194 (78%)

Second Review (Wk 6) 425 194 188 (97%) 6 (2.4%)

The majority of courses checked were undergraduate courses. Courses that were not checked include dissertation, thesis, internships, clinicals, and graduate courses, as well as courses taught by faculty who have completed the Online Course Improvement Program professional development. Many courses lacked only one or two items from the Basic Online Course Check, such as the textbook ISBN and the expected instructor response time for communications. After the second check, an average of 14% of the courses still did not meet all the course check items.

7

The Basic Online Course Check information.

Percentage of AT Workshop Hours by College/Organization

Organization Attendance Count Hours

Agricultural, Consumer and Environmental Science College 47 73.5

ALCC Alamogordo Community College 3 6.5

Arts and Sciences College 119 187.5

Business College 52 80

CACC Carlsbad Community College 4 6

Chancellor Office 1 1

DACC Dona Ana Community College 81 119

Education College 61 97.5

Engineering College 36 56.5

Health and Social Services College 46 72

Information and Communication Technology 6 12

Library 6 9

New Mexico Dept of Agriculture 1 1.5

NONE 6 10.5

Provost Office 16 26.5

Student Success and Enroll Management 7 11

University Advancement Vice President’s Office 1 2

Total 493 772

8

Distance Education (3.25 FTE) Distance Education (DE)/NMSU Online provides a one-stop website to access information about the 68+ degree programs systemwide offered in non-traditional formats. Website email and phone inquiries are answered and directed to the appropriate contact person as needed (online.nmsu.edu). See Appendix C.

Highlights ● NMSU Online website launched representing 60+ online/DE programs available system-wide. ● NMSU Online Student Program Coordinator hired. ● Successful NMSU Online marketing campaign launched April 15, 2019. ● Partnered with three departments supporting development of their online programs - BS Fish,

Conservation Wildlife Ecology, MAs of Computational Data Analytics and Early Childhood Education.

● Added six online programs - 2 - BA/BS degree-completion programs BS in Geomatics and BA in Hotel, Restaurant, Tourism and Management; 3 MAT/MAE/MS degrees: Concentration in Spanish; Language, Literacy and Culture (Reading); Family and Consumer Sciences: Teaching, Research and Administration; 1 Graduate Certificate in Autism Spectrum Disorders.

NMSU Online/ DE Website Inquiries Year Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Total

2019 6 7 5 10 5 5 13 10 10 19 20 21 124

2018 11 9 4 8 6 8 13 8 5 14 10 8 104

2017 9 8 4 6 8 3 8 6 10 9 10 9 90

2016 11 12 8 6 14 6 10 7 9 17 5 7 112

2015 3 10 6 2 1 4 9 2 8 2 3 3 57

19.2% increase

9

Distance Education Website Inquiries by College Total BA MA/MS Ph.D

Ed.D Grad Certs

Endorsements, Licensure, Specialties

Courses

Gen.

ACES 6 5 1

A&S 30 12 10 8

BUS 17 14 3

EDUC 17 4 2 9 2

ENG 11 4 6 1

HSS 23 2 11 7 3

NMSU 20 6 1 2 11

Total 124 47 34 16 3 2 11 11

DE Exam Proctoring Exam proctoring is a free DE service provided to Las Cruces campus students taking an online course from another campus or institution and to students at a distance who need to have a proctored exam coordinated at an offsite location. See Appendix D.

Year Courses Students Exam Hours Total No. Instructors

2018-2019 Total 16 200 419 38

2018-2019 ProctorU 25 937 1390 25

2017-2018 Total 23 104 231.5 27 2017-2018 ProctorU 28 934 1357.75 33

2016-2017 Total 42 212 348.5 55

2016-2017 ProctorU 21 449 784.5 19 2015-2016 Total 26 176 324 28

2015-2016 ProctorU 7 76 125 7

2014 - 2015 Total 27 161 314 27 2014-2015 ProctorU 3 89 166 3

NMSU Online The NMSU Online Task Force (NMSUOTF) continued to meet regularly throughout FY19. In FY19, they met three times in Summer 2018, nine times in Fall 2018, seven times in Spring 2019, and four times in Summer 2019, for a total of 23 meetings. The NMSUOTF membership continued to evolve as needed. Currently, there are 40 members on the roster representative of the NMSU system stakeholders - central administration, academic leadership, community college campuses, faculty, staff, and students.

10

For FY 19, the NMSUO benchmarks include: ● August 2018 new|ed Program Search module purchase finalized. ● Fall 2018 the Website Committee conducts online/DE program survey systemwide. ● December 2018 the Board of Regents approves NMSUO flat rates per credit for Undergraduate

($348.25), Graduate ($369.10) and Active Duty Military ($250) February 2019 ● February 2019 the Student Program Coordinator started her position. ● February 2019 the NMSU Online website launched. ● March 2019 UO campus, UO program codes, and UO course seats/sections established. ● March 2019 NMSUO Point of Contact group starts regular meetings to support systemwide

communication and coordination. ● March-April 2019 the first group of online/DE programs and students transitioned to the NMSUO

campus. ● April 2019 NMSUO marketing campaign launched by MarComm with Converge Marketing, ● May 2019 NMSUOTF decided out-of-state students interested in online CC programs will remain

the students of the CCs. ● 265 UG applications for NMSUO - 39 ALCC,10 CCC, 30 DACC, 8 GCC, and 178 LC.

Instructional Media Services (1 FTE) Instructional Media Services (IMS) provides a variety of services for two-way video conferencing for distance education courses and meetings, video production services, and web conferencing. See Appendix E.

Highlights ● Expanded services to facilitate video conferences at Hadley Hall Room 130. ● Purchased Vadio HD Cameras, Array Microphones, and Bose Speaker System, to support

Distance Education via ITV. Installation is complete and ready to host telecourses and faculty/staff meetings.

● IMS provided on-site technical support for UFVA Conference hosted by NMSU Creative Media Institute at Milton Hall.

Teleconferences Year Number of Events Total Hours Facilitated 2018-2019 190 372

2017-2018 166 520.50

2016-2017 185 302.50

2015-2016 157 252.5

2014-2015 104 273

2013-2014 122 276

11

Telecourses Year Courses Colleges Departments Enrollments

2018-2019 22 4 5 566

2017-2018 26 4 7 746

2016-2017 25 3 5 845

2015-2016 31 3 5 1,110

2014-2015 25 3 5 743

2013-2014 22 3 6 968

12

Number of Events and DE Student Enrollments Hosted in FY19

Student Enrollment

13

Online Course Improvement Program (4.5 FTE) The Online Course Improvement Program (OCIP) provides support for faculty teaching blended and online courses. Opportunities include workshops, in depth professional development programs with stipends, an online course for effective teaching online, instructional design services, and online resources. OCIP supports quality in online/blended course design and NMSU Las Cruces’ Quality Matters subscription. See Appendix F.

Highlights ● Continued implementation of NMSU ARP Policy 4.69 requiring online courses to meet a QM

Internal Review. ● Mentored 115 faculty for quality online course development for a 21% increase from 2017-18

(95). ○ Served 72 faculty in 6 cohorts in Fall and Spring Course Development Institutes. ○ Hosted 43 faculty for 2 Summer Online Course Development Institutes.

● Offered 78 professional development events and generated 4547 professional development hours.

● Facilitated Strategies for Online Teaching course 8 times with 74 participants.

Professional Development Programs OCIP continues to evaluate and revise its professional development (PD) programming to best meet the needs of NMSU Las Cruces campus online instructors. Some highlights from FY19:

1. Initiated in 2018 and in accordance with the NMSU ARP 4.69 Academic Rules for Distance Education, successful completion of all OCIP PD programs is now contingent on an online/blended course meeting a QM Internal Review (NMSU Las Cruces campus quality metric). In FY19 the stricter policy has reduced completion rates. However, it will prevent courses from slipping through without truly meeting the LC campus quality metric for blended/online courses.

2. In order to serve more faculty, the year-long One-Year-Plus Fellowship (1Yr+) and New2Online(N2O) Programs were replaced in 2018 with the shorter 5-month Course Development Institute. CDI features a series of professional development workshops on instructional design topics designed to assist the faculty with developing or revising an NMSU-Las Cruces course to meet a QM Internal Review. In the Fall and Spring semesters, OCIP offered 2 CDI cohorts, one on Tuesday afternoons and the other on Friday mornings. Faculty were allowed to self-select their cohort.

3. OCIP instructional consultants continued to mentor faculty outside of a PD program, assisting them in the development of their online courses to meet the quality metric.

4. OCIP in partnership with Academic Technology facilitated two Summer Institutes (CDSI-SI1 and CDII-SI2). The SI format is very similar to the FY17 and FY18 SIs, but with the stricter completion policy in effect. SI1 was a two-week institute in May that assisted any faculty who were developing an online course. In addition to holding eight full-day professional development workshops, a separate OCIP-staffed computer lab was available for the duration of the institute. SI2 was a one-week institute in June 2019 for a specific group of COE Early Childhood Education online teachers developing or revising an online course to meet a Quality Internal Review.

14

Participation by Program

15

Program Applicants Participants Complete Incomplete N/A Percent

Complete

Summer 2 - Summer 2019

10 10 0 0 10 N/A

Summer 1 - Summer 2019

33 33 16 17 0 48.5%

Independent - Spring 2019

20 16 8 8 0 50.0%

Friday - Spring 2019

10 9 2 7 0 22.2%

Tuesday - Spring 2019

10 10 4 6 0 40.0%

Independent - Fall 2018

23 23 15 8 0 65.2%

Friday - Fall 2018

10 9 4 5 0 44.4%

Tuesday - Fall 2018

9 5 3 2 0 60.0%

Total 125 115 52 53 10 45.2%

Participants by College

16

College Participants Complete Incomplete N/A Percent

Complete

ACES 19 10 9 0 52.63%

A&S 15 8 7 0 53.33%

BUS 11 6 5 0 54.55%

EDUC 36 14 12 10 38.89%

ENG 12 4 8 0 33.33%

HSS 13 3 10 0 23.08%

LIB 0 0 0 0 --

Other 9 7 2 0 77.78%

Totals 115 52 53 10 45.2%

Professional Development Workshops and Hours

Workshops by Type

17

Type Attend % Attend Hours % Hours Events % Events

Coffee and Course Design 18 2.5% 18.0 0.4% 4 5.1%

Conference 75 10.4% 525 11.5% 1 1.3%

Course Development Institute 192 26.7% 1953 43.0% 25 32.1%

LTOT 95 13.2% 142.5 3.1% 6 7.7%

Quality Matters 52 7.2% 227.5 5.0% 8 10.3%

Self-paced Module 25 3.5% 25 0.5% 2 2.6%

Strategies for Online Teaching 74 10.3% 984 21.6% 8 10.3%

Summer Institute 32 4.5% 388 8.5% 1 1.3%

Webinar 53 7.4% 52 1.1% 11 14.1%

Workshop 28 3.9% 84.0 1.8% 11 14.1%

Other 74 10.3% 148 3.3% 1 1.3%

Totals 718 100.0% 4547.0 100.0% 78 100.0%

Workshop Attendance by College

18

College # Depts Attend

Count % Total Attend

Hours % Total Hours

Unique Attend

% Total Unique

A&S 17 107 14.9% 687 15.1% 44 13.5%

ACES 10 74 10.3% 527.5 11.6% 28 8.6%

BUS 5 70 9.7% 445 9.8% 20 6.1%

CC 36 120 16.7% 777 17.1% 91 27.8%

EDUC 6 110 15.3% 905 19.9% 53 16.2%

ENG 7 44 6.1% 295.5 6.5% 18 5.5%

HHS 4 65 9.1% 320 7.0% 26 8.0%

LIB 1 1 0.1% 3 0.1% 1 0.3%

Units* 25 127 17.7% 587 12.9% 46 14.1%

Totals 111 718 1 4547 1 327 1 *Units are NMSU-LC departments that are not associated with a college.

Workshops Year-by-Year

19

18-19 17-18 16-17 15-16 14-15 13-14

Events 78 98 53 63 51 67

Attendance 718 1237 486 757 399 486 Unique

Attendees 327 387 207 186 194 238

Hours 4547 5477 3400 2589 2895 2211

Completions of Strategies for Teaching Online by NMSU Campus

Year Alamogordo Carlsbad Doña Ana Grants Las Cruces Total

2018-2019 0 4 16 1 53 74

2017-2018 4 2 13 1 72 92

IIQ/OCIP Partnerships In 2019, IIQ partnered with Fish, Wildlife Conservation and Ecology on a National Science Foundation - Hispanic Serving Institution grant application with Dr. Martha Desmond as the Principal Investigator. IIQ/OCIP provided a Letter of Support and agreed to provide faculty professional development,

20

mentoring, and stipends to complete the development of the Bachelor of Science in FWCE as an online degree-completion degree. IIQ/OCIP also provided a Letter of Support for HRTM’s grant application submitted by Dr. Betsy Stringam agreeing to provide faculty professional development, mentoring, and stipends for the online MA HRTM.

Quality Matters (.5 FTE) OCIP manages NMSU’s Quality Matters (QM) Statewide subscription (qmprogram.org.). OCIP provides QM informal and formal course reviews, QM training for faculty, and support for faculty to become QM certified. See Appendix G.

Highlights ● 58 online courses met a Quality Matters Internal Review. ● One online course met a Quality Matters Formal Review. ● Continued partnership with four NMSU Community Colleges on a QM Statewide Subscription. ● FY19 marks the third year completion of 2016-2019 Three Year QM Implementation Plan formally

approved by the Provost and the QM Academic Committee.

2016-2019 Implementation Progress (NMSU Las Cruces Campus Only)

Events

Type Progress Percentage of Completion

Outstanding

Applying the QM Rubric 118/100 100% 0%

Peer Reviewers 18/30 60% 47%

Master Reviewers 8/12 67% 13%

Informal Reviews 220/100 100% 0%

Formal Reviews 22/36 61% 39%

QM Activities

Type 2019 2018 2017 2016 2015 2014

QM Formal Course Reviews 1 6 9 10 10 8

Internal Course Reviews 58 55* 46 30 26 N/A

Peer Reviewer Certifications 1 2 9 11 3 15

Master Reviewer Certifications 0 0 1 7 3 3

APPQMR Participants 16 55 55 49 36 11

*Total of 52 reviews for 2017-2018 program with 3 reviews for 2017-2016 program being completed in 2017-2018 fiscal year.