SKeVA©

IntroductionA Self Guided Tour of the A Self Guided Tour of the

SKeVA© System

Contact InformationContact Information Main email: skeva@tamu.edu

Phone: (979) 862-1151

SKeVA © : Science Keyword Vocabulary AssessmentVocabulary Assessment

What is SKeVA© ?

An online progress monitoring system of science key word vocabulary

An online data based method for making decisions about instructional practices

Who can use it? Specifically designed for 5th and 8th grade Has been used with students from 1st-12th grade Contains inclusive TEKS vocabulary Contains inclusive TEKS vocabulary

***Most state standards reflect national standards and have a great deal of overlap. Compare to your state by clicking the link (below) http://www.tea.state.tx.us/index2.aspx?id=6148

SKeVA © BackgroundSKeVA Background Sponsored by Texas Education Agency

and Texas A&M Universityand Texas A&M University Lead Researchers: Dr. Kimberly Vannest,

Dr. Richard Parker Project entering fifth year Has been used by over 15,000 students

d 500 f lt / t ff b and 500 faculty/staff members across Texas

What is Progress Monitoring?What is Progress Monitoring? Consists of frequent tests or check-ups

that provide feedback on the skills being that provide feedback on the skills being taught

Allows teachers to evaluate student learninglearning

Enhances ability to evaluate the effectiveness of instruction or interventions

Facilitates necessary changes to improve students’ academic progress

What is Progress Monitoring?What is Progress Monitoring? Conducted in an on-going fashion

I f i t ti Informs instruction Can be used to estimate rates of

improvement for each studentp Helpful to evaluate effectiveness of

instruction

Components of Effective Progress MonitoringProgress Monitoring

Well-defined target behavior or skill

Goal Graph progressbehavior or skill

A measurement strategy

Graph progress A plan for making

decisions Student’s baseline

level of performanceperformance

Intervention

Why Use Progress Monitoring?Why Use Progress Monitoring? Progress Monitoring, unlike Pre/Post

testing, allows you to assess the retention testing, allows you to assess the retention of materials over longer (6-12 weeks) periods of time

English and mathematics have used English and mathematics have used Progress Monitoring successfully for years

Science has struggled with incorporating i l l t d “ t ” it seemingly unrelated “autonomous” units

in Progress Monitoring

SKeVA© as a Progress Monitoring ToolMonitoring Tool

Research shows that keyword assessment is a valid and reliable measure of is a valid and reliable measure of retention and progress monitoring in science

SKeVA© is a free, online system available to teachers based on keyword assessment for progress monitoring in assessment for progress monitoring in science

Why Use SKeVA© ?Why Use SKeVA ? Provides instant, online feedback

regarding student performanceregarding student performance Save time by creating and grading

SKeVA© tests in seconds Use SKeVA© results to communicate with

district stakeholders and parentsM ti t t d t b i t h l Motivate students by using technology and instant feedback

Encourage struggling students to track Encourage struggling students to track their progress against self scores

Who Can Use it?Who Can Use it? Free to all teachers and district

administratorsadministrators Requires the use of a computer with

internet access Can also be accessed by mobile devices

such as iPads, smart phones, etc.A il bl 24 h d Available 24 hours a day

SKeVA© SystemSKeVA System 5th Grade

2500 it 2500 items 500 keywords Audio (Read Aloud) Support Audio (Read Aloud) Support Spanish Language Translations

8th Grade 1400 items 250 keywords

SKeVA© CreationSKeVA Creation Keywords were gathered from state

adopted textbooks supplemental adopted textbooks, supplemental materials, and through feedback with current teachers

Items (questions) were written for each keyword and edited for clarity, relevance, and importance in the curriculumand importance in the curriculum

Components of SKeVA©Components of SKeVA Adding Students and Classes

Creation of Tests

Test Reports

Supplemental Materials and Support

Test CreationTest Creation The first step is to decide between a

Progress Monitoring Test or a Pre/Post TestProgress Monitoring Test or a Pre/Post Test The two main considerations are: Length of Unitg U Amount of material within the Unit

Progress Monitoring vs. Pre/Post TestingPre/Post Testing

Pre/Post Progress Monitoring Test given at the start

and conclusion of a unit

Probes (tests) given periodically over a longer unit, 6-12 times

Represents content Represents content

learned in that specific unit

5 10 day unit

Represents content learned in a specific unit AND retained from previous units6 12 k it 5-10 day unit

Covers 10-14 Keywords in SKeVA©

6-12 week unit Covers 30-54 Keywords

in SKeVA©

Which one is right for me?Which one is right for me? Teachers are generally more familiar with Pre/Post

testing S ll k l it th t ifi Smaller, week-long units that are specific are better suited for Pre/Post Testing Insect Life Cycle Adaptations of Mammals Scientific Method

Longer, more comprehensive units can be g passessed with Progress Monitoring Chemistry Physics Physics Solar System

Which One is Right for Me?Which One is Right for Me? One of the benefits of SKeVA© is that it is

possible to use both assessments at the possible to use both assessments at the same time

Example of combined Unit: “Living Things”Things Progress Monitoring: Probe every week

for 8 weeks Pre/Post Tests: Mammals, Fish, Reptiles,

Amphibians, Birds

Training Set UpTraining Set Up In the following slides, you will find

screenshots with step by step instructions p y pon how to use the components of SKeVA©

Each set of instructions will be followed by t l t lid ith b d itt at least one slide with numbered, written

instructions in a simplified format for easy reference laterC t i © T t i l il bl ith li Camtasia © Tutorials are available with live captures of the SKeVA© system

HintsHints After each section you will find a slide with

helpful hints based on frequently asked helpful hints based on frequently asked questions

Although the SKeVA© system is relatively easy to learn, you may find it beneficial to print out or save a copy of this presentation for quick access laterpresentation for quick access later

Getting StartedGetting Started Log in using your username and password

S l t “M A t” i th i ht Select “My Account” in the upper right hand corner of the home screen

Adding ClassesAdding Classes Enter a desired username and password

E t l t ti b Enter class names one at a time by selecting “Add” after each class

Select “Update” when completeS Up p

Step by Step: Logging in and Adding StudentsAdding Students

1.) Log in using established username and passwordpassword2.) Select “My Account” in upper right hand corner of homepage3.) Change username and password if desired4.) Add classes one by one by selecting “Add” f h lfor each class5.) Select “Update”; the screen will not refresh but your changes will be savedbut your changes will be saved

Helpful HintsHelpful Hints It is much easier to add classes first, and

add students to those classes later rather add students to those classes later rather than vice versa

It may be helpful to add an additional “tutoring” class to your roster at this time; you can create additional practice tests for students who would benefit from extra for students who would benefit from extra exposure to materials and assign them to this class only

Adding StudentsAdding Students You only add students once to the

SKeVA© system each yearSKeVA© system each year Two options: Manual UploadUp Excel Spreadsheet Upload

The general rule of thumb is For 40 or less students, manual (one by one)

upload is more efficient For more than 40 students the mass upload For more than 40 students, the mass upload

with the Excel template is more efficient

Manual UploadManual Upload On the homepage, select

“Add/Edit/Delete Students” under Add/Edit/Delete Students under “Manage Users”

A drop down box listing your classes will appear on the left

Manual Upload (2)Manual Upload (2) Select “Add Student” for the class desired

A drop down menu with many fields will appear (see next slide)pp ( )

The only necessary fields are: First and Last Name Class Period PEIMS ID All other fields are optional

Manual Upload (3)Manual Upload (3)

Step by Step: Manual UploadStep by Step: Manual Upload1.) Select “Add/Edit/Delete Students” under

“Manage Students”Manage Students2.) Select desired class from drop down

menu on the left3.) Select “Add Student”4.) Enter student first and last name, class,

d PEIMS IDand PEIMS ID5.) Select “Add Student”

Helpful HintsHelpful Hints Certain versions of Internet Explorer are

incompatible with the adding students feature of SKeVA©

If you select “Add Student” and the screen fails to fully load (look at the green bar at fails to fully load (look at the green bar at the bottom of the screen), you are likely experiencing this difficulty

We suggest switching to Safari Mozilla or We suggest switching to Safari, Mozilla, or another version of Internet Explorer for adding students only; all other features of SKeVA© are unaffected

Excel UploadExcel Upload Select “Add/Edit/Delete Students” under

“Manage Users”Manage Users

Select “Upload Students” in the lower left hand side of the screen

Excel Upload (2)Excel Upload (2) Enter the following information in your Excel

document: First and Last Name PEIMS ID Class ID (should be automatically generated) Class ID (should be automatically generated) Gender Ethnicity

Save the document Select “Upload Students” and follow the listed

instructions

Step by Step: Excel UploadStep by Step: Excel Upload1.) Select “Add/Edit/Delete Students” from “Manage Users” on the homepagep g2.) Select “Excel Template” from lower left hand side of the Student Screen3 ) Complete spreadsheet by entering: first and last 3.) Complete spreadsheet by entering: first and last name, PEIMS ID, gender, and ethnicity (class is completed for you)4 ) Save the spreadsheet4.) Save the spreadsheet5.) Return to the student screen and select “Upload Excel Template”6 ) Follow the instructions to browse for your 6.) Follow the instructions to browse for your document and upload it to the SKeVA© system

Helpful HintsHelpful Hints While many other student data fields are

optional you or your district may find it optional, you or your district may find it useful to have this information listed for students (ex: free or reduced lunch, SPED,

t )etc.) The manual upload screen is where you

will be able to activate the Audio Support will be able to activate the Audio Support and Spanish Language translations

Helpful HintsHelpful Hints When adding students, you may come across an

error message stating that a student with that first/last name combination already exists in the first/last name combination already exists in the system

You can either create an individual name by adding a suffix or a prefix to that student’s name adding a suffix or a prefix to that student s name or add a universal suffix or prefix to all students names for ease of use Ex: Juan Lopez becomes Juan Lopez11; a Ex: Juan Lopez becomes Juan Lopez11; a

teacher would automatically add 11 to the end of all last names so that he or she would not have to remember which students had the have to remember which students had the unique suffix

Creating TestsCreating Tests Select “Create a New

Test” under “Manage gTests” on the SKeVA©

Homepage The following are

O ti l fi ld i l d g

required fields for test creation (Green): Cycle Type

Optional fields include (Orange): Instructionsy yp

Test Name Start Date & End

Date

Share test Timer

Date Classes Assigned

Test Creation FieldsTest Creation Fields

Creating Tests (2)Creating Tests (2) Once you have completed the required

fields, make sure you select the desired fields, make sure you select the desired classes by highlighting them with your cursor and then selecting “add”

Your selected class should toggle from the Your selected class should toggle from the left text box to the right

Select “Save and Continue” at the bottom of the screen

Creating Tests (3)Creating Tests (3) The keywords displayed can be narrowed down

by selecting either TEKS standards or objectives Any combination of TEKS and objectives can be

selected The SKeVA© team strongly suggests starting with

th ti k d b k d i i iti l t t ti the entire keyword bank during initial test creation sessions

To select from the entire bank of keywords, check each box next to the objectives at the top of the each box next to the objectives at the top of the screen

Select “Save and Continue”

Example of Selection CriteriaExample of Selection Criteria

Selecting KeywordsSelecting Keywords Guidelines:

10 14 k d f P /P t T t 10-14 keywords for Pre/Post Tests 30-54 keywords for Progress Monitoring

Tests Select keywords by checking the box next

to each keyword

Selecting KeywordsSelecting Keywords Notice the “Keyword Counter” in the

center of the blue bar above the center of the blue bar above the keywords; this counter will track your selections—there is no need to keep

t count as you go

Select “Save and Continue”

Example Keyword SelectionExample Keyword Selection

Progress Monitoring TestsProgress Monitoring Tests Progress Monitoring Tests have one additional field

that appears during test creation called “Number of Probes”of Probes

A probe is simply a progress monitoring test; A probe is simply a progress monitoring test; different terms are used to help easily distinguish between pre/post tests and progress monitoring

Enter the number of desired probes in this field, 6-12 12

Most users start with one probe per week and adjust as needed

Progress Monitoring Test Creation ScreenCreation Screen

Step by Step: Test CreationStep by Step: Test Creation1.) Select “Create New Test” under “Manage Tests”Manage Tests2.) Complete fields: Cycle Type, Test Name, Start and End Date, Classes3.) Select desired TEKS or Objectives, select “Save and Continue”4 ) S l t d i d k d l t “S 4.) Select desired keywords, select “Save and Continue”

Student View of TestStudent View of Test

Helpful HintsHelpful Hints Start and End Dates: The SKeVA© team

strongly suggests selecting today’s date strongly suggests selecting today s date as the start date and the last day of the school year as the end date for tests. Once the end date has past the test is Once the end date has past the test is inaccessible to students although results will be available for the teacher. Selecting the last day of the school year will ensure the last day of the school year will ensure that students have access to take the test even if absent, etc.

Helpful HintsHelpful Hints Number of Probes: Although as few as six

probes can be used with Progress probes can be used with Progress Monitoring, research suggests using as many as possible, up to twelve.

Selection Criteria: New SKeVA© users should start with general criteria as many TEKS do not have sufficient keywords TEKS do not have sufficient keywords associated with them to create an entire test

Helpful HintsHelpful Hints Share Test: Tests can be shared with other

teachers within your school (not within the di t i t) l if l t “Sh T t” same district) only if you select “Share Test”

during the creation process Timer: The test timer appears in the upper

right hand corner of student test pages; it right hand corner of student test pages; it counts up, will not limit students to a particular time frame, and will not record the time spent on the test. The timer acts as a visual reminder f th t d t d ll th t h t for the student and allows the teacher to determine, at a glance, how long the student has been working on any one test.

Helpful HintsHelpful Hints Error Messages: Occasionally you may

see the message “Test NOT CREATED see the message Test NOT CREATED, please click here to modify”

Follow the prompts back to the keyword selection screen and select additional keywords as needed to complete your testtest

Student AccessStudent Access Once your test has successfully created,

you can visit your homepage to allow you can visit your homepage to allow students to access the test.

Students must be given explicit access to their tests in order to take themtheir tests in order to take them.

This allows teachers to create tests for the entire school year without worrying that th i t d t ill tt t t t their eager students will attempt tests on material not yet covered.

Student Access(2)Student Access(2) On the SKeVA© homepage, scroll down to

“Upcoming Tests”Upcoming Tests Next to each created test is a field that

states “Student Access” Select “Yes” when you are ready for

students to begin that particular test

Student Access (3)Student Access (3) Many teachers choose to allow access at

the start of a particular school day or unitthe start of a particular school day or unit

Once granted, access cannot be denied O g ,to students

Editing Created TestsEditing Created Tests Select “Created Tests” under “Manage

Tests” on the SKeVA© homepageTests on the SKeVA© homepage

A list will appear with all created tests with the fields “Edit”, “Delete” and “View St d t St t ”Student Status”

Editing Created TestsEditing Created Tests Tests that have not been completed by

any students can be edited by selecting any students can be edited by selecting the “Edit” link

Tests that have had at least one student start them are locked to editing to ensure start them are locked to editing to ensure that all students receive equivalent tests

Teachers can view rosters of which t d t h l t d t t b students have completed tests by

selecting “View Status”

View Status Screen View Status Screen

Viewing Student DataViewing Student Data Student data is available in a variety of

formats within the SKeVA© systemformats within the SKeVA© system Data can be accessed as “Individual

Student Reports” or as “Class wide Reports

Reports are organized by overall percentage correct TEKS standards and percentage correct, TEKS standards and objectives, and keywords

Reports AvailableReports Available

Viewing Classwide ReportsViewing Classwide Reports Select “Class Gradebook Report” under

“Manage Reports” on the SKeVA©Manage Reports on the SKeVA©

homepage

Select applicable test name and class

Viewing Classwide ReportsViewing Classwide Reports Reports can only be viewed for one class

at a timeat a time Reports are initially presented as overall

percentage correct; use the blue links in the upper right hand corner to view data arranged in other formats

Report by Keywords (Numerical)(Numerical)

Report By Keywords(Bar Graph)(Bar Graph)

Report by Objective Report by Objective

Report by Grade (Numerical)Report by Grade (Numerical)

Report by Grade (Bar Graph)Report by Grade (Bar Graph)

Special Features: AudioSpecial Features: Audio The Audio, or Read Aloud feature uses a human

(not digital) voice to pronounce both the ( g ) pquestions and available answer choices

Students activate the audio by clicking on a black “play” button on the test screen next to each item p yor answer

Students can utilize the audio as often or as little as they prefer

Special Features: AudioSpecial Features: Audio The audio function ensures that science

content is being measured for struggling content is being measured for struggling readers (not reading level)

Available in 5th grade only Teachers assign the audio feature for

each individual student

Assigning the Audio SupportAssigning the Audio Support Select “Add/Edit/Delete Students” from

the SKeVA© homepagethe SKeVA© homepage

Select the desired class and student for Sthe audio support

Click on “Edit” next to the desired student

Assigning the Audio SupportAssigning the Audio SupportScroll to the bottom of the page and select

the box labeled “Audio Support”the box labeled Audio Support Select “Update”

Spanish Language SupportSpanish Language Support Spanish Language translations are

available for the 5th grade system onlyavailable for the 5th grade system only Like the audio, Spanish Language

translations must be activated for each individual student

Assigning Spanish Language SupportSupport

Select “Add/Edit/Delete Students” from the SKeVA© homepageSKeVA© homepage

Select the desired class and student for the SSpanish Language Support

Select “Edit”

Assigning Spanish Language SupportSupport

Scroll to the bottom of the available fields and select BOTH “ELL” and “Spanish and select BOTH ELL and Spanish Language Items are Displayed”

Select “Update”

Helpful HintsHelpful Hints Only activate the Audio or the Spanish

Language Support for each individual student; they are not designed to work together and will read Spanish items in EnglishEnglish

Consider using headphones for students with Audio Support

Remember to check both “ELL” and “Spanish Language Items are Displayed” if translations are desiredif translations are desired

Helpful HintsHelpful Hints Students should begin and end an entire

test series of progress monitoring probes or test series of progress monitoring probes or pre/post tests in one language

Ex: Students who take probe 1 in Spanish should take all additional probes in should take all additional probes in Spanish as well

When a new test is started, the teacher it h b t E li h d S i h can switch between English and Spanish

at will

Student Access to SKeVA©Student Access to SKeVA The student access portal is

skeva tamu edu/students (PLURAL)skeva.tamu.edu/students (PLURAL) Students log in with a username that is

automatically generated No passwords for students to remember

Student Access to SKeVA©Student Access to SKeVA If you had to make a name “unique” by adding a

suffix or prefix, this will be included in the username p ,as well

Print out a list of usernames by viewing the “Add/Edit/Delete” students link and usernames will / /appear in the class grid

We suggest keeping this list handy the first few times students access SKeVA©

Helpful HintsHelpful Hints If a student is having trouble logging on to

the SKeVA© system there are usually two the SKeVA© system there are usually two issues at fault:1.) The student did not properly log off2.) The student’s name has an almost

imperceptible space or character mistakenly inserted during the registration y g gprocess

Never fear—we have easy solutions to both!both!

Helpful HintsHelpful Hints SKeVA© utilizes a specific “Log Off” link in the

upper right hand corner of the screenSt d t t fi t i l hit th d “X” t l Students may at first simply hit the red “X” to close the screen, which may not register that they have logged offTh t ti th t d t tt t t l i th The next time the student attempts to log in, they will be blocked because the system believes they never logged outT h l ff t d t b i Teachers can log off students by accessing “Add/Edit/Delete Students” and selecting “Log off All Students”

Helpful HintsHelpful Hints When adding students, sometimes users

inadvertently insert a space before the first letter of a student’s name or a special character

These small variations can be all but invisible to the userTh t ill t ll th t d t t l ith The system will not allow the student to log on with this discrepancy in place

The teacher can reset the student’s username by accessing “Add/Edit/Delete Student” and re-accessing Add/Edit/Delete Student and re-entering the student’s first and last name, then selecting “Update”

Data Driven Decision MakingData Driven Decision Making What is data driven decision making?

H it i / t How can progress monitoring or pre/post testing help me make data driven decisions?

What are the most common decisions teachers make regarding lesson content?

What is Data Driven Decision Making?Making?

Data driven decision making is essentially exactly as it sounds:exactly as it sounds: The ability to form decisions regarding

lesson content based on quantitative data di t d t regarding student progress

Decisions in the classroom respond directly to individual needs, not to a directly to individual needs, not to a prescribed plan of teaching

How can SKeVA© help me make Data Driven Decisions?Data Driven Decisions?

SKeVA© provides instantaneous, quantitative data quantitative data

SKeVA© reports can be accessed by the individual or the class level

Sufficient detail is provided within the reports to facilitate decisions regarding future lesson contentfuture lesson content

Data can be compared across multiple time points in progress monitoringg g

What are the most common Data Driven Decisions?Data Driven Decisions?

Reteach Reteach

Remediate

Differentiate

Mastery

ReteachingReteaching Reteaching refers to presenting material

to the entire class or a large group an to the entire class or a large group an additional time

This can include: Material that should have been covered in

previous grades but was not retained Material covered in previous lessons that Material covered in previous lessons that

perhaps would be better presented in an alternative method (visual, audio, tactile, etc )etc.)

ReteachingReteaching Teachers who use data driven decision

making to select content for reteachingmaking to select content for reteachingoften only select the few concepts their students struggle with out of an entire lessonlesson

In the SKeVA© system, reports break down data by keywords, TEKS Objectives, and standards to allow teachers to easily and standards to allow teachers to easily and quickly assess which topics specifically the class continues to struggle with

ReteachingReteaching In the example to

the right many the right, many individuals continue to t l ith th struggle with the

content and the whole class could presumably benefit from reteaching

RemediationRemediation Remediation refers to offering tutoring or

specialized extra practice to individual specialized extra practice to individual students who continue to struggle with mastery while the rest of the class performs at acceptable levelsperforms at acceptable levels

The primary difference between reteaching and remediation becomes a question of numbers (How many students question of numbers (How many students would benefit from additional practice or instruction?)

RemediationRemediation Remediation at the individual level allows

teachers to individualize according to t d t d hil i t i i th t student needs while maintaining the most

efficient delivery of content to the class as a whole

Teachers can avoid reteaching a concept that most have already mastered by using SKeVA© data to mastered by using SKeVA© data to pinpoint struggling students and individualize “tutoring” or practice tests for additional exposure to content

Remediation ExampleRemediation Example In the example below, only one student

continues to struggle with the material continues to struggle with the material and would benefit from remediation

DifferentiateDifferentiate Differentiation refers to teaching in

different modalities (visual, audio, kinetic, different modalities (visual, audio, kinetic, etc) to allow students to process the content according to their own needs and preferencesand preferences

A teacher may decide to differentiate if he or she notices a pattern; for instance, if a student consistently scores well on tests a student consistently scores well on tests of content taught with pictures, this student may benefit from visual instruction

MasteryMastery Of course, the most delightful data that

SKeVA© provides is evidence that students t i d t i i t are mastering and retaining concepts

throughout the school year SKeVA© reports can provide data on SKeVA reports can provide data on

mastery of the TEKS Objectives, standards, and keywordsE id f t th t h Evidence of mastery assures the teacher that he or she can move on to additional content while still preparing students for p p gend of year assessments

MasteryMastery In the example below, students

demonstrate mastery of the topics demonstrate mastery of the topics assessed

Supplemental Materials & ResourcesResources

On the homepage, you will find additional resources including:additional resources including: Frequently Asked Questions Quick Start GuideQ S G Usage Instructions Helpful Hints SKeVA © grams Camtasia Tutorials

Thank youThank youWe hope you enjoy the SKeVA© system!

Please contact us at skeva@tamu.edu if you have any questions or if you would like y y q yadditional teacher accounts created for your school, district or region.