1. intro & welcome 2. updates – technology, curriculum partners, product updates - skills pointer,...

1. Intro & Welcome 2. Updates Technology, Curriculum Partners, Product Updates - Skills Pointer, DesCartes, Science, Field Testing, Knowledge Academy 3. Wisconsin Updates: WKCE Alignment, New Norms 2015 4. Special Feature: MAP & STAR: Whats the Difference? LUNCH Afternoon Breakout sessions Wisconsin MAP Members Mtg. Oct. 29, 30, 31 - 2013

Afternoon Sessions 12:30 to 1:15 S1 Using RIT Norm Calculators: Setting Goals at All Levels Dan Henderson S1Bring Your Data Bring Your Questions Eric Merchant & Lynn Lamers S1 Compass Learning Odyssey Demo Mike Geers and Becky Blink 1:30 to 2:15 S2College and Career Readiness: Tracking Growth toward Post H.S. Success John Woodin S2MPG/CPAA Assessing the Learning Needs of Primary Age Students Lynn Lamers & Eric Merchant S2 Compass Learning Odyssey Demo Mike Geers & Becky Blink

Wisconsin NWEA Team John Woodin Account Executive for Wisconsin, Iowa, Illinois [email protected]@nwea.org (Dubuque, Ia.) Lynn Lamers Account Manager for Minnesota & Wisconsin [email protected] (Minneapolis) [email protected] Eric Merchant Account Manager for Minnesota & Wisconsin [email protected] (Modesto, Ca) [email protected] Linda Andres - Account Manager for Minnesota & Wisconsin [email protected] (Portland, Or) [email protected] Dan Henderson Central Region Accounts Manager (Iowa, Wisconsin, Minnesota, Illinois, Missouri, Kansas, Nebraska) [email protected] [email protected] (Washington, Ia.) General Number: 503.624.1951 Tech Support: 877-469-3287

Special Guest: Mr. Matthew Hicks Director of Product Strategy Forming a Partner Advisory Panel Matt previously served as the Senior Product Manager for NWEAs MAP assessment product line. In his current role Matt is responsible for leading the strategy for NWEAs growing product portfolio, ensuring that each of NWEAs products is aligned with NWEAs mission of helping all kids learn. Before joining NWEA, Matt worked in high-tech, market research, secondary education and eCommerce where he successfully developed and launched over a dozen products. He developed his deep interest in education from his wife, a first grade teacher of 12 years. Matt graduated from Sheffield Hallam University in England and now lives in Portland Oregon with his wife and two dogs.

Special Guest John OHair John O'Hair Vice President & Chief Technology Officer John O'Hair joined NWEA in 2012 and brings over 20 years of experience in technology products for K-12 education. Prior to NWEA, John led the technology teams at eInstruction Corporation building interactive whiteboards, classroom "clickers," and iPad applications for schools world- wide as their Chief Technology Officer. Previous to that, John was the Chief Technology Officer of Scantron Corporation where he was responsible for software and hardware development providing software solutions for both the educational and commercial market places. John joined Scantron in 2002 after the acquisition of EdVision where he served as CTO and co-founder of EdVision Corporation for 12 years managing the educational software product development. He consistently creates customer-centric "best of breed" educational products that are used in schools nation-wide

Special Guest: Mr. Jeff Strickler, Executive Vice President and Chief Operating Officer Jeff joined Northwest Evaluation Association (NWEA) in 2007. In addition to his role as Chief Operating Officer, Jeff also serves as NWEA's CFO and Vice President of Corporate Services. Jeff brings to NWEA more than 20 years of experience helping organizations attain their goals, first as an attorney at Perkins Coie and later in various leadership roles at notable Northwest companies, including CFI ProServices/Harland Financial System, Vesta Corporation, Centrisoft Corporation and CakeBoxx LLC. At CFI ProServices, Jeff was Vice President and General Counsel from 1994 through its acquisition by Harland Financial Services Systems in 2000. He was the Vice President of Finance and Administration at Vesta Corporation during a critical time in that company's expansion. Jeff has served as the Chief Operating Officer at both Centrisoft Corporation and CakeBoxx LLC, a startup company engaged in developing a new, more secure design for international shipping containers. Jeff received a B.S. in Business Administration from Oregon State University in 1982 and J.D. degree from the University of California at Berkeley (Boalt Hall) in 1985.

Technology: The Good, The Bad & The Ugly (and the beautiful) CLIENT-SERVER MAP - Good System in use since early 2000s Archive your previous term data located in the NTE folder. Submit your Class Roster File (CRF) at least two weeks in advance of testing. If applicable, also submit your Special Programs File (SPF) Client-Server performance has been good this year tech calls are mostly of the how-to variety Process for transitioning to Web MAP contact your account manager most likely not this school year

INTERNET ACCESS Technology Happens

Mobile Devices? Performing Well - Good iPad Implemented this Fall (Not MPG) Chromebooks? YES

Web Based MAP Update Ugly Start This Year Many of you experienced interrupted or suspended testing because of multiple technical problems in MAP - early to mid-September hardware failures in network equipment resiliency failures degraded performance due to anomalous traffic generated by the changing patterns of testing Long wait time on tech support line Heavy concurrency load at certain times of the day 8:30 to 10:00 am NOT the optimum partner experience that we want to provide Hard to determine issues locally when we are having issues Resulted in delayed testing; drawn out window; stops and starts; less than stellar results

What We Have Done What We Will Do WHAT STEPS HAVE WE TAKEN? We replaced hardware and audited our network configuration; we then asked Cisco to confirm the configuration and health of our system We strengthened our solutions to automatically switch to redundant systems in case of failure; this work was confirmed with third party experts. We expanded our hardware and systems infrastructure to increase the overall processing power available to MAP assessment We temporarily delayed end-of-test reporting until end of day to optimize students testing experience. Students will still immediately receive their reports at the end of the testing session. As we made these changes we asked many of you to suspend or delay testing for one or more days. This allowed us to ensure the changes we made fully solved the problems

Still An Issue Safari & MAC OS systems MAC OS 10.5.8 and 10.6.8 devices causes the Lockdown Browser to shut down automatically when using MPG tests While we work to resolve this issue, we have made it possible for users of these Mac OSs to request temporary access to be able to test using Firefox rather than using the Lockdown Browser If you would like to use Firefox and temporarily not be required to use the Lockdown Browser, please contact tech support We are currently working to optimize our test items and technology to work within the limits of Safari. We are consulting with Apple on how best to address this issue as we do this work

NEW! Web MAP Update Website Better Communication Process http://www.nwea.org/node/18860/ Latest Tech Updates (no calling required) Hour by Hour Updates on the Technical System at NWEA Alerts will be posted in real time Technical reminders for local configuration Notices of future maintenance windows

Questions from Partners ? Are Results Valid when students had to stop and restart? (see letter from research team) Research team analyzed about 100,000 test results of students that were interrupted. From our findings, we are confident the scores are valid and that the MAP test behaved as designed in spite of unintentional interruptions

CRITERIA TO DETERMINE SCORE VALIDITY 1.Time on test less than 30 minutes are suspect 2.Standard Error of Measure (St Err) more than 4 points is suspect 3.Percent correct for the test: Normal = 45% to 55% correct Students getting less than 45% to 40% correct will be suspect These data are all on the Comprehensive Data File aka, the Data Export Scheduler

Partner Questions If we had to delay our test window to later in the fall, will the norms still apply? (see letter from Mike Nesterak Director of NWEA Research Services) It is recommended that districts not delay beyond the eighth week of instruction for their fall MAP test administration. Testing within these first eight weeks should have no material impact on the fall-to-spring RIT growth.

Partner Questions Since the Web MAP system had problems this year, will we receive any compensation? Yes, we will work with districts one on one to determine a fair compensation.

Check List for Technology on District Side Check the Whitelist: If your district/school is experiencing intermittent slowness, white screens, or the inability to click on various buttons when testing, please ensure that you have whitelisted *.mapnwea.org on equipment that sits between the testing machine and NWEA servers.mapnwea.org Double Check That You Are Using the LATEST Version of the Lock Down Browser - Latest version was released on Aug. 28. If you did not download that browser, Web MAP will not be compatible Check Internet Usage During Testing Hours - your district may have plenty of bandwidth, but if people are using the internet during testing hours, the bandwidth requirements may not meet the need for testing. Check the Tech Requirements for Using Compatible Browsers Chrome, Safari (NO INTERNET EXPLORER) Use the Proctor Console Issues Quick Guide - If students are stuck dont panicuse the guide and a few key strokes.

BIGGEST CHANGE.. No New Migrations to the Web Based System This School Year will open again for Fall 2014

Product Updates: Skills Pointer for Progress Monitoring & DesCartes (Fall 2014) What Will Be New with DesCartes? Interactive learning continuum Student-Teacher Friendly language Ability to create Data-Ladders for Differentiated Instruction

What are our Partners Saying? Our teachers give up on it pretty quick. Its become a hurdle. Its too intense and stymies the teachers and detracts from the value of MAP. intimidating and takes too much time. The statements dont appear to be directly based on the CCSS.

The vision for a future DesCartes addresses the specific limitations of the current offering, including the following: Teacher and student friendly content that clearly describes a learnable skill or understanding Improved organizational structure providing options of sorting Learning Statements by Topic and Standard in addition to Sub-Goal Interactive and customizable reporting capabilities & features support instructional planning Ability to link to external resources including lesson plans, interactives, and student learning resources DesCartes Vision

Advanced options for report display, filtering & content Improved content for instructional use Linking to additional resources Ability to view statements by standards language

Automatically generated class-based ladders for instructional groupings View Learning Statements by State Standards

NEW! Skills Pointer diagnostic tool (gr. 3-9) What Will Be New in Skills Pointer? User-friendly design & interface Easy-to-use reports Rich digital learning content High-quality test items & larger item bank Revised CCSS skills framework Integration with the MAP platform

Improved UI

Skills Pointer Today Skills mastery assessment for: Grades 3-9: Math, Reading, Language Usage and Science aligned to the Common Core and state standards Intended for frequent use, primarily for remediation Provides access to printable learning plans based on individual skills Standalone system, independent of MAP

What will the new Skills Pointer provide? Ability to leverage MAP as an RTI Screener to inform remediation plans for students with Skills Pointer CAT based Skills Locator Assessment determines a student's actual skill level, independent of grade to find the exact learning objectives/skills each student needs to learn Track frequent progress to plan with Skills Pointers short skills mastery tests Access learning and instructional resources based on each students plan, saving teachers time and giving every student resources to learn Developed from the ground-up based on the Common Core State Standards

Display Resources for: Interactive Lesson Plans Handouts Questions Articles Now required in Wisconsin

Science Test Update Changes to Science: One test instead of two Concepts and Processes no longer a stand alone test Incorporated into the General Science test 64 to 45 items saving time Current General Science Norms are applicable

Best Practices - Sharing What Is Your District Doing to Help Parents Understand the Data? Group into 2 or 3 different districts Each share a strategy or practice that you use in your district Talk about new ideas that youd like to try Be prepared to share out one current practice from the group (or more) and one new idea to try

Parent Resources from Other Schools Parent Resources: http://www.greenville.k12.sc.us/lforest/parents/map. asp http://www.greenville.k12.sc.us/lforest/parents/map. asp http://lmms.acps.schoolfusion.us/modules/groups/ho mepagefiles/cms/2361977/File/MAPSCORESPAREN TS.pdf http://lmms.acps.schoolfusion.us/modules/groups/ho mepagefiles/cms/2361977/File/MAPSCORESPAREN TS.pdf http://www.ccsd89.org/index.php?option=com_cont ent&task=view&id=1699&Itemid=256 http://www.ccsd89.org/index.php?option=com_cont ent&task=view&id=1699&Itemid=256 http://www.edgerton.k12.wi.us/thedistrict.cfm?subpa ge=831873 http://www.edgerton.k12.wi.us/thedistrict.cfm?subpa ge=831873 http://www.pisd.edu/parents/assessment.accountabilit y/map.shtml http://www.pisd.edu/parents/assessment.accountabilit y/map.shtml

Parent Videos http://www.youtube.com/watch?v=9bPQOXMle00 http://www.youtube.com/watch?v=9bPQOXMle00 Overview http://www.youtube.com/watch?v=y5JsAoy8EVYhttp://www.youtube.com/watch?v=y5JsAoy8EVY Reading a Parent Report http://www.youtube.com/watch?v=KHTkM-io27Qhttp://www.youtube.com/watch?v=KHTkM-io27Q (This on is ours) http://www.youtube.com/watch?v=k2oAbzEvAbkhttp://www.youtube.com/watch?v=k2oAbzEvAbk Cool kids talking about MAP http://www.youtube.com/watch?v=C9BHHm5ZgjYhttp://www.youtube.com/watch?v=C9BHHm5ZgjY This One Is Just for FUN

Field Testing Opportunities NWEA Needs YOUR Help! 3 Areas for Field Testing This Year: Spanish Math grades 2-5 Upper Level Math (high school) Standalone Field Testing (SFT) is NWEAs means of introducing and testing new items with a goal of increasing the breadth and depth of assessment knowledge in future Measures of Academic Progress (MAP) testing. The field-testing of items also allows NWEA to maintain the stability and accuracy of our measurement scale.

What is required of a field test partner? ANY District is eligible: No limit to the number of students that can participate (just limited to grade levels mentioned) Each test will take about an hour students can take multiple tests on different subjects Workstations must meet current technical requirements web based testing. Either Server based districts or Web Based MAP districts can participate

Whats in it for YOUR District? NWEA will give renewal or new product credit up to $5.00 per completed test You will expose your students to new item types that will eventually become part of the NWEA standard item bank Your district will help to create the Next Generation of MAP Assessments

Knowledge Academy

Knowledge Academy Nomination

Wisconsin Updates: WKCE Alignment Kingsbury Center re-aligned Projected Proficiency to the new WKCE Cut Points Fall of 2012 50% probability of achieving the cut pt. All cut pts are above the 50 th & 60 th Percentile

Norm - New Norms? Norm Study Conducted every 3 years Last norm study was in 2011 Due to implementation of the Common Core SS in many states, research has decided to wait until 2015

STAR Claims : Cheaper - Faster Better MAP & STAR Whats the Difference? Lets look Under the Hood to see if these claims are valid

By only looking at the shiny new outside??? Buying a New Car..

..not all assessments are equal under the hood You Have to Look Under the Hood..

NWEA is the only adaptive test Adapts across all grades on a single scale (pre-k through 12) Based on 30+ years of solid research Has the most stable-predictive scale in the industry Uses norms that are truly national Is content neutral Has the largest item bank of any assessment program Is a non-profit, mission driven organization Setting the Standard in Adaptive Testing for 30+ years

How stable is the scale? How are norms created, and how often updated? Is the assessment FULLY adaptive across a pre-K through 12 scale? What type of items are used, and how many items support the assessment? By strand? How long is the assessment and does it include enough items to give accurate data? What type of organization is the assessment company? Will they support you? Review the Questions

RIT Scale: stability and predictability Virtually no shift (change) in the RIT Scale for 20 years Scale is stable and scores mean the same thing over time Ex: a student with a 200 RIT is at the same instructional level today as 20 years ago Question: How stable is the scale an assessment is using? Scale Stability & Accuracy

Norming Process Kingsbury Center at NWEA re-norms MAP test every 3 years (4 years this time) Norms both for growth & status are nationally representative Our Norm Studies now include 5+ million students and 10s of million of test events Some test makers use a quartile or quintile regression model (misrepresents growth at extremes) Question: how representative are the norms? What methodology do they use? Norms for Comparisons

NWEA MAP Assessments are fully adaptive across all grades Some adaptive assessments are constrained adaptive Within grade level (MCA) A couple of grades above or below (STAR) Will still miss outlier students Adaptive Tests Question: how adaptive is the assessment?

New Item Types to assess deeper levels of DOK (depth of coverage) Sample of new items: here.here. STAR is still primarily MC and assesses lower cognitive skills NWEA uses 7 to 10 items per strand to determine goal strand scores STAR uses fewer items per strand STAR tests are shorter tests Item Depth & Breadth

Item exposure: STAR limits items to 75 to 90 day exposure MAP limits item exposure to 14 months STAR item bank Reading: 4700 items Math: 4000 items MAP item bank Reading: 15,000 ELA items Math: 12,000 items Item Depth & Breadth Question: What type of items and how many items does an assessment use?

Why does a MAP test take longer for students to complete? avg is 45 to 50 minutes Assessing the depth of knowledge higher order skills (not just lower cognition) Providing accurate information based on adequate item selection per strand Gives you MORE information on broader range and depth of skills Fewer items means higher SEM LESS IS NOT ALWAYS MORE.especially in assessment Time On Test

MAP is untimed: students can show their achievement without time constraint STAR is timed per item: forced selection after a set period of time How will this impact performance? Time on Test Question: How does time affect student performance?

1. intro & welcome 2. updates – technology, curriculum partners, product updates - skills pointer,...

Documents