26th annual management information systems [mis] conference

60
Data Standards for Content: Granular Learning Standards, Learning Resources [Concurrent Session VI -J - Thursday February 14, 2013 - 9:00–10:00 – South Carolina] Richard Culatta Jim Goodell Doug Levin Michael Jay Since the 2012 Summer Data Conference there have been significant new developments related to learning standards, education resources (including open educational resources and assessment repositories), and corresponding data standards. This session will examine key developments including those related to the CCSS-GIM project, the CEDS version 3 release, the Learning Registry, and the Learning Resource Metadata Initiative (LRMI). 26th Annual Management Information Systems [MIS] Conference 1

Upload: leda

Post on 25-Feb-2016

45 views

Category:

Documents


1 download

DESCRIPTION

26th Annual Management Information Systems [MIS] Conference. Data Standards for Content: Granular Learning Standards, Learning Resources [Concurrent Session VI -J - Thursday February 14, 2013 - 9:00–10:00 – South Carolina] Richard Culatta Jim Goodell Doug Levin Michael Jay - PowerPoint PPT Presentation

TRANSCRIPT

Slide 1

GIM-CCSS: Granular Identifiers and Metadata for the Common Core February 14, 2013Doug Levin, Executive DirectorState Educational Technology Directors Association (SETDA)[email protected]@douglevinwww.setda.org @SETDA

22State Educational Technology Directors AssociationServe, support, and represent U.S. state and territorial directors for educational technology

Mission to build and increase the capacity of state and national leaders to improve education through technology policy and practice

Forum for:Advocacy for policy and practiceProfessional learningInter-state collaborationPublic-private partnerships

Online at: www.setda.org or @SETDA

All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.33The Need for the ProjectThe shift to digital in K-12: instructional materials, assessments, professional development, courses, school models

The adoption and implementation of the Common Core State Standards

The need and opportunity in academic standards-based systems to align resources to the standards with fidelity

The opportunity and obligation to share across state lines, e.g., RTTA

44Granular Alignment: Assessment Use Case Example #1CCSS.Math.Content.6.RP.A.2 (Ratios & Proportional Relationships Grade 6)

Understand the concept of a unit rate a/b associated with a ratio a:b with b 0, and use rate language in the context of a ratio relationship.

Can you write one assessment item to fully address the standard? Is it more likely that an assessment item might address only part of the standard? If so, how many instructionally meaningful permutations exist?55Granular Alignment: Assessment Use Case Example #1CCSS.Math.Content.6.RP.A.2 (Ratios & Proportional Relationships Grade 6)

Understand the concept of a unit rate a/b associated with a ratio a:b with b 0, and use rate language in the context of a ratio relationship.

166Granular Alignment: Assessment Use Case Example #1CCSS.Math.Content.6.RP.A.2 (Ratios & Proportional Relationships Grade 6)

Understand the concept of a unit rate a/b associated with a ratio a:b with b 0, and use rate language in the context of a ratio relationship.

277Granular Alignment: Assessment Use Case Example #2CCSS.ELA-Literacy.RL.6.4 (Reading: Literature Grade 6)

Determine the meaning of words and phrases as they are used in a text, including figurative and connotative meanings; analyze the impact of a specific word choice on meaning and tone

Can you write one assessment item to fully address the standard? Is it more likely that an assessment item might address only part of the standard? If so, how many instructionally meaningful permutations exist? 88Granular Alignment: Assessment Use Case Example #2CCSS.ELA-Literacy.RL.6.4 (Reading: Literature Grade 6)

Determine the meaning of words and phrases as they are used in a text, including figurative and connotative meanings; analyze the impact of a specific word choice on meaning and tone

1

99Granular Alignment: Assessment Use Case Example #2CCSS.ELA-Literacy.RL.6.4 (Reading: Literature Grade 6)

Determine the meaning of words and phrases as they are used in a text, including figurative and connotative meanings; analyze the impact of a specific word choice on meaning and tone

2

1010Granular Alignment: Assessment Use Case Example #2CCSS.ELA-Literacy.RL.6.4 (Reading: Literature Grade 6)

Determine the meaning of words and phrases as they are used in a text, including figurative and connotative meanings; analyze the impact of a specific word choice on meaning and tone

3

1111Granular Alignment: Assessment Use Case Example #2CCSS.ELA-Literacy.RL.6.4 (Reading: Literature Grade 6)

Determine the meaning of words and phrases as they are used in a text, including figurative and connotative meanings; analyze the impact of a specific word choice on meaning and tone

4

1212Granular Alignment: Assessment Use Case Example #2CCSS.ELA-Literacy.RL.6.4 (Reading: Literature Grade 6)

Determine the meaning of words and phrases as they are used in a text, including figurative and connotative meanings; analyze the impact of a specific word choice on meaning and tone

5

1313ThemesMapping, not authoring

Extending, not rewriting or restructuring

Mechanism for assessing quality of alignments and coverage of standards

Offers mechanism to address inter-state variation in adoptions (15% additions)

Ability to crosswalk from PARCC to Smarter Balanced and vice versa

1414The ProjectSteering Committee: SETDA, PARCC, and Smarter Balanced with CCSSOs EIMAC

Consultants/Working Groups: Content and Technical

Stakeholder Review

Publish solution as open source with attention to sustainability/implementation and role in ecosystem1515The Technical ApproachPosted for public review:

Scope, Technical Requirements, Approaches and Recommendations (v.08 2/6/13)

Creating a digital representation of the Common Core State Standards (CCSS) based on a well-defined information architecture.Assigning, using and managing identifiers associated with statements within the CCSS.Providing metadata describing the statements within the CCSS.

Online at: http://assess4ed.net/group/gim-ccss-public-updates 1616Project Milestones and Planned Activities

February - March 2013: Refine and finalize technical solution to publish learning standardsFebruary - May 2013: Iteratively release, review and refine granularity specification in the Common Core for all grade levelsApril - May 2013: Implement technical solution; develop documentationMay - June 2013: Deploy and test technical solution; refine documentationJune 2013: Release technical solution1717Stay ConnectedGIM-CCSS Public Updates online at: http://assess4ed.net/group/gim-ccss-public-updates

1818GIM-CCSS: Granular Identifiers and Metadata for the Common Core February 14, 2013Doug Levin, Executive DirectorState Educational Technology Directors Association (SETDA)[email protected]@douglevinwww.setda.org @SETDA

1919LRMINCES MISWashington, D.C. 14 February 2013

Michael Jay, Educational Systemics20All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#20LOM, DC, MLR, LRMI, OMG21All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#21

22All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#22

23All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#23

24All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#24

All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#25But nothing about learning.All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#2627MOMA

vs.All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#2728

So, why do we need a standard?All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#28

All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#2930Goal: Make it easier and more convenient to find learning resources that meet specific student and class needs.Curriculum StandardsSchema.orgIntersection of three opportunitiesResource Registries(Learning Registry)LRMIWhy Now? Kinda Perfect Stormfrom a representation by Brandt Redd, Gates FoundationAll images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#GoalMake it easier and more convenient to find learning resources that meet specific student and class needs.Intersection of three opportunitiesAdoption of the Common Core State Standards by 45 States, DC and three Territories (http://corestandards.org)Schema.org joint initiative by Google, Yahoo and Microsoft Bing (http://schema.org) Advent of the Learning Registry (http://learningregistry.org) Informed by previous education and metadata effortsIEEE LOMDublin CoreSCORMMany others

All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#31 Sheryl Abshire, Calcasieu Parish Public School System Phil Barker, JISC CETIS Kurt Bollacker, Applied Minds Brian Carver, UC Berkeley School of Information Cable Green, Creative Commons Greg Grossmeier, Creative Commons Charlie Jiang, Microsoft Michael Johnson, Full Potential Associates Mike Linksvayer, Creative Commons Joshua Marks, Curriki Brandt Redd, Gates Foundation Colin Smythe, IMS Global Stuart Sutton, Dublin Core Metadata Initiative Randy Wilhelm, netTrekker Lee Wilson, PCI Educational Publishing 32All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#3233The Tagging ChallengeThere is nothing worse than a sharp image of a fuzzy concept.- Ansel Adams

All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#3334The LRMI Properties v1 (lrmi.net/the-specification)GeneralTerms (Schema.org):title/nameURLDescriptionImageTopiccreated (date)CreatorPublisherinLanguageMediatypetechnologiesRequiredtechnologiesRecommended Use RightsURLis based onEducational Terms:intendedEndUserRoleeducationalUse timeRequiredtypicalAgeRange interactivityType learningResourceType

Competency related:educationalAlignmentDescriptionURLAlignment Type educationalFrameworktargetDescriptiontargetNametargetURLAll images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#34The Act of Tagging35All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#3536

All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#3637Use the Open Source Tagger to create LRMI metadata for your educational resources.Tagger output is pushed to The Learning Registry and embedded in your page(s) to make your content much more easily discoverable.1. Tag2. Publish3. Search

Resource Registry

Your DataYour content tagged with LRMI metadata is more easily discovered, accessed and purchased.What is the Process?All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#37AEP SupportAll images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#3839Phase IIMarch 2012 February 2013Awareness building Proof of Concept Collaboration on Tagger/SearchEducator/publisher surveys Encouraging/supporting Schema.org adoptionHands-on Publisher Tagging SupportAll images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#3940

All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#4041Phase IIIMarch 2013 February 2014Awareness buildingEducator/publisher surveys Continued support for Schema.org adoptionPublisher Tagging SupportService Providers ProgramTest Environment for PublishersAll images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#4142ImplicationsAll images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#4243

DiscoveryLRMI is designed to make content discoverableCommerceContextual relevance drives value. Relevance at the level of the learner facilitates the move to new learning modelsWhy Tag to the LRMI Objects?All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#4344Not just for topical application...Use to capture and communicate instructional intent as part of product conceptualization and design

Tag, youre it!

All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#4445ShiftingResourceInstitutionMediaAdoptedLearningLearnerEngagementDiscoveredtotototoMove fromAll images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#4546So, How Can Your Organization Participate?All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#4647Ask us www.lrmi.netHere to help you... Gain support for LRMI within your organizations Provide support in finding ways to integrate this into your existing processes Facilitate access to technical resources if needed To do this we can... Present to you and those teams with whom you work Review and provide feedback on metadata you are creating Provide information to show benefit to your organization for participation All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#4748Questions & ContactsPresenter:Michael [email protected]

To Get Started:

Dave Gladney AEP LRMI [email protected]

Teila Evans, Project [email protected] All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.#48

http://youtu.be/-1QEkA9qbwA

49See video at : http://lrmi.net All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.49

LRMI in CEDS50All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.50

51All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.51 Synergy5252

How the multiple initiatives work together

1: Finding Learning Resources53All images used in this presentation are stock photos used with permission, public domain, or created by the authors. Release for web use of all photos on file.(Jim) Lets start with a student or teacher searching for learning resources for homework or to prepare tomorrows lesson. Existing search engines will find too many options. It can be like finding a needle in a haystack. LRMI allows publishers to tag educational resources so they are more discoverable and so people searching can find specifically what they need. Search engines use the tags and give users the ability to filter results based on details like the specific Common Core State Standard that the resource addresses. It narrows the results to exactly what is needed.53

How the multiple initiatives work together

2: Learning Resources Ratings & Analysis54All images used in this presentation are stock photos used with permission, public domain, or created by the authors. Release for web use of all photos on file.Now that the student or educator has a more focused set of search results, there can still be questions about the quality or effectiveness of a resource. The Learning Registry helps address this. It is a behind-the-scenes peer network for sharing rich information about learning resources between data systems. It uses the vocabulary of LRMI, which is also aligned to the Common Education Data Standards, and leverages the power of the network to collect more than the descriptive data (metadata) provided by publishers. It also allows sharing of metadata such as ratings, comments, downloads, standards alignment, and usage statistics. Applications built to harness the power of harvesting and analyzing the Learning Registry data, including learning management systems and search engines, will allow educators to quickly find content specific to their unique needs with additional quality indicators from the community of educators. It will help educators better understand what works and better target resources to individual needs.54

How the multiple initiatives work together

3: Supporting Personalized Learning55All images used in this presentation are stock photos used with permission, public domain, or created by the authors. Release for web use of all photos on file.Part of the inBloom (formerly the Shared Learning Collaborative) is an indexing service for the Learning Registry. Applications built using inBloom services and Learning Registry data will be able to serve as a bridge between individual learner needs and preferences and the learning resources that will best meet those needs.

Lets say our student has found the right learning resource, targeted to his/her needs, used the resource as part of a learning activity--so what next? At some point there needs to be an assessment to check for understanding. Innovations in online assessments are being developed into applications that interface with the inBloom services. The assessment application must also be able to target specific student needs while assessing granular competencies within learning standards.55

How the multiple initiatives work together

4: Authentic , Standards-Based, Granular, Assessment of and for Learning

GIM-CCSS

AIF(IMS, SIF)56All images used in this presentation are stock photos used with permission, public domain, or created by the authors. Release for web use of all photos on file.And finally, a couple of projects connected with the Race to the Top Assessment consortia, the GIM-CCSS which Doug told you about and the Assessment Interoperability Framework. IMS Global and the SIF Association launched the Assessment Interoperability Framework and then worked under a sub-project of the CEDS with the two assessment consortia and a state not participating in either consortia. The resulting additions to CEDS and interoperability standards lay a foundation for a common vocabulary for assessment data that is compatible across systems, such as sharing of assessment items across assessment banks.

These projects informed CEDS version 3 and new developments in these projects will inform CEDS version 4, just as CEDS provides a common data vocabulary across the initiatives.

For our student and teacher, all of this could mean a critical mass of public domain assessment items and innovative assessment applications for continuous feedback to inform individualized learning. 56

How the multiple initiatives work together

5: Student (and parent) Access to their own Data57All images used in this presentation are stock photos used with permission, public domain, or created by the authors. Release for web use of all photos on file.Finally our student clicks My Student Data Download to download his/her own data in order to create a personal learning profile that he/she can keep throughout his/her learning career.

This is possible because of the MyData Button, a joint project between the Office of Educational Technology and the White House Office of Science and Technology Policy to encourage schools and software vendors who hold student data to allow such downloads as delimited text, XML, and human readable formats. Developers are encouraged to create customized services and tools for students based on the information available in their personal learning profile.57Synergy between initiativesPurpose

Approach

EncodingGIM-CCSSLRMI / Schema.orgLearning RegistryMy Student Data DownloadAssessment Interoperability Framework, IMS & SIF inBloomLong-term technical implementation of CCSS for assessments, etc.Search Engine DiscoveryData Exchange (Resources)Access to Personal DataData InteroperabilityShared services for personalized learningWeb publisherWeb CrawlingPeer ReplicationDownload ButtonData TransportOpen PlatformJSON, HTMLHTMLJSON, XMLDelimited text, XML, Human Readable (XSLT)XMLAPI Calls, XML, SIFCommon Education Data Standards (CEDS)Common Vocabulary Other synergistic initiatives: Cross-state data sharing, e.g. SEEDE , EdFi Dashboards and toolsCEDS v3 58All images used in this presentation are stock photos used with permission or created by the authors. Release for web use of all photos on file.58For more information visit:

http://ceds.ed.gov

http://lrmi.net

http://www.learningregistry.org

http://assess4ed.net/group/gim-ccss-public-updates

5959CONTACTS:

Richard CulattaRichard.Culatta @ ed.govJim GoodellJimGoodell @ qi-partners.comDoug LevinDLevin @ setda.orgMichael JayMichael @ edusystemics.com

6060