flip roadmap sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. these include...
TRANSCRIPT
![Page 1: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/1.jpg)
FLIP Roadmap Sessions
Mark Molenaar – Chief Technology Officer
Patrick Plichart –VP Software Engineering
![Page 2: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/2.jpg)
Agenda
• Part 1: Platform functionalities + Introduction
- Monday 15:30 – 17:00
• Part 2: Broad issues + GDPR
- Tuesday 9:00 – 11:00
• Part 3: Technology enhanced items + Content Sharing
- Tuesday 11:00 – 12:30
• Questions/Comments?
- Any time!
13
![Page 3: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/3.jpg)
Goals
FLIP
• Share knowledge &
experience
• Share technology/costs
• Share content
OAT/TAO
• Share OAT Vision &
TAO Product Strategy
• Receive feedback &
additional requirements
• Define next steps for
Roadmap
14
![Page 4: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/4.jpg)
Technology Is Transforming Education In a BIG Way
From one-size-fits-all… To:
15
![Page 5: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/5.jpg)
TAO Roadmap
Master
Assessment
Capture
Learning Dataflow
Enable and/or Provide
Learner Analytics,
Reporting, etc.
TAO as EdTech Platform Infrastructure
16
2017 2019 2021
![Page 6: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/6.jpg)
The Next Generation Digital Learning Environment (NGDLE)
“A learning environment consisting of learning tools and components that adhere to common standards. “
Source: http://www.ngdle.org
17
![Page 7: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/7.jpg)
NGDLE Modules
• Itembanking
• Authoring
• Delivery
• On-site Proctoring
• Scoring & Marking
• Analysis & Reporting
• Learning Record Store*
• Administration
• Learning Environment
• Educational Apps
• Learning Analytics Engine
• Remote Proctoring
• Advanced Manual Scoring
External/Partners
* Potential licensed components
18
![Page 8: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/8.jpg)
Design
Item Construction
Test Assembly
Administration
Delivery
Scoring
Analysis
Reporting
Evaluation
19
![Page 9: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/9.jpg)
Design
Item Construction
Test Assembly
Administration
Delivery
Scoring
Analysis
Reporting
Evaluation
20
Construct
RosterDeliver
Report
Core
+
Store
![Page 10: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/10.jpg)
Design
Item Construction
Test Assembly
Administration
Delivery
Scoring
Analysis
Reporting
Evaluation
21
Construct
RosterDeliver
Report
Core
+
Store
Student Information Systems
Curricula &
Frameworks
IGOR
Automated Item
Generation
Badges & Certification
Scanning & Marking
Reporting, Recommendation &
Analytics
Adaptive Engines
Remote Proctoring Learning Management Systems
![Page 11: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/11.jpg)
Design
Item Construction
Test Assembly
Administration
Delivery
Scoring
Analysis
Reporting
Evaluation
22
Construct
RosterDeliver
Report
Core
+
Store
Student Information Systems
Curricula &
Frameworks
IGOR
Automated Item
Generation
Badges & Certification
Scanning & Marking
Reporting, Recommendation &
Analytics
Adaptive Engines
Remote Proctoring Learning Management Systems
QTI
QTI
QTI
LTI
LTI
OneRoster
CASE
Caliper/xAPI
Open Badges
![Page 12: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/12.jpg)
FLIP Requirements List
• 1. offline capability - 1.1 item caching
- 1.2 local server support
- 1.3 offline device
• 2. math tools- 2.1 geogebra item types (PCI)
- 2.2 geogebra student tools (e.g. calculator)
• 3. online marking- 3.1 marking item response
- 3.2 marking logistics
- 3.3 external marking integration (API)
• 4. reporting tools- 4.1 external reporting tool integration
• 5. content sharing- 5.1 shared item banks
- 5.2 shared plugins and extensions
• 6. accessibility- 6.1 dyslexia font support
• 7. item banking UX- 7.1 improved test assembly
- 7.2 UX for staged adaptive
- 7.3 improved item workflow
- 7.4 simplified interface for teachers
• 8. PCI/student tools- 8.1 computational thinking
- 8.2 scratch pad student tool
- 8.3 chat simulator
23
![Page 13: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/13.jpg)
Part 1: Platform functionalities
Authoring, item banking, scoring, accessibility, adaptive testing, etc.
24
![Page 14: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/14.jpg)
Topics
• Authoring & Itembanking (20 minutes)
• Accessibility (20 minutes)
• Adaptive Testing (20 minutes)
25
![Page 15: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/15.jpg)
FLIP Requirements List
• 1. offline capability - 1.1 item caching
- 1.2 local server support
- 1.3 offline device
• 2. math tools- 2.1 geogebra item types (PCI)
- 2.2 geogebra student tools (e.g. calculator)
• 3. online marking- 3.1 marking item response
- 3.2 marking logistics
- 3.3 external marking integration (API)
• 4. reporting tools- 4.1 external reporting tool integration
• 5. content sharing- 5.1 shared item banks
- 5.2 shared plugins and extensions
• 6. accessibility- 6.1 dyslexia font support
• 7. item banking UX- 7.1 improved test assembly
- 7.2 UX for staged adaptive
- 7.3 improved item workflow
- 7.4 simplified interface for teachers
• 8. PCI/student tools- 8.1 computational thinking
- 8.2 scratch pad student tool
- 8.3 chat simulator
26
![Page 16: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/16.jpg)
Authoring & Itembanking: Current
• Basic Workflow
- Resource workflow
- Resource versioning
- Data/functional access control
• Automated scoring
- Partial credit item scoring
- Test level category scoring & cut score definition
• Improved Test Assembly
- Use of search filters
27
![Page 17: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/17.jpg)
Authoring & Itembanking: Future
• Advanced Workflow
- Assignments, notifications, dashboards
- Extended data access control
• Integrated Analysis Tools
- Classical, IRT, other?
• UX improvements
- Improved search
- Simplified interface for teachers?
28
![Page 18: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/18.jpg)
Accessibility: Current
• Accommodations (+ demo)- Color contrast
- Item Level Zoom
- Magnifying Glass
- Keyboard Control
- Highlighter Tool
- Additional Testing Time
- Line Reader
- Text-to-speech (+ Invalsi)
- Scratchpad student tool (+ ACT)
• Item level features- Answer Eliminator
- Answer/area Masking
- Flash Cards (+ Invalsi)
29
![Page 19: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/19.jpg)
Accessibility: Future
• QTI 3 + PNP
- Remodeling of APIP features
• Taking into account Personal
Needs & Preferences (PNP)
- Cards & Catalogs
- Extended W3C ARIA support,
e.g. screen readers, braille
• Dyslexia font
- Optional: linked to PNP?
30
![Page 20: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/20.jpg)
Adaptive Testing: Current
• Auto-navigation (+ Invalsi)
- Guided test “on rails”
• Multistage testing (+ DEPP)
- Predefined branching rules
• Item-by-item adaptive by using
Standard on CAT (+ Cito)
- Live IRT-based algorithm
31
![Page 21: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/21.jpg)
IMS Standard on CATWorkgroup established May 2016
Elsevier, Pearson, ACT, CITO, OAT, PCG, PARCC
Problem- Delivery and Adaptive Engines implemented as proprietary
integrations and are tightly coupled
Goal- Improved interoperability and broader use of algorithms while
protecting intellectual property
Solution- Treat CAT engine as a “Black Box”
- Clearly describe interface that provides the greatest flexibility
- Define best practices
32
![Page 22: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/22.jpg)
Adaptive Testing: Future
• Graphical User Interface for
Staged adaptive (branching)
- Currently operations
• Release of Standard on CAT
- Public release: November 2018
- Including IMS conformance testing
& certification program
33
![Page 23: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/23.jpg)
Part 2: Broad issues
Security, confidentiality, usability, data analytics, reporting, etc.
34
![Page 24: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/24.jpg)
FLIP Requirements List
• 1. offline capability- 1.1 item caching
- 1.2 local server support
- 1.3 offline device
• 2. math tools- 2.1 geogebra item types (PCI)
- 2.2 geogebra student tools (e.g. calculator)
• 3. online marking- 3.1 marking item response
- 3.2 marking logistics
- 3.3 external marking integration (API)
• 4. reporting tools- 4.1 external reporting tool integration
• 5. content sharing- 5.1 shared item banks
- 5.2 shared plugins and extensions
• 6. accessibility- 6.1 dyslexia font support
• 7. item banking UX- 7.1 improved test assembly
- 7.2 UX for staged adaptive
- 7.3 improved item workflow
- 7.4 simplified interface for teachers
• 8. PCI/student tools- 8.1 computational thinking
- 8.2 scratch pad student tool
- 8.3 chat simulator
35
![Page 25: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/25.jpg)
Topics
• Offline & Apps (30 minutes)
• Online marking (30 minutes)
• Analytics & Reporting (15 minutes)
• Security & Privacy (15 minutes)
36
![Page 26: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/26.jpg)
Offline & Apps: Current
• Item Caching- Precaching x items up front
• TAO Sync- Synchronize assignments, test-
takers & deliveries (scoped)
• Local Server (+ IAVE demo)- Deployed by Virtual Machine
- Dedicated hardware or USB
- Scalability considerations
• App prototype (+ video)- Utilizing Apache Cordova
37
![Page 27: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/27.jpg)
Offline & Apps: Future
• Offline support tools
- Auto sync, updates
- Operational Scalability challenges
• Release native Apps
- Different mobile platforms
- Integrate lockdown components?
• Mobile friendly GUI
- Usability considerations
- Responsive design
- Mode effects?
38
![Page 28: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/28.jpg)
Online Marking: Current
• Defining scoring rubrics
during authoring
- Traits ~ QTI outcomes
• Custom external integration
- By use of QTI Results API,
e.g. OSCAR
• IAVE marking solution
- SCOI demo by Helder
39
![Page 29: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/29.jpg)
Online Marking: Future
• External Integration by use of (IMS) open standards
- IAVE, OSCAR, others?
• Re-using rubrics, traits across items
• Built-in TAO basic marking capabilities
- Including basic workflow, which?
40
![Page 30: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/30.jpg)
Analytics & Reporting: Current
• Results export
- Comma Separated
Values (CSV)
- QTI Results Reporting
• Custom Client Solutions
- Custom export formats
- DEPP Portals (+ demo?)
41
![Page 31: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/31.jpg)
Analytics & Reporting: Future
• Common test-taker reports
- Which ones?
• Common item/test analysis
reports
- Which models?
• External tool integration
- R packages (e.g. DEPP, Cito
Dexter), SAS, SPSS, others?
42
![Page 32: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/32.jpg)
Security & Privacy
• Thierry: end-user perspective?
• Impact of GDPR on solutions?
- Hosting location
- Personal data storage
• Identity web service (+ DEPP)
• Other solutions?
43
![Page 33: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/33.jpg)
Part 3: Technology Enhanced Items
Portable custom interactions (PCI), 21st century skills
44
![Page 34: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/34.jpg)
FLIP Requirements List
• 1. offline capability - 1.1 item caching
- 1.2 local server support
- 1.3 offline device
• 2. math tools- 2.1 geogebra item types (PCI)
- 2.2 geogebra student tools (e.g. calculator)
• 3. online marking- 3.1 marking item response
- 3.2 marking logistics
- 3.3 external marking integration (API)
• 4. reporting tools- 4.1 external reporting tool integration
• 5. content sharing- 5.1 shared item banks
- 5.2 shared plugins and extensions
• 6. accessibility- 6.1 dyslexia font support
• 7. item banking UX- 7.1 improved test assembly
- 7.2 UX for staged adaptive
- 7.3 improved item workflow
- 7.4 simplified interface for teachers
• 8. PCI/student tools- 8.1 computational thinking
- 8.2 scratch pad student tool
- 8.3 chat simulator
45
![Page 35: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/35.jpg)
Topics
• TEI/PCI Introduction (10 minutes)
• Math tools (30 minutes)
• Other student tools (30 minutes)
• Sharing Content (20 minutes)
46
![Page 36: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/36.jpg)
TEI/PCI Introduction
Technology Enhanced Items (TEIs)• “… are computer-delivered items that include
specialized interactions for collecting response data. These include interactions and responses beyond traditional selected-response or constructed-response.”
• To enrich “traditional subjects” assessments
• To explore “new” competences (e.g. 21st CS)
• Considerations- More expensive to develop: use IMS PCI
specification to allow for portability & sharing
- Hard(er) to analyze?
Portable Custom Interaction (PCI)• “… is a best practice on creating custom item
types which go beyond the capabilities of QTI, retaining interoperability”
• PCI ~ item-type- Can be configured by parameters
- Combined with other interactions
• One-off vs. Generic types- One-item type, e.g.
very specific simulation
- Generic type, e.g. Likert
47
![Page 37: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/37.jpg)
Math Tools: Current
• Math Input PCI (Invalsi)
• Formula cheat sheet (Invalsi)
• PARCC PCI (+ demos)
• Geogebra integration
prototype
• DEPP/Luxembourg
Math PCI (+ demo Franck)
48
![Page 38: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/38.jpg)
Math Tools: Future
• Geogebra integration by
open standards
• Geogebra student tools
- Scientific calculator
• Computer Algebra System
(CAS) integration
49
![Page 39: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/39.jpg)
Other Student Tools
• World Language Input
Control (NYC)
• Computational Thinking
- Programming tools,
different age groups
• DEPP Science PCIs
(+ demo Jean Philippe)
• Chat simulator (+ demo)
50
![Page 40: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/40.jpg)
Sharing Content by Open Standards
QTI + PCI
• Tests
• Item banks
• Components
- Adaptive engines
- (Generic) PCIs
• Other content?
LTI
• Launch test deliveries
- Launch proctoring separately
• Launch item preview
• Launch item authoring
51
![Page 41: FLIP Roadmap Sessionsflip-initiative.org/wp-content/uploads/2019/03/... · data. These include interactions and responses beyond traditional selected-response or constructed-response.”](https://reader035.vdocuments.us/reader035/viewer/2022071008/5fc5d68cb96c47070f6bcbb0/html5/thumbnails/41.jpg)
Sharing Content: Future (“TAO Exchange”)
• Sharing of content and systems that “work with TAO”
- Data/Functional Access Control
• Itembanks
- Items, tests
• Components/Building blocks
- PCIs,Adaptive Engines
• Proven system integrations
- Text-to-speech engines, (AI) scoring systems, reporting tools, etc.
• Other?
52