aamc implementation of the medbiquitous curriculum inventory data exchange standard terri cameron,...
TRANSCRIPT
AAMC Implementation of the MedBiquitous Curriculum Inventory Data Exchange Standard
Terri Cameron, MADirector of Curriculum Programs
Spring 2014
MedBiquitous Curriculum Inventory V1
• Working Group launched in December 2010• Susan Albright and Marc Triola, co-chairs 2010-2013• Charter:
“to develop XML standards for the exchange of curriculum data for benchmarking and educational research.” (Not just for AAMC Curriculum Inventory)
• Reasons for Undertaking Work:• Enable local curriculum management systems to upload data to
a central Curriculum Inventory• Identify curricular trends• Support curriculum benchmarking and reform
• Approved by CI Working Group: February 2013• Approved by ANSI: May 2013
www.aamc.org/medaps
CI Pilot• September – December
• 25 schools / six vendors
• 5 schools working with school-based systems
• Testing• Upload process• Accuracy of Verification Report to submitted
data• School Portal functionality
www.aamc.org/medapswww.aamc.org/medaps
CI Pilot Results• Increased file size limits
• Provided staging area for vendors
• Improved error messages
• Clarified AAMC Business Rules
• Improved appearance of School Portal
• Added curriculum file upload screen
www.aamc.org/medapswww.aamc.org/medaps
2012-2013 Upload Process• CI Portal Open: December 10• CI Portal Close: February 10: 65 Schools• One month follow up period for schools that
did not participate• CI Gateway Close on March 10: 90 Schools
• 85 US Medical Schools• 5 Canadian Medical Schools
• Additional schools were in process but unable to meet deadline
• All other schools contacted plan to participate in 2013-2014 Upload (August)
www.aamc.org/medaps
2012-2013 Upload Details• 50 Schools included competency mapping• 4968 Sequence Blocks• 107458 Events• 108031 Sequence Block Expectations• 283325 Event Expectations• 61249 Assessment Methods • 124068 Instructional Methods• 22421 Resources
www.aamc.org/medaps
2012-2013 Resource DetailsResource Type Number
1 Audience Response System 12582 Audio 12163 Cadaver 4584 Clinical Correlation 9975 Distance Learning - Asynchronous 2866 Distance Learning - Synchronous 147 Educational Technology 56758 Electronic Health/Medical Record (EHR/EMR) 1849 Film/Video 113410 Key Feature 211 Mannequin 9612 Plastinated Specimens 213 Printed Materials (or Digital Equivalent) 57014 Real Patient 80915 Searchable Electronic Database 10416 Standardized/Simulated Patient (SP) 34117 Task Trainer 7618 Virtual Patient 19319 Virtual/Computerized Laboratory 17720 Wet Laboratory 244
www.aamc.org/medaps
2012-2013 ‘Other’ Resources
www.aamc.org/medaps
Anatomy 8Biology of Cells 1inanimate models 1Medical equipment 19Museum 1Palliative Care 1Panel 3Panel discussions 21Personality/leadership test/profile (disc)
6
Plastinated Specimens 105Printed Materials (or Digital
161
Printed Materials (or Digital Equivalent)
8076
Scenarios 62
Searchable Electronic Database
68
Simulator (Harvey) 3
Small group discussion with facilitator
25
Small group discussion with mentor of a project review
3
theater project 2
Ultrasound 9
ventilator 1
Women's Health 1
Written assignments 8
• Reasons for not participating this year:• Focused on LCME Site Visit• Curriculum Review/Renewal/Change• Just started working with new curriculum
management system so did not have data completely entered / organized
• Do not have system / have not decided on a vendor yet / do not have technical staff
• Change in leadership / staff – needed time to come up to speed
• Concerns about Verification Report• Vendor did not upload as planned
www.aamc.org/medaps
2012-2013 Upload Process
• Biggest Hurdles:• Report Start and End Dates• Institution Information• Competencies
• Program to PCRS (related)• Hierarchy Levels (broader / narrower)
• Academic Levels• Start and End Dates• Sequence Blocks in multiple levels
• Unique Curricula• Multiple options for students
www.aamc.org/medaps
2012-2013 Upload Process
• Biggest Hurdles:• Organizing data• Documenting competencies in XML• CI Verification Report
• Assessment Counts• Summative / Formative
• Instructional Method Hour Counts• Constantly-changing environment
• Communication!
www.aamc.org/medaps
2012-2013 Upload Process
• Successes:• Curriculum Management System Vendors
• Massive changes to systems to support CI • Great communication and feedback• All but one uploaded as planned
• MedBiq Leadership / Support• Valerie Smothers• CI Implementers’ Listserv
• Webinars• Nearly every school participated
• Physician Competency Reference Set (PCRS)• Standardized Vocabulary• School Participation
www.aamc.org/medaps
2012-2013 Upload Process
CI Reports• Two Sources of Data:
• Curriculum Inventory• LCME Annual Questionnaire Part II
• Phased Approach for Reporting:• Short-term (6-12 months)
• Static Reports• Reports by Request ([email protected])
• Intermediate-term (12- 18 months)• Dynamic Reports• Reports on Demand
• Long-term (2-3 years)• Enterprise-wide (AAMC) Reporting Solution
www.aamc.org/medaps
CI Reports• Reporting Options
• Short-term and Intermediate• Choose types of schools to include:
• All Schools• US Medical Schools• US Regional Medical Schools• Canadian Medical Schools• Osteopathic Schools
• Enter search criteria• Reports will include:
• Where and how often content is covered• Instructional methods• Assessment Methods• Competencies
www.aamc.org/medaps
Preparing for 2013-2014• CI School Portal Opens August 1
• Closes September 30
• Staging (for testing uploads) available in May• Vendors automatically have access• Available to school developers by request
• Webinars/Virtual Focus Groups:• Three-part Developer Series• Curriculum Deans and Administrators
• Developer-to-Developer Hands-on Workshop:• Develop and upload one course plus Program
Competencies mapped to PCRS
www.aamc.org/medaps
MedBiquitous Curriculum Inventory V2 • Working Group convened in February 2014• Susan Albright and Hugh Stoddard, co-chairs• Review of implementation of V1• Known Issues:
Academic Level Assessment Methods
– Requirement for Formative/Summative Event Duration (Assessments) Sequence Block Duration (Weeks) Resources (Require / Refine List ) Standardized Vocabulary Update
Resources• Curriculum Inventory Website:
www.aamc.org/cir • Webinar dates• Developer resources• Updates regarding reports• Vendor List• Participating Schools
• MedBiquitous: www.medbiq.org • Curriculum Inventory Working Group:
http://www.medbiq.org/curriculum_inventory
• Competencies Working Group:http://www.medbiq.org/working_groups/competencies/index.html
www.aamc.org/medaps
Questions?
www.aamc.org/medaps
©