transition of professional exams to cbt -...
TRANSCRIPT
![Page 1: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/1.jpg)
TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, P.E. NCEES Project Manager of Computer-Based Exams
![Page 2: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/2.jpg)
Overview • Computer-based testing (CBT) transition
update • CBT exam formats • Examinee references in CBT • Alternative item types (AITs) • CBT transition schedule
![Page 3: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/3.jpg)
Learning objectives • After attending this workshop, participants
should be able to – Name at least two benefits of CBT – Explain how references are being provided to examinees on
CBT exams – Identify the first two professional exams being converted to
CBT (There will be a quiz!)
![Page 4: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/4.jpg)
CBT PROGRESS TO DATE
![Page 5: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/5.jpg)
CBT progress to date • Why CBT?
![Page 6: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/6.jpg)
CBT progress to date • At the 2012 annual meeting, NCEES voted to
convert the FE/FS exams to CBT. • CBT exam administration began January 2, 2014.
– Over 95,000 FE/FS exams administered through June 2016
– Very positive examinee feedback
![Page 7: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/7.jpg)
0
10,000
20,000
30,000
40,000
50,000
60,000
04-05 05-06 06-07 07-08 08-09 09-10 10-11 11-12 12-13 13-14 14-15
FE and PE exam usage
Total FE Exams
Total PE Exams
FE exam trends
![Page 8: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/8.jpg)
FE exam windows trend
0
2000
4000
6000
8000
10000
12000
14000
16000
2014_C01.02 2015_C01.02 2016_C01.03 2014_C04.05 2015_C04.05 2016_C04.06 2014_C07.08 2015_C07.08 2016_C07.09 2014_C10.11 2015_C10.11
FE volumes by year and window
2014_C01.02 2015_C01.02 2016_C01.03 2014_C04.05 2015_C04.05 2016_C04.06 2014_C07.08 2015_C07.08 2016_C07.09 2014_C10.11 2015_C10.11
![Page 9: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/9.jpg)
FE exam pass rates 2013
October 2014
C01.05 2014
C07.11 2015
C01.05 2015
C07.11 2016
C01.06
Total number of examinees 22,825 15,880 13,812 22,133 17,261 25,293
Number of first-time examinees 17,439 13,348 10,827 18,517 13,453 20,874
First-time pass rate 73% 78% 74% 73% 70% 72%
Repeat pass rate 30% 34% 34% 34% 34% 34%
![Page 10: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/10.jpg)
CBT EXAM FORMATS
![Page 11: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/11.jpg)
• Different CBT formats are based on examinee population.
• All CBT formats offer benefits to – NCEES – Examinees
CBT exam formats
![Page 12: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/12.jpg)
• Key benefits, NCEES perspective – Improved security (not just collusion) – Consistent testing environment
• Key benefits, examinee perspective – Flexible scheduling – Searchable handbook – Quicker results
CBT exam formats
![Page 13: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/13.jpg)
CBT exam formats • LOFT—Linear On the Fly Test
– These exams have large examinee volumes. – Every examinee receives a different, but statistically
equivalent, exam form. – Each exam is the same length but covers the same topics.
• LOFT benefits – Flexible scheduling – Quick results turnaround (7–10 days)
![Page 14: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/14.jpg)
CBT exam format • NCEES exams/disciplines with enough volume for LOFT
– FE (7 disciplines) – FS – PE Chemical – PE Civil (5 disciplines) – PE Electrical and Computer (Power discipline only) – PE Environmental – PE Mechanical (3 disciplines) – PS
![Page 15: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/15.jpg)
CBT exam formats • LFF—Linear Fixed Form
– These exams are not large enough for LOFT. – Every examinee receives the same items (like pencil-and-
paper exams but administered on computer). – LFF are single-day testing “events” (like today).
• LFF benefits in CBT – Quicker results turnaround (all exams) – More precise psychometric model (4 italicized exams)
![Page 16: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/16.jpg)
CBT exam format • NCEES exams/disciplines using LFF in CBT
– PE Agricultural and Biological – PE Architectural – PE Control Systems – PE Electrical and Computer (Computer discipline) – PE Electrical and Computer (Electrical and Electronics
discipline) – PE Fire Protection
![Page 17: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/17.jpg)
CBT exam format • NCEES exams/disciplines using LFF in CBT (continued)
– PE Industrial and Systems – PE Metallurgical and Materials – PE Mining and Mineral Processing – PE Naval Architecture and Marine – PE Nuclear – PE Petroleum – PE Software
![Page 18: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/18.jpg)
CBT EXAMINEE REFERENCES
![Page 19: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/19.jpg)
Professional exam references • What is a reference?
– Content that must be provided to answer a test question • Currently, examinees provide their own
references. • References will be provided on screen in CBT.
– Just like CBT FE/FS exams
![Page 20: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/20.jpg)
Professional exam references • Four CBT reference alternatives:
– Open book (existing pencil-and-paper exams) – Reference handbook (written by exam committee) – Exhibits (embedded in specific questions) – Supplemental references (typically codes/
standards)
![Page 21: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/21.jpg)
CBT exam screen with handbook
![Page 22: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/22.jpg)
CBT exam screen—exhibits
![Page 23: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/23.jpg)
CBT exam screen—handbook and codes
![Page 24: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/24.jpg)
• When converting PE exams to CBT, the exam committees’ major challenge is references. – Bank items already exist. – NCEES-supplied references do not.
Professional exam references
![Page 25: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/25.jpg)
ALTERNATIVE ITEM TYPES
![Page 26: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/26.jpg)
Alternative item types • What is an alternative item type (AIT)?
– An item format that cannot be supported on paper exam formats but can be supported on a computer screen
• AIT formats we’ll be using – Point and click (two types): identify a spot on a drawing/figure – Drag and drop: move tokens onto targets – Fill in the blank – Multiple choice, multiple select
![Page 27: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/27.jpg)
Alternative item types • Question: When should alternative items be used? • Answer: When they’re the best tool for the job (testing
minimum competence)
![Page 28: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/28.jpg)
Point and click (hot spot)
![Page 29: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/29.jpg)
Point and click (hot spot)
![Page 30: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/30.jpg)
Point and click (hot area)
![Page 31: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/31.jpg)
Point and click (hot area)
![Page 32: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/32.jpg)
Drag and drop
![Page 33: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/33.jpg)
Drag and drop
![Page 34: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/34.jpg)
Fill in the blank
![Page 35: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/35.jpg)
Fill in the blank
![Page 36: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/36.jpg)
Multiple choice, multiple select
![Page 37: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/37.jpg)
Multiple choice, multiple select
![Page 38: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/38.jpg)
Alternative item types • Question: When should alternative item types be used? • Answer: When they’re the best tool for the job (testing
minimum competence)
![Page 39: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/39.jpg)
Alternative item types • AIT integration schedule
– PS: October 2016 (initial CBT exam) – FE (7 disciplines): July 2017 – FS: July 2017 – PE Chemical: January 2018 (initial CBT exam) – All others: with initial CBT exam
![Page 40: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/40.jpg)
CBT TRANSITION SCHEDULE
![Page 41: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/41.jpg)
General transition timeline • The last major NCEES exam transition was the
1996–2002 migration from essay exams to multiple choice.
• What can we learn from that transition? – Over five years, 16 exams converted to multiple
choice. – The schedule averaged three exams per year.
![Page 42: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/42.jpg)
General transition timeline • Currently, 16 PE exams remain paper-based. • CBT transition schedule concept approved by
EPE: – Convert three exams annually over six years,
beginning in 2018. – Transition order will depend on readiness.
![Page 43: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/43.jpg)
Potential PS/PE CBT transition schedule Group 1 exams Group 2 exams Total this year
2014 Council vote: Convert “as soon as feasible”
2017–18 (year 1) CHE, PS NUC 3
2019 (year 2) ELEC (3), ENV,
MEC (3)
FPE, MIN (?) 3
2020–21 (years 3–4) AGR, ARC, CSE, IND,
MET, NAME, PET, SWE
6
2022 (year 5) CIV (5) 3
2023 (year 6) STR? 2 (3)
Totals 5 (6) 11 17 (18)
Approved by EPS/EPE in January/October 2015, respectively
![Page 44: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/44.jpg)
REVIEW LEARNING OBJECTIVES
![Page 45: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/45.jpg)
Learning objectives • After attending this workshop, participants
should be able to – Explain how references are being provided to
examinees on CBT exams – Name at least two benefits of CBT – Identify the first two professional exams being
converted to CBT
![Page 46: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/46.jpg)
QUESTIONS AND DISCUSSION
![Page 47: transition of professional exams to cbt - NCEESncees.org/wp-content/uploads/2016/01/Update-on-PE-and-PS... · TRANSITION OF PROFESSIONAL EXAMS TO CBT Lehmon Dekle, ... • Alternative](https://reader031.vdocuments.us/reader031/viewer/2022022509/5ad2957c7f8b9aff738ce131/html5/thumbnails/47.jpg)