ABA/ASA JOINT COUNCIL ON ABA/ASA JOINT COUNCIL ON

IN-TRAINING EXAMINATIONSIN-TRAINING EXAMINATIONS

2007 REPORT TO SAAC/AAPD2007 REPORT TO SAAC/AAPDGlenn P. Gravlee, MDGlenn P. Gravlee, MD

Chair, Joint CouncilChair, Joint Council

University of Colorado Denver and Health Sciences University of Colorado Denver and Health Sciences

CenterCenter

Department of AnesthesiologyDepartment of Anesthesiology

Glenn.gravlee@uchsc.eduGlenn.gravlee@uchsc.edu

2007 JOINT COUNCIL MEMBERS2007 JOINT COUNCIL MEMBERS

• ABAABA– David Chestnut*David Chestnut*

– Douglas CoursinDouglas Coursin

– Glenn GravleeGlenn Gravlee

– Jeff AndrewsJeff Andrews

-- Jim Di NardoJim Di Nardo

– Cynthia LienCynthia Lien

– Kenneth Tuman*Kenneth Tuman*

• ASAASA– Arnold Berry*Arnold Berry*

– John RowlingsonJohn Rowlingson

– Jeffrey Gross (V.C.)Jeffrey Gross (V.C.)

– Roger MeccaRoger Mecca

– Charles Otto*Charles Otto*

– Patricia PetrozzaPatricia Petrozza

– Robert GaiserRobert Gaiser

New Joint Council MembersNew Joint Council Members

ABA representativesABA representatives• John EmhardtJohn Emhardt• Steve HallSteve Hall

ASA representativesASA representatives• Jerry KlaftaJerry Klafta• Don MartinDon Martin

PlusPlus

• Approximately 30 senior editors, 20 junior Approximately 30 senior editors, 20 junior editorseditors

• And 24 new Junior EditorsAnd 24 new Junior Editors

• PLEASE recognize this as important PLEASE recognize this as important service activity toward promotionservice activity toward promotion– Time consumingTime consuming– Peer reviewedPeer reviewed

IN-TRAINING EXAMINATIONIN-TRAINING EXAMINATION

• ““3 exams in 1”3 exams in 1”– In-Training ExamIn-Training Exam

– Requalifying ExamRequalifying Exam

– ABA Part I ExamABA Part I Exam• Subset of ~300 questions from ITE (350)Subset of ~300 questions from ITE (350)

– 2007: last year for a combined ITE and ABA 2007: last year for a combined ITE and ABA

Part I ExamPart I Exam

– BUT: Content and difficulty blueprints will BUT: Content and difficulty blueprints will

remain as close as possibleremain as close as possible

Demographics of In-Training ExaminationsDemographics of In-Training Examinations

4000

5000

6000

7000

8000

9000

2003 2004 2005 2006 2007Tot

al N

um

ber

of

Exa

min

ees

Registrants

DEMOGRAPHICS OF IN-TRAINING DEMOGRAPHICS OF IN-TRAINING

EXAMINATIONS EXAMINATIONS

0200400600800

10001200140016001800

2001 2003 2004 2005 2006 2007

CA-1 CA-2 CA-3

Num

ber

of R

esid

ents

(n)

Num

ber

of R

esid

ents

(n)

2005 ITE Question Distribution2005 ITE Question Distribution

32

19

76

010

203040

50607080

90100

A K G R

Per

cent

of

Que

stio

ns (

%)

Per

cent

of

Que

stio

ns (

%)

ReminderReminder• K-types will not be on the 2008 examsK-types will not be on the 2008 exams

• A-types, G-types, and (we hope) R-types will A-types, G-types, and (we hope) R-types will remainremain

• Why abandon K-types? Why abandon K-types? – They are not on USMLEThey are not on USMLE– They take longer, and the exam will be shorterThey take longer, and the exam will be shorter– Concern that candidates’ growth in knowledge Concern that candidates’ growth in knowledge

might partly reflect just learning to take K-types might partly reflect just learning to take K-types

-0.8

-0.6

-0.4

-0.2

0

0.2

2002 2003 2004 2005 2006 2007

Log

it Sc

ale

Exam Difficulty

In-training ExamIn-training ExamAverage Scaled ScoreAverage Scaled Score

05

10152025303540

2001 2003 2004 2005 2006 2007

All CA3 Residents

Sca

led

Sco

reS

cale

d S

core

ABA WRITTEN EXAMINATION SUCCESS RATES 1990 - 2007

20%

30%

40%

50%

60%

70%

80%

90%

100%

1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007

All First Takers Total Group All Repeaters

SUBSCORE CATEGORIESSUBSCORE CATEGORIES

• AnatomyAnatomy• Anesthesia ProceduresAnesthesia Procedures• CardiovascularCardiovascular• HematologyHematology• NeuroanesthesiaNeuroanesthesia• Obstetric AnesthesiaObstetric Anesthesia• PainPain

• Pediatric AnesthesiaPediatric Anesthesia• PharmacologyPharmacology• Physics/EquipmentPhysics/Equipment• PhysiologyPhysiology• Regional AnesthesiaRegional Anesthesia• RespiratoryRespiratory

SubscoresSubscores

• Provided to the examineesProvided to the examinees

• NOT provided to the program directors NOT provided to the program directors

• This was not our intentThis was not our intent

• Looking into feasibility of a program report Looking into feasibility of a program report for CA2s (CA3s will not matter in 2008)for CA2s (CA3s will not matter in 2008)– (Do you want this?) (Do you want this?)

Old Exam ReleaseOld Exam Release

• Historically one per year at a 10 year delayHistorically one per year at a 10 year delay

• Held off in 2005 because of concerns about Held off in 2005 because of concerns about size of question banksize of question bank

• Voted in 2006 to release 1995 examVoted in 2006 to release 1995 exam

• Then learned that 2007 exam contained Then learned that 2007 exam contained several questions from 1995 examseveral questions from 1995 exam

• Should release 1995 exam in early 2008Should release 1995 exam in early 2008

When do you want to have the When do you want to have the ITE? ITE?

(A Continuing Saga)(A Continuing Saga)

Joint Council 2005 Survey of Residency ProgramsJoint Council 2005 Survey of Residency Programs

65

2311

0102030405060708090

100

July February Other

Per

cent

(%

)P

erce

nt (

%)

Question: Assuming that the In-training Examination will be Question: Assuming that the In-training Examination will be administered once a year, I would prefer that the exam be given in: administered once a year, I would prefer that the exam be given in:

20062006I would (still) prefer to keep the exam in JulyI would (still) prefer to keep the exam in July

Yes56%

No44%

{2006} I thought we would get more {2006} I thought we would get more votes for Winter/Spring – Why?votes for Winter/Spring – Why?

• Once it’s not simultaneous with ABA Part I Once it’s not simultaneous with ABA Part I exam, giving the ITE sometime between exam, giving the ITE sometime between January 1 and April 30January 1 and April 30– Allows CA3s a “practice run” closer to ABA Allows CA3s a “practice run” closer to ABA

examexam– Provides a better database for CA0s (CA1 yr)Provides a better database for CA0s (CA1 yr)– Provides recent knowledge data for 6/30 CCC Provides recent knowledge data for 6/30 CCC

report - current info is old even for 12/30 report - current info is old even for 12/30

20072007Given the options of July/August or Given the options of July/August or

February/MarchFebruary/March

Feb/Mar77%

July/Aug23%

Computerized Exam ConversionComputerized Exam Conversion

• Target: ABA in 2008, ITE in 2009Target: ABA in 2008, ITE in 2009• [ABA and ITE can’t remain on same day [ABA and ITE can’t remain on same day

because of exam center capacity issues]because of exam center capacity issues]• ABA sooner because of smaller number of ABA sooner because of smaller number of

candidatescandidates• Eventual goal: more creative uses of Eventual goal: more creative uses of

graphics, videos; different question types graphics, videos; different question types and scenariosand scenarios

ABA and ITE ComparabilityABA and ITE Comparability

• Even though they can no longer be the same Even though they can no longer be the same exam on the same day:exam on the same day:

• Question development process will be the Question development process will be the same for both examssame for both exams

• Exam topic distribution will remain the Exam topic distribution will remain the same same

• Most ITE questions will be previous ABA Most ITE questions will be previous ABA questionsquestions

The ideal way to deliver the In-training The ideal way to deliver the In-training

examination to residents is via:examination to residents is via:

A.A. Printed test books – Printed test books – 27%27%

B.B. Computer at a commercial computer-based testing Computer at a commercial computer-based testing center – center – 21%21%

C.C. Internet to secure, proctored centers, which may be at Internet to secure, proctored centers, which may be at the training institution – the training institution – 45%45%

D.D. Both B & C – Both B & C – 2%2%

E.E. No answer – No answer – 5%5%

Joint Council 2005 Survey of Residency ProgramsJoint Council 2005 Survey of Residency Programs

[2006] CBT ITE Administration [2006] CBT ITE Administration ModelsModels

• Could use high-tech high-security centers Could use high-tech high-security centers like ABA Part I, but EXPENSIVElike ABA Part I, but EXPENSIVE

• Or – lower-tech centers at a lower costOr – lower-tech centers at a lower cost

• Or – download to departments, administer Or – download to departments, administer yourselves with standards/guidelines from yourselves with standards/guidelines from Joint Council Joint Council

• Mixed models may be possible Mixed models may be possible

RFP In progressRFP In progress

• Goal: Deliver ITE at a CBT center in early Goal: Deliver ITE at a CBT center in early March, 2009 over 3 or fewer daysMarch, 2009 over 3 or fewer days

• Do this at an affordable cost Do this at an affordable cost

• Do it the same way for all examineesDo it the same way for all examinees

• Get reports by end of April, 2009Get reports by end of April, 2009

Our next P.D. survey MIGHT look Our next P.D. survey MIGHT look like this:like this:

• ITE can be delivered for $100 a candidate ITE can be delivered for $100 a candidate in paper and pencilin paper and pencil

• We’d like to do it via CBT for consistency We’d like to do it via CBT for consistency with ABA Part Iwith ABA Part I

• If this can’t be done for $100 as a CBT, If this can’t be done for $100 as a CBT, how much more would you pay? how much more would you pay?

• Right now, I can only guess that it can be Right now, I can only guess that it can be done for $120-150done for $120-150

ABA Part I Exam: Critical ABA Part I Exam: Critical DatesDates

• Sept 15, 2007: first mailingSept 15, 2007: first mailing• Nov 1, 2007: first reminderNov 1, 2007: first reminder• Nov 15, 2007: final reminderNov 15, 2007: final reminder• Dec 15, 2007: Registration standard deadlineDec 15, 2007: Registration standard deadline• Jan 15, 2008: Late registration deadline (penalty Jan 15, 2008: Late registration deadline (penalty

of $300 PLUS risks loss of preferred exam site)of $300 PLUS risks loss of preferred exam site)• Exam: August 4-5, 2008 (Mon-Tues)Exam: August 4-5, 2008 (Mon-Tues)

– NOT August 4-6 as stated in ABA BOINOT August 4-6 as stated in ABA BOI

Grace Period for ABAGrace Period for ABAPart 1 EnrollmentPart 1 Enrollment

Recently extended from August 31 to Recently extended from August 31 to September 30 for completion of September 30 for completion of residency/fellowship training.residency/fellowship training.

Scheduling with Pearson VUE Scheduling with Pearson VUE

• Instructions sent after fee paid on-line, so Instructions sent after fee paid on-line, so pay fee ASAP:pay fee ASAP:

• Early Bird gets the wormEarly Bird gets the worm– The earlier you register, the better your exam The earlier you register, the better your exam

center and time selectioncenter and time selection– Later registration (especially waiting until May) Later registration (especially waiting until May)

risks the need to travel long distances to an risks the need to travel long distances to an exam center, possibly by planeexam center, possibly by plane

Scheduling PossibilitiesScheduling Possibilities

• Two day test window: August 4-5, 2008Two day test window: August 4-5, 2008

• Morning & afternoon session each dayMorning & afternoon session each day

• Pearson Pearson maymay elect to fill morning slots elect to fill morning slots before offering afternoon ones (still under before offering afternoon ones (still under discussion) discussion)

• Once scheduled, Pearson VUE sends a Once scheduled, Pearson VUE sends a confirmation letterconfirmation letter

Exam Center: Pearson VUEExam Center: Pearson VUE

• Professional, state-of-the-art testing centersProfessional, state-of-the-art testing centers

• High, standardized security (stay tuned)High, standardized security (stay tuned)

• Standardized facilities and layout Standardized facilities and layout

• Audio- & Video-taped surveillanceAudio- & Video-taped surveillance

• Proctoring through an observation window Proctoring through an observation window and “walk-throughs” and “walk-throughs”

Pearson VUE: What we hearPearson VUE: What we hear• Examinees may dislike the high-level security Examinees may dislike the high-level security

and rigid enforcementand rigid enforcement• This is standard for this vendorThis is standard for this vendor• ABA chose Pearson based on amenities and ABA chose Pearson based on amenities and

facilitiesfacilities– The security measures are driven by Pearson VUE The security measures are driven by Pearson VUE

policy with ABA acceptancepolicy with ABA acceptance

• Please share security info with your residents so Please share security info with your residents so it will not be a surpriseit will not be a surprise

Personal items?Personal items?• In a word, NO:In a word, NO:

– Cell phonesCell phones– Hand held computers or digital assistantsHand held computers or digital assistants– Cameras or recording devicesCameras or recording devices– PagersPagers– Watches, wallets, pursesWatches, wallets, purses– Hats, bags, coatsHats, bags, coats– Books and notesBooks and notes

• Lockers provided for these itemsLockers provided for these items

Exam Schedule Exam Schedule

• Nondisclosure Agreement: 5 minutesNondisclosure Agreement: 5 minutes

• Exam tutorial: 10 minutes (once)Exam tutorial: 10 minutes (once)

• Session 1: 2 hours, 20 minutesSession 1: 2 hours, 20 minutes

• 20 minute break 20 minute break

• Session 2: 2 hours, 20 minutesSession 2: 2 hours, 20 minutes

More detailed slide show about More detailed slide show about 2008 ABA Part I Nuts and Bolts2008 ABA Part I Nuts and Bolts

• (Presentation given to ASA Resident HOD (Presentation given to ASA Resident HOD in SF)in SF)

• Now posted on ABA Web site Now posted on ABA Web site www.theaba.orgwww.theaba.org– Go into Primary Certification, ABA Part I Go into Primary Certification, ABA Part I

Examination, click on “slide show” Examination, click on “slide show”

Thank you!Thank you!

glenn.gravlee@uchsc.eduglenn.gravlee@uchsc.edu

Think about: Can you accept a Think about: Can you accept a $200-250 ITE? (now $100)$200-250 ITE? (now $100)

If so, under what conditions? If so, under what conditions?

2006 Survey: Details2006 Survey: Details

• Survey conducted by fax in September, Survey conducted by fax in September, 20062006

• 95 program directors responded95 program directors responded

Assume that the results of the ITE will take 1-2 months to Assume that the results of the ITE will take 1-2 months to produce and deliver to you. If the ITE should occur in a produce and deliver to you. If the ITE should occur in a month other than July, I would prefer that it be given:month other than July, I would prefer that it be given:

August - September

41%

October - December

14%

January - March21%

April - June24%

So, are you having second thoughts So, are you having second thoughts about JULY for the In-training about JULY for the In-training

exam? exam?

Content Outline RevisionContent Outline Revision

• 1996 version1996 version

• 2003 version (convert to organ-based)2003 version (convert to organ-based)

• 2006 revision approved and in progress: 2006 revision approved and in progress:

will apply to 2008 Examwill apply to 2008 Exam– www.asahq.org/publicationsandwww.asahq.org/publicationsandservices/contentoutlinerev2003services/contentoutlinerev2003

Annual Release of Old ITEsAnnual Release of Old ITEs• Not done last year because of concerns Not done last year because of concerns

about question pool size re CBT conversionabout question pool size re CBT conversion

• Joint Council has approved release of 1995 Joint Council has approved release of 1995 ITE ITE

• JC Decided to stop JC Decided to stop selling selling them. Will them. Will provide for free (with answers) on ASA web provide for free (with answers) on ASA web site site

• Released Exams are still copyright-Released Exams are still copyright-protected!protected!

2006 Test Center Issues2006 Test Center Issues

• Nothing of consequence to ITE candidates Nothing of consequence to ITE candidates this yearthis year

• One test center changed its venue without One test center changed its venue without contacting ASA office, hence two contacting ASA office, hence two requalification candidates missed an hour of requalification candidates missed an hour of exam timeexam time

• If you change the exam site, please be so If you change the exam site, please be so kind as to inform us of this changekind as to inform us of this change

To serve you better in 2006 and To serve you better in 2006 and beyond, the Joint Council beyond, the Joint Council

introducesintroduces

SUBSCORESSUBSCORES

% Correctly Answered 2005 ITE% Correctly Answered 2005 ITECalibration GroupCalibration Group

7273

0102030405060708090

100

Book A Book B

Per

cent

Cor

rect

Ans

wer

s (%

)P

erce

nt C

orre

ct A

nsw

ers

(%)

Subscore FrameworkSubscore Framework

• Requires 20+ questions to get a reliable Requires 20+ questions to get a reliable samplesample

• Note standard error is about 3 times that of Note standard error is about 3 times that of the overall ITE scorethe overall ITE score

• Recommend these over Recommend these over key wordskey words in trying in trying to analyze areas of strength or weakness to analyze areas of strength or weakness [either program or resident][either program or resident]

Gaps in Knowledge – CA3sGaps in Knowledge – CA3s

• 8 Surprising Gaps Identified8 Surprising Gaps Identified

• Report sent before ASAReport sent before ASA

• Few repercussions Few repercussions

Information on New ABA Part I Information on New ABA Part I Exam FormatExam Format

Information about ABA Part IInformation about ABA Part I

• Application, Notification and Scheduling Application, Notification and Scheduling

• CBT informationCBT information

• Examination DayExamination Day– Arrival/RegistrationArrival/Registration– Exam conduct/schedule Exam conduct/schedule

• Post-examinationPost-examination

History: ABA Part I (aka Written History: ABA Part I (aka Written Exam)Exam)

• Paper & pencil exam since 1930s, initially Paper & pencil exam since 1930s, initially essayessay• Exclusively multiple choice: 1948Exclusively multiple choice: 1948• Computerized “bubble” scanned scoring: Circa Computerized “bubble” scanned scoring: Circa

1960 (first ITE was 1977)1960 (first ITE was 1977)• Computerized ABA Part I Exam: 2008Computerized ABA Part I Exam: 2008• Computerized In-training Exam: 2009 (we hope)Computerized In-training Exam: 2009 (we hope)

Exam Registration Process Exam Registration Process • Starts with ABA sending you an admission Starts with ABA sending you an admission

letter, which will explain the on-line payment letter, which will explain the on-line payment processprocess

• Letter sent as early as Feb 1, 2008 (all repeat Letter sent as early as Feb 1, 2008 (all repeat candidates, most on-time registrants)candidates, most on-time registrants)

• Late registrants Late registrants will definitelywill definitely receive the receive the letter laterletter later

Scheduling Exam with Pearson VUEScheduling Exam with Pearson VUE

• On-line: On-line: http://http://www.pearsonvue.comwww.pearsonvue.com

• If on-line, you may need to apply for a log-in If on-line, you may need to apply for a log-in name and passwordname and password

• Or: Call the ABA Test center at Pearson VUE Or: Call the ABA Test center at Pearson VUE at 866-468-3848, X2796 M-F between 7 am & at 866-468-3848, X2796 M-F between 7 am & 7 pm 7 pm CENTRAL TIMECENTRAL TIME

CBT in generalCBT in general

• Similarities to USMLE will likely exceed Similarities to USMLE will likely exceed the differencesthe differences

• Pearson VUE instead of Thompson Pearson VUE instead of Thompson PrometricPrometric– More consistent amenities and More consistent amenities and

software/hardware at examination centerssoftware/hardware at examination centers– In general, tighter security measures (e.g., In general, tighter security measures (e.g.,

fingerprint scanning on each entry/exit)fingerprint scanning on each entry/exit)

Exam ContentExam Content

• Predominantly A-type multiple choice (single-best answer)Predominantly A-type multiple choice (single-best answer)• NO K TYPES (more than one correct answer)NO K TYPES (more than one correct answer)• Probably some matchingProbably some matching• Based on ABA/ASA ITE Content Outline, weighted Based on ABA/ASA ITE Content Outline, weighted

according to importance of content area according to importance of content area • 250 questions, i.e., 125 per session250 questions, i.e., 125 per session• Only 225 will be scored (but not identified)Only 225 will be scored (but not identified)• Budget your time: 140 minutes for 125 questions, can Budget your time: 140 minutes for 125 questions, can

scroll backward & forward within each 125-question setscroll backward & forward within each 125-question set

Procedures on Arrival at Test Procedures on Arrival at Test CenterCenter

Again, ABA “authorization to test” Again, ABA “authorization to test” letter is letter is NOT REQUIREDNOT REQUIRED

Procedures on Arrival at Test Procedures on Arrival at Test Center - 2Center - 2

• 2 forms of ID:2 forms of ID:– one must have a photo & signature & be one must have a photo & signature & be

government-issued, non-expiredgovernment-issued, non-expired– Second must bear your signatureSecond must bear your signature– Name on file must exactly match ID (not to the Name on file must exactly match ID (not to the

point of full middle name)point of full middle name)

• Provide signature for validation by Provide signature for validation by comparison with IDcomparison with ID

Procedures on Arrival at Test Procedures on Arrival at Test Center - 3Center - 3

• Obtain fingerprint scanObtain fingerprint scan

• Obtain photo Obtain photo

• Show locker to candidate (explain what Show locker to candidate (explain what must be placed there, enforce that this is must be placed there, enforce that this is done)done)

• Provide erasable noteboard & penProvide erasable noteboard & pen

• Admit candidate to examinationAdmit candidate to examination

Late ArrivalsLate Arrivals

•If within 30 minutes, they may elect to seat If within 30 minutes, they may elect to seat you, you, SCHEDULE PERMITTINGSCHEDULE PERMITTING

•If > 30 minutes late: lost opportunity (you get If > 30 minutes late: lost opportunity (you get 3) plus $100 cancellation fee3) plus $100 cancellation fee

•So arrive on time! (30 minutes before So arrive on time! (30 minutes before scheduled test time)scheduled test time)

Unscheduled Breaks & QuestionsUnscheduled Breaks & Questions• Unscheduled break with the clock running: Unscheduled break with the clock running:

raise your handraise your hand– Must leave room, can access locker for essential Must leave room, can access locker for essential

items (e.g., medications: best to pre-advise proctor items (e.g., medications: best to pre-advise proctor of need)of need)

– May not access cell phones, study guides, etc.May not access cell phones, study guides, etc.– Fingerprint on exit and re-entryFingerprint on exit and re-entry

• Questions on hardware or software problems: Questions on hardware or software problems: also raise your handalso raise your hand

Erasable Noteboards, etc.Erasable Noteboards, etc.

• You will get an erasable noteboard and a You will get an erasable noteboard and a marker for use during the exammarker for use during the exam

• If filled, raise hand and a new one will be If filled, raise hand and a new one will be providedprovided

• Computer terminal has a calculator function Computer terminal has a calculator function that you can accessthat you can access

• Food, drink, and disturbing noise are Food, drink, and disturbing noise are prohibitedprohibited

Exam or Session Complete?Exam or Session Complete?

• Raise your hand, proctor will come to Raise your hand, proctor will come to ensure exam has been properly completed ensure exam has been properly completed (NOT to check your answers)(NOT to check your answers)

• Printout “receipt” acknowledges completion Printout “receipt” acknowledges completion of examof exam

• Optional onscreen evaluation of exam may Optional onscreen evaluation of exam may be offeredbe offered

Irregular BehaviorIrregular Behavior

• Exam center will report this to ABAExam center will report this to ABA

• Disruptive or irregular behavior during the Disruptive or irregular behavior during the exam may cause immediate dismissal from exam may cause immediate dismissal from exam and loss of exam opportunityexam and loss of exam opportunity

• Copying behavior will be reported and Copying behavior will be reported and disciplinary action may ensuedisciplinary action may ensue

Cheating – Never worth itCheating – Never worth it(And especially not now)(And especially not now)

• Thankfully, this is rareThankfully, this is rare

• Different issues with paper-pencil vs CBTDifferent issues with paper-pencil vs CBT

• With CBT, order of questions is scrambled and With CBT, order of questions is scrambled and the exams may be different from seat to seatthe exams may be different from seat to seat

• Cubicle set-up with screens, hence challenging Cubicle set-up with screens, hence challenging to see another screento see another screen

• Potential consequences: Copyright violation Potential consequences: Copyright violation suit, loss of exam/certification accesssuit, loss of exam/certification access

After the ExamAfter the Exam

• Confirmation received from Pearson Confirmation received from Pearson VUE that the exam was completedVUE that the exam was completed

• Score and pass-fail report received Score and pass-fail report received from ABA in approximately 2 monthsfrom ABA in approximately 2 months

• Use your online ABA portal for fastest Use your online ABA portal for fastest accessaccess

Contacting ABAContacting ABA

•www.aba.orgwww.aba.org

•919-881-2570 9a-5p EST or EDT 919-881-2570 9a-5p EST or EDT Monday-FridayMonday-Friday

Other housekeeping detailsOther housekeeping details

• Rescheduling (including a change of Rescheduling (including a change of examination center) is permitted examination center) is permitted if if availableavailable > 24 hours in advance of > 24 hours in advance of scheduled test time/datescheduled test time/date

• ABA will send a letter containing all of the ABA will send a letter containing all of the test rules and procedures (which you need test rules and procedures (which you need not bring with you to the exam)not bring with you to the exam)

QUESTIONS?QUESTIONS?

-0.8

-0.6

-0.4

-0.2

0

0.2

1 2 3 4 5 6

Log

it S

cale

Exam Difficulty

ABA WRITTEN EXAMINATION SUCCESS RATES 1990 - 2007

20%

30%

40%

50%

60%

70%

80%

90%

100%

1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007

All First Takers Total Group All Repeaters

The ideal way for residents to take the The ideal way for residents to take the

In-training examination is:In-training examination is:

• On the same day at the same time – On the same day at the same time – 54%54%

• During an eight-day testing window During an eight-day testing window beginning and ending on a Saturday – beginning and ending on a Saturday – 46%46%

Joint Council 2005 Survey of Residency ProgramsJoint Council 2005 Survey of Residency Programs