gg2012 3.2 sandy bhangal

7/31/2019 GG2012 3.2 Sandy Bhangal

1/33

Copyright 2012 by Educational Testing Service. All rights reserved. ETS, the ETS logo, TOEFL and TOEFL iBT are registered trademarks of Educational Testing Service (ETS). IELTS is a trademark of theUniversity of Cambridge ESOL Examinations. 19030

Best Pr act i ce s f o r Best Resu l t s :Using TOEFL i BT Tes t Scor es

f o r A d m i ssi o n s D eci si o n s

Goin g Glob a l

Sandy Bhangal, ETS GlobalDiane Schmitt, BALEAP


2/33


W h at i s t h e TOEFL Tes t?

The TOEFL test measures the ability of nonnativespeakers to use and understand English as it isspoken, written and heard in college and university

settings Used primarily for admission into universities

where English is the language of instruction

Accepted at both undergraduate and postgraduatelevels

Also used for immigration, licensing, scholarships

and placement

2


3/33


Th e TOEFL Te st Fo r m a t

Section Description Testing Time Score ScaleReading 3-4 passages from academic texts;

12-14 questions per passage60-80 min. 0-30

Listening 4-6 lectures, some with classroomdiscussion, 6 questions each;

2-3 conversations, 5 questions each

60-90 min. 0-30

Break - 10 min. -

Speaking 2 tasks to express an opinion;4 tasks to speak based on reading

and listening passages

20 min. 0-30

Writing 1 integrated task (write based onwhat is read and listened to);

1 independent task (support anopinion on a topic)

50 min. 0-30

Total - - 0-120

3

Note-taking is allowed in all sections.


4/33


Scoring process ensures fairness and integrityof scores Rigorous rater training Daily calibration for Speaking and Writing raters Multiple raters for Speaking and Writing

Three to six raters for Speaking responses Four ratings for Writing responses

Scoring is separate from the testing site tomaintain score integrity

Raters see and hear worldwide responses,not just from one country

Anonymous raters do not know the examinee

4

Scor in g Se t s t h e TOEFL Test Apa r t


5/33


The TOEFL program uses the e-rater automated scoring engine in a limited andresponsible way for the Writing section

Independent Writing task one human rater + one automated rating

Integrated Writing task

one human rater + one automated rating

Combines the judgment of humans for content

and meaning and the consistency of automatedscoring for linguistic features

5

W h a t TOEFL d o e s


6/33


Measures the mechanical aspects of writing sufficiently,but content is measured only at a basic level

The kinds of test questions designed only for automatedscoring are more coachable and promote rote learning,not practice of real communication skills

Repeat a sentence out loud Read a sentence out loud

At present, no automated scoring engine can evaluatecontent and meaning at the sophisticated level tested by

theTOEFL iBT

writing tasks without also having thecontributions of a human scorer

6

Au t o m a t ed Sco r i n g


7/33


TOEFL i BT Scores

Four skill scores Reading 0-30 Listening 0-30

Speaking 0-30 Writing 0-30

Total score: 0-120

Score reports sent within 10 calendar daysafter test

TOEFL test scores are valid for two yearsfrom the test administration date


8/33


Se cu r i t y - e n h a n c ed Sco r e Re p o r t s

8


9/33


Pe r f o r m a n c e Fe ed b a ck o n Ex a m i n e e Re p o r t


10/33


T OEFL i B T

Readi ng Sc ores

10


11/33


TOEFL i B T

Speak ing Sc ores

11


12/33


Holistic score Test takers are rated on:

Topic development (especially forintegrated tasks)

Delivery Language use

Ratings are 04 from rubrics Converted to a scaled score of 030

Sp eak in g Scor es


13/33


Sp e ak i n g Ben ch m a r k s

What is a benchmark?

Listen to the four Benchmarks for SpeakingTask #2 Independent Speaking


14/33


I n d ep e n d e n t Sp e ak i n g Task


15/33


Be n ch m a r k Sp e a k i n g Re sp o n se s

Benchmarks independent speaking

Annotations provide narrative descriptionof the level

Each score represents a range of ability

Level 4

Level 3

Level 2

Level 1


16/33


I n t eg r a t ed Sp e ak i n g Ta sk

Task #5 Problem/Solution A Listening/Speaking campus situation topic Consists of one source, a listening passage,

a single question

The test taker hears a conversation betweentwo people about a campus topic less than 90seconds

The test taker is asked to briefly summarizethe problem and to express a personal opinionabout the topic

Note-taking allowed

Preparation time: 20 seconds Response time: 60 seconds


17/33



18/33



19/33


Speak in g Respo n ses

Listen for the following key points Student #1 stressed out because she has

too much homework a paper to write, twoexams to study for and math problems tocomplete

Student #2 recommends two possiblesolutions

Ask her professors for an extension on

paper and math work Create a schedule to manage her timeand focus her energies

Then test taker states which solution he/sheprefers and explains why

Sample #1 Sample #2


20/33


T OEFL i B T

Wri t ing Sc ores

20


21/33


TOEFL Sco r e Req u i r em en t s

ETS does not determine which students musttake the TOEFL test, nor does ETS establishthe TOEFL score requirementsinstitutions/agencies should use in making

their decisions Each institution sets its own policy on whether

a TOEFL score is required as well as theminimum TOEFL score they will accept

ETS supports each universitys individual

decision on who should be required to submita TOEFL score

21


22/33


Gen er a l Gu id e l in es f o r Goo d Scor e Use

Base evaluation of an applicants readiness tobegin academic work on all available relevantinformation, not solely on TOEFL scores Look for other supporting evidence of

English-proficiency in the application

Use score ranges rather than rigid cut scoreson the TOEFL test to help make admissionsdecisions

22


23/33


TOEFL UKBA sco r es

23

B1 LEVEL B2 LEVEL

Reading 4 Reading 18

Listening 9 Listening 17

Speaking 16 Speaking 20

Writing 13 Writing 17

To t a l s 4 2 To t a l s 7 2


24/33


S e t t i n g TOEFL Sco r e Re q u i r e m e n t s

There are many options for settingTOEFL

score requirements Require total score only Require a total score but review applicant

section scores for the skills most important toyour program

Require a total score and a minimum sectionscore for the most important skill(s)

Require minimum section scores only (mostrestrictive)

It is important to consider scores from allEnglish-proficiency tests in the same manner

24


25/33


Using TOEFL Sect io n Scor es

Reading Listening Writing Speaking TotalStudent 1 18 22 16 24 80Student 2 20 20 20 20 80Student 3 25 25 16 14 80

25

A ll t h r e e st u d e n t s h av e a t o t a l sco r e o f 8 0 , b u tt h e y h a v e d i f f e r e n t p r o f i l es o f En g l i sh sk i l ls .

W h i ch s t u d e n t i s b est f o r y o u r p r o g r a m ?


26/33


Rev i ew y o u r sco r e r eq u i r em en t s r eg u l a r l y

How much English is enough? Different departments have different needs What language skills are important for success in

this program?

Level of ESL support available

Competitive situation Higher score requirements could reduce

applications Lower scores could result in student failure, need

for ESL support or slowing down the rest of theclass

26


27/33


Conduct a Standard Setting Session using the freeTOEFL Standard Setting CD-ROM

Select a panel of 10-12 faculty members, including

ESL and admissions staff Follow procedures outlined on CD-ROM

Listen to TOEFL test items and responses at variouslevels and determine minimum acceptableperformance

Analysis of panelists decisions determines panelsselection of minimum acceptable TOEFL

requirements for each skill

27

Se lec t ing TOEFL Sco r e Re q u i r e m e n t


28/33


Test a n d Sco r e Da t a Su m m a r y f o r TOEFL i BT

Percentile data Score means listed by total population,native language, native country, genderand purpose for taking the test(i.e., Undergraduate, Graduate, orProfessional License)

Based on data from previous testing year Annual publication available for downloadfrom the Research section of the TOEFL

website ( www.ets.org/toefl ) b y thebeginning of Q2

28
http://www.ets.org/toeflhttp://www.ets.org/toeflhttp://www.ets.org/toefl


29/33

C i TOEFL i BT d I ELTS S


30/33


30

C o m p a r i n g TOEFL i BT and I ELTS Scores

Research report at http://www.ets.org/toefl/comparescores


31/33


TOEFL i BT Scor e Com p ar i son Too l

The comparison table was created as an initialstep for universities that wanted to compareTOEFL iBT and IELTS scores

ETS recommends the table be used forpurposes of general understanding and not forestablishing cut scores

It is not appropriate to use the comparisontable to project an applicants IELTS or TOEFLiBT score

Follow up validity studies are recommended tovalidate the score comparisons

31

TOEFL I f t i d C t t


32/33


TOEFL I n f o r m at i on an d Co n t act s

TOEFL website for institutions:www.ets.org/toefl/institutions

TOEFL website for students:http://www.toeflgoanywhere.org

Sandy BhangalUK Client Relations [email protected] Schmitt [email protected]

ETS Listening. Learning. Leading.

Copyright 2011 by Educational Testing Service. All rights reserved. ETS, the ETS logo, LISTENING.LEARNING. LEADING., GRE and POWERPREP are registered trademarks of Educational TestingService (ETS). BETTER BY DESIGN and SCOREITNOW! are trademarks of ETS. All other trademarksare property of their respective owners .
http://www.ets.org/toefl/institutionshttp://www.toeflgoanywhere.org/mailto:[email protected]:[email protected]:[email protected]:[email protected]://www.toeflgoanywhere.org/http://www.ets.org/toefl/institutions


33/33

C ight 2012 b Ed ti l T ti g S i All ight d ETS th ETS l g TOEFL d TOEFL iBT gi t d t d k f Ed ti l T ti g S i (ETS) IELTS i t d k f th

Questions?

gg2012 3.2 sandy bhangal

Documents