fighting back against fraud in the academic space · fighting back against fraud in the academic...
TRANSCRIPT
Fighting Back Against
Fraud in the Academic Space
Michelle Hampton, Educational Testing Service
Margit Schatzman, Educational Credential Evaluators, Inc.
John J. Wood, University at Buffalo (SUNY)
Session Outline
Introductions
Examine Fraud in the following Academic
Spaces:
- Standardized Testing
- Credentials Evaluation
- Institutional
- Group discussion of Best Practices
Testing Fraud Has Changed Over
TimeTHEN
• Low tech
• Individual misconduct
• Localized action
NOW
• High tech
• Global scale, across time zones
• Organized rings and individual misconduct
• Big business
New challenges require new tools and
processes
The TOEFL® Test Approach to
Security
ETS takes test security extremely seriously
and uses a three-pronged approach to protect
test integrity
Prevention
DetectionCommunication
Security - Prevention
1. Test design – reduce item memorization
2. Encrypted test delivery/return of results
3. Training and certification of test center staff
4. Digital test day photo provided on score report
5. Test taker photo appears on assigned computer at start of test and at break
Security - Detection
1. When there are concerns about score validity
– Review individual scores
– Review test center scores
– Voice analysis, handwriting analysis
– Other confidential measures
Biometric Voice Identification
Uses statistical pattern-matching techniques,
advanced voice classification methods and input
from multiple systems to compare speech
samples from TOEFL® test takers
– Introduced in 2012 for security investigations
– Since February 8, 2014 now used on all test takers
worldwide before scores are released
Biometric Voice IdentificationDetects impersonation in three ways:
– Potential impersonators within a test center
• Compare voiceprints with speech samples for all test takers in a given test center
– Repeat test takers
• Compare voiceprints with speech samples across multiple administrations for the same test centers
– Known impersonators within a group
• Compare voiceprints with speech samples of known imposters to all test takers within a suspect group
Additional Measures– Implementation of electronic wands at all test
centers worldwide to detect electronic
photographic, audio or recording devices
– New techniques to ensure the authenticity of test-
taker photographs
– Requirements of second-generation government
ID document in China
– Always piloting new measures - i.e., facial
recognition
Security - Detection
2. When policy or procedural irregularities are discovered
– Scores are canceled
– Test center is closed
– Scores from previous administrations are reviewed
– Institutions are informed
Security - Communication
1. When scores are cancelled, ETS contacts all institutions designated by the student to receive scores
2. Communication from institutions with concerns about possibly fraudulent scores helps our investigations
3. Every concern is investigated by the Office of Testing Integrity (OTI)
4. ETS notifies you with the results of any investigation
Security - Communication
Ways to reach the Office of Testing Integrity
Email: [email protected]
Security Hotline: 1-800-750-6991
Assisting Institutions
The TOEFL® Program revised its policies and procedures to assist institutions
– Eliminated student permission requirement to tell institution why a score has been cancelled
– Simplified process for institutions to learn why a score has been canceled
– Provided new data fields to score reports: ID type, last four digits of ID number and issuing country
– Free test vouchers available for universities where scores are canceled for students already on campus
The Fight Against Fraud is Never
OverNo single form of prevention or detection will work for all kinds of fraud
– Cheating attempts have become increasingly sophisticated
– Constantly evolving technology enables new forms of fraud
– Individuals and organized rings constantly changing tactics
ETS continually works to develop new tools and strategies to combat fraud
We welcome your help
Responding to Test Fraud
The following have been reported by institutions as actions they have taken when scores were canceled due to inappropriate behavior:
– Ask ETS for the letter given to the test taker
– Call in the student and ask for an explanation
– Require retesting since the score is no longer valid
– Require the student to do an intensive English program if studies are not going well due to language
– Expulsion
Fighting fraud in the credential evaluation process…
• Develop consistent approach– Carefully designed documentation requirements
• Promote appropriate expertise– High resolution image scanning and tracking of
document forensics
• Verify documents
• Follow up with appropriate actions
Institute Safer Document Policies
• Request a full educational history supported by a full set of official documentation
• Request documents to be sent directly from the issuing institution (if possible)– Request documents issued in the official language of the country
(known exceptions: US-based educational systems, e.g. Taiwan, Philippines etc.)
• Request original documents for closer review– Offer safe document return procedures
• Send documents for verification
20
Review Institution and Program Status
• Identify the recognition status of the institution– Recognized institutions
– Unrecognized institutions
– Diploma mills
• Identify the program status– Program offered at the time of study
– Name of qualification awarded
– Transnational program arrangements
21
Analyze Credentials
• Develop a check-list that will help investigate the following:– Applicant personal data and educational chronology
– Source of document
– Document appearance
– Document content
• Do not give in to applicant’s pressure (pressing deadlines, missing or unacceptable documents)
• Retain sample credentials for future comparison
• Note your observations for future reference when document is being held up for verification
22
Verify Documents
• Keep verification letters brief and to the point!– Use form letters and native language if possible for best results
• Write to the issuing institution– Address the letter to the person who normally is in charge of issuing
documents
– Avoid using specific person’s names
• Ask only reliable sources for assistance in obtaining contact information– Do not accept contact information from the student unless it can be
verified through official resources
• Say “thank you” when you receive a response!
23
Online Verifications
• Government databases
• Private or government agency services
• Individual institution databases
• Lists of graduates/lists of results
UKRAINEGovernment Database
• On-line database available for diplomas awarded in the current (plastic) format beginning 1998
• Now website available in English
• Free registration required to set up account
• Use login to access Verification service
• Green = positive result
• Red = negative result
25
http://www.osvita.net/checkdoc.php
WEST AFRICAWAEC Online Verification
Candidate must buy a scratch card in person
Information on where cards can be purchased is found on the respective websites
Additional access details, like how to use the card, are given on the websites
For exams taken prior to the online system, students must request a Statement of Results / Confirmation of Results to be sent directly to a third party
28
Individual Institution Verification(Peking University on-line verification)
graduate program verification (The system functions
in both English and Chinese.)
http://www.pku.edu.cn/graduate/diplomaEN.html
Works mostly for credentials issued after 1990.
undergraduate program verification
http://dean.pku.edu.cn/certificate/ (credentials from 1981 to
2009)
Only functions in Chinese. The top link is for graduation
certificates, the bottom link is for degree certificates
The database does not include double majors, medical
majors and adult education programs, for those they
provide contact phone numbers.
32
Government Agency ServiceChina - CDGDC
China Academic Degrees & Graduate Education Development Center (CDGDC)
Website:http://www.cdgdc.edu.cn/China Academic Degrees & Graduate Education Development Center (CDGDC)Credential DepartmentB 18, Tongfang Scientific BuildingNo. 1 Wangzhuang Road, Haidian DistrictBeijing 100083People’s Republic of China
Fax: (008610) 82379491E-mail: [email protected]
35
CDGDC Verification Report
36
Background colors:
BLUE = Verification confirms
authentic documents
PINK = Verification confirms
fraudulent documents
YELLOW = Duplicate Verification
copy
38
Undergraduate: http://www.dgae-siae.unam.mx/ and click "Acceso”
Graduate: go to http://www.uap.unam.mx/ enter the Numerode cuenta and the students birthdate (NIP) to access their transcript. (2)
Numero de cuenta (without dashes, start with zero for pre-2000
Usually, it’s the DOB (ddmmyyyy), but student can reset it. Ask for NIP if it’s been reset.
•http://www.igmohe.gov.iq/rwabitKhrijeen.html
Lists of GraduatesIraq – links to graduate listings online
htt
p:/
/ww
w.r
yers
on
.ca/
curr
ents
tud
en
ts/e
ssr/
Individual InstitutionVerification Database
Canada – Ryerson University
http://www.minesup.gov.cm/
Online Exam ResultsCameroon – Ministry of Higher Education
National Examinations
Institutional Perspective
2. Preventing/detecting fraud in:
• Academic records
• Essays and recommendations
3. Avoiding fraud on campus: promoting and
enforcing academic integrity
1. What are universities looking for in the
admissions process?
What are universities looking for
when they admit students?
1. Potential for success
2. A specific academic profile
3. Potential to contribute to class profile
4. Potential to enrich campus and community
5. In other words, a good “match”
Problem of Fraud
1. “Matches” based on fraud serve no one
2. Students perpetrating fraud are more likely to
fail in the long term
3. Agents and counselors committing fraud on
student’s behalf betray student and the
process
4. Institution can suffer harm also
Avoiding Fraud
with Academic Records
1. Using a credential evaluation service confers
the highest level of security and least risk to
institution
2. Next best thing is to have in-house
expertise—know what to expect, what to look
for
3. Verify when possible and use a holistic
approach
Tips to Avoid Fraud
1. Accept documents only from entity
authorized to issue them
2. Require submission in official, properly
sealed envelopes
3. Board exam results should be submitted
directly to the institution
Essays and Personal Statements
1. Purpose of these documents should be clear
for both the applicant and the institution
2. Is content, language proficiency, personal
motivation, etc the primary consideration?
3. Question of authenticity: “Who wrote this?”
Tips to Avoid Fraud
1. Be sure purpose and expectations are clear
2. Be sure writing prompt is clear
3. Indicate how the piece of writing will be
used/evaluated
Tips to Avoid Fraud
1. Alert applicants to format/style requirements,
use of anti-plagiarism software; reference
appropriate tools/resources
2. Be very clear about consequences of fraud
(plagiarism, omission of information, etc)
What to Watch for
1. Font changes, inconsistent spelling (US vs.
UK), lack of coherence
2. Inconsistency between quality of writing and
submitted test scores and grades
3. Uncited concepts, terms, theories that derive
from recently published work
Recommendations
1. One to three letters is standard (for graduate
programs)
2. Checklist of applicant’s academic attributes
3. Narrative section
4. Applicant agreement not to have access to
recommendations
Tips to Avoid Fraud
1. Be clear about what type of recommendation
is desired (academic vs. professional)
2. Check that recommendation supports other
parts of the application
3. Confirm relationship of applicant and
recommender
4. Verify recommendations
Promoting Academic Integrity
1. Be sure institution has explicit and consistent
policies on academic integrity and process for
handling violations, with penalties made clear
2. Alert students pre-arrival about academic
integrity policies
3. Educate incoming students about policies and
procedures at orientation and in follow-up
outreach
Fraud on Exams and Papers“Alleged exam cheating leads to fraud charges against 2students in Waterloo
Two Ontario university students have been charged with forgery and fraud after a first-year student allegedly paid a PhD student $900 to write her final math exam.University of Waterloo officials said a 26-year-old PhD student at Toronto's York University was contacted by the first-year student through a website connecting international students to others who are willing to write exams for compensation.The 20-year-old University of Waterloo student allegedly paid $900 to the York student, and provided a fake student ID so he could write her exam.” (CBC News, Dec. 18, 2014)
Fraud on Exams and PapersFROM AN EMAIL CIRCULATED AT UB IN SUMMER 2014:
summer的又一个section开始了,有木有觉得作业太难不会写?有木有觉得lab数据太烦很难算?有木有觉得作业太多没空玩耍?有木有觉得考试不会焦头烂额?这里能解决你的需求
代写MTH,及其他一切与编程有关的作业
出售CHE101 LAB计算表格,excel格式,自动计算,输入实验数据即可自动得到答案,简单易用,完全照搬书本表格
代考MTH,及其他一边与编程有关考试,可指定要考到的分数,误差不超过5%的分数
有需求的请回复邮件或联系QQ446579909