Attrition control in a longitudinal Attrition control in a longitudinal
surveysurvey and and preventionprevention on on «« potentiallypotentially
nonnon--respondentsrespondents »»
Florent DomergueFlorent Domergue
DepartmentDepartment of of statisticsstatistics, , studiesstudies and documentationand documentation
General General secretariatsecretariat for immigration and for immigration and integrationintegration
Ljubljana – 17 July 2013
SummarySummary
�� PresentationPresentation of the ELIPA of the ELIPA surveysurvey
�� MethodsMethods to to limitlimit attritionattrition
�� Attrition in Attrition in otherother longitudinal longitudinal surveyssurveys
�� Non Non responseresponse correctioncorrection
�� TreatmentsTreatments on on «« potentiallypotentially nonnon--respondentsrespondents »»
The The DepartmentDepartment of of statisticsstatistics, , studiesstudies
and documentationand documentation
�� Part of the Part of the MinistryMinistry of the of the InteriorInterior sincesince 20102010
�� The The DepartmentDepartment includesincludes : an administrative data : an administrative data treatmentstreatmentsunit and a unit and a surveyssurveys and and studiesstudies unitunit
�� The French The French statisticsstatistics of of integrationintegration are made are made onlyonly in the in the DepartmentDepartment
�� Publications Publications relatedrelated to to mymy workwork ::Domergue, Jourdan : Domergue, Jourdan : http://jms.insee.fr/files/documents/2012/867_2http://jms.insee.fr/files/documents/2012/867_2--
JMS2012_S05JMS2012_S05--2_DOMERGUE2_DOMERGUE--ACTE.PDFACTE.PDFDomergue, Jourdan : Domergue, Jourdan : http://jms.insee.fr/files/documents/2012/957_2http://jms.insee.fr/files/documents/2012/957_2--
JMS2012_CA_S19_JOURDANJMS2012_CA_S19_JOURDAN--ACTE.PDFACTE.PDFJourdan, Bouvier : Jourdan, Bouvier : http://sondages2012.ensai.fr/wphttp://sondages2012.ensai.fr/wp--
content/uploads/2011/01/S9P2_BouvierJourdan.pdfcontent/uploads/2011/01/S9P2_BouvierJourdan.pdf
�� In In progressprogress : Non : Non responseresponse correction for ELIPA correction for ELIPA –– wavewave 33
The The DepartmentDepartment of of statisticsstatistics, , studiesstudies
and documentationand documentation
Main publications (Main publications (relatedrelated to ELIPA) : to ELIPA) :
generalgeneral overviewoverview (Domergue(Domergue--Regnard)Regnard)
economiceconomic integrationintegration (Domergue(Domergue--Jourdan)Jourdan)
econometriceconometric evaluationevaluation of of languagelanguage training training (Le (Le QuentrecQuentrec))
OtherOther issues : issues : housinghousing, , educationeducation, , homogamyhomogamy, social network, , social network, refugeesrefugees, focus on , focus on
womenwomen, discrimination, discrimination
(Bouvier, (Bouvier, BreemBreem, , CoirierCoirier, Collet, Domergue, Garcin, Jourdan, , Collet, Domergue, Garcin, Jourdan, LeQuentrecLeQuentrec, Regnard), Regnard)
SeeSee : http://www.immigration.interieur.gouv.fr/Info: http://www.immigration.interieur.gouv.fr/Info--ressources/Documentation/Etudes/Etudesressources/Documentation/Etudes/Etudes--etet--documentsdocuments
And :And : hhttp://www.immigration.interieur.gouv.fr/Infottp://www.immigration.interieur.gouv.fr/Info--ressources/Documentation/Publicationsressources/Documentation/Publications
ELIPA : Longitudinal ELIPA : Longitudinal surveysurvey on the on the
integrationintegration of firstof first--time time arrivalsarrivals
�� French public French public statisticalstatistical system system surveysurvey
�� ConductedConducted alongsidealongside OECD, INSEEOECD, INSEE……
�� FundedFunded by by bothboth the the MinistryMinistry and the European and the European CommissionCommission
�� Total Total costcost : 3 M : 3 M -- 3,5 M 3,5 M €€ over over threethree waveswaves
�� Migrants Migrants whowho gotgot theirtheir first first residenceresidence permit in 2009, permit in 2009, allowingallowing themthem to to staystay in France in France atat least one least one yearyear (but (but likelylikely to to staystay indefinitelyindefinitely).).
�� AgedAged 18 and over18 and over
�� ComingComing fromfrom «« thirdthird countriescountries »», i.e. , i.e. outsideoutside EEA and EEA and SwitzerlandSwitzerland and living in 4 and living in 4 regionsregions in Francein France
�� SignatoriesSignatories of the of the «« receptionreception and and integrationintegrationcontractcontract »» (R&I)(R&I)
�� Questionnaire Questionnaire translatedtranslated in 14 in 14 languageslanguages
ELIPA : Longitudinal ELIPA : Longitudinal surveysurvey on the on the
integrationintegration of firstof first--time time arrivalsarrivals
�� KnowledgeKnowledge of the of the integrationintegration pathpath of the new of the new migrantsmigrants
EconomyEconomy ((activityactivity, , incomeincome))
«« HumanHuman capitalcapital »» ((languagelanguage skillsskills, , educationeducation))
Living conditions (Living conditions (housinghousing, , familyfamily and social life, and social life, accessaccess to to rightsrights……))
�� Evaluation of public Evaluation of public policiespolicies of of receptionreception
MigratoryMigratory and administrative and administrative processesprocesses
AssessmentAssessment of the R&Iof the R&I
ELIPA : Longitudinal ELIPA : Longitudinal surveysurvey on the on the
integrationintegration of firstof first--time time arrivalsarrivals
�� 11stst wavewave : : springspring 20102010
6,107 people 6,107 people interviewedinterviewed
�� 22ndnd wavewave : : springspring 20112011
4,756 people 4,756 people interviewedinterviewed (78 %)(78 %)
�� 33rdrd wavewave : : springspring 20132013
3,573 people 3,573 people interviewedinterviewed (75 %)(75 %)
ELIPA : Longitudinal ELIPA : Longitudinal surveysurvey on the on the
integrationintegration of firstof first--time time arrivalsarrivals
�� LimitLimit attrition due to nonattrition due to non--contactcontact
�� LimitLimit attrition due to attrition due to refusalrefusal
MethodsMethods usedused to to limitlimit attritionattrition
�� ReplyReply coupon coupon delivereddelivered to to respondentsrespondents in W1in W1
�� A A twotwo--stage stage followfollow--up :up :
TelephoneTelephone followfollow--upup
ReplyReply coupon (coupon (onlyonly for people for people unreachableunreachable by phone)by phone)
�� MatchingMatching withwith an administrative sourcean administrative source
LimitLimit attrition due to nonattrition due to non--contactcontact
FollowFollow--up data up data
81 %
19 %
6,107 respondents in
wave 1
711 people reached by
coupon (267 new
addresses)
1,182 people unreached
(neither by phone nor by
coupon)
1,893 people unreached
by phone
4,214 people reached by phone (990
new addresses)
69 % 31 %
19 %12 %
The administrative sourceThe administrative source
�� ResidenceResidence permitspermits databasedatabase
�� MatchingMatching made possible made possible throughthrough the the numbernumber of of theirtheirresidenceresidence permit, permit, askedasked to to respondentsrespondents
�� Double contribution : Double contribution :
ProvidesProvides new new addressesaddresses uncollecteduncollected by the initial by the initial followfollow--upup
Corrects the Corrects the addressesaddresses whenwhen theythey are are incompleteincomplete
�� In all, 500 In all, 500 addressesaddresses have been have been foundfound or or modifiedmodified
LimitLimit attrition due to attrition due to refusalrefusal
�� SendingSending of (in the of (in the effective effective languagelanguage of the interview) :of the interview) :
A A prepre--notification notification letterletter
A brochure on the main A brochure on the main resultsresults of the first of the first wavewave
�� SurveyedSurveyed people people requestionedrequestioned by the by the samesame
interviewer, if possibleinterviewer, if possible
�� TollToll--free free numbernumber
ComparisonsComparisons withwith previousprevious
longitudinal longitudinal surveyssurveys
DateSample
size
Response
rate (%)
Wave 1 march 94-dec 95 5,192
Wave 2 march 95-feb 97 4,465 86
Wave 3 march 97-feb 99 3,894 87
Wave 1 april 01-may 02 12,040
Wave 2 dec 02-dec 03 9,322 77
Wave 3 nov 04-nov 05 7,716 83
Wave 1 june 03-june 04 8,573
Wave 2 2007-2009 3,500 40
Wave 1 may 05-april 07 7,137
Wave 2 may 06-april 08 6,156 86
Wave 3 nov 07-oct 09 5,144 84
Wave 1 sept 06-jan 07 6,280
Wave 2 sept 07-dec 07 3,882 62
Wave 1 march 10-june 10 6,107
Wave 2 march 11-june 11 4,756 78
Wave 3 march 13-june 13 3,573 75
ELIPA (France)
LisNZ (New Zealand)
PPM (France)
Surveys
LSIA 1 (Australia)
Elic (Canada)
Nis (USA)
WhatWhat cancan explainexplain ElipaElipa’’ss lowerlower
attrition attrition comparedcompared to PPM ?to PPM ?
�� The use of the administrative source (500 The use of the administrative source (500 addressesaddresses))
�� The brochure on the main The brochure on the main resultsresults of the first of the first wavewave
�� The interviewers The interviewers experienceexperience ((mostmost of of themthemparticipatedparticipated in PPM)in PPM)
RefusalRefusal and non contact and non contact analysisanalysis
��ModellingModelling non non responseresponse due to due to refusalrefusal or non or non
contact contact involvesinvolves 5 types of variables :5 types of variables :
SocioSocio--demographicdemographic variablesvariables
Social life variablesSocial life variables
LanguageLanguage skillsskills variables variables
R&I variablesR&I variables
Variables Variables relatedrelated to the to the progressprogress of the interviewof the interview
Common Common characteristicscharacteristics of of refusalrefusal
and non contactand non contact
�� Young people Young people
�� LowLow levellevel of frenchof french
�� CommunityCommunity social networksocial network
�� LackLack of of interestinterest in the R&I trainingsin the R&I trainings
�� General General lacklack of of interestinterest in the in the wavewave 1 1 surveysurvey ::
An end of An end of periodperiod contactcontact
A qualitative postA qualitative post--surveysurvey refusalrefusal
Interviewer Interviewer poorlypoorly receivedreceived
WaveWave 3 : 3 : preventionprevention of attritionof attrition
� Limit attrition by focusing on a sub-population who isless likely to answer the survey (the « potentially non respondents »)
� 2 series of probability for the respondents in W2 :
Probability of being contacted
Probability of answering
«« The The potentiallypotentially nonnon--respondentsrespondents »»
Low 10%
Higher 90%
Total 100%
2%
8%
10%
8%
82%
90%
Probability of
answering the
survey
Probability of being
contacted
Low Higher
Total
WhatWhat guidances ?guidances ?
� End of period contact in wave 2
To be contacted as a priority
�Difficulties in understanding French during the interview
Suggest one of the 13 foreign languages
�All characteristics
Brochure on the results
Attrition in Attrition in WaveWave 33
75 65
25 35
0%
100%
Total (n=4,756) Priority interviews (n=190)
Success Failure
ThanksThanks for for youryour attentionattention