overview of 2010 ehc-capi field test and objectives jason fields housing and household economic...
TRANSCRIPT
![Page 1: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/1.jpg)
Overview of2010 EHC-CAPI Field Test
and Objectives
Jason Fields
Housing and Household Economic Statistics Division
US Census Bureau
Presentation to the ASA/SRM SIPP Working Group
November 17, 2009
![Page 2: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/2.jpg)
“Re-SIPP” Development
* Following successful completion of • the EHC Paper Field Test
![Page 3: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/3.jpg)
“Re-SIPP” Development
* Following successful completion of • the EHC Paper Field Test
* Develop the 2010 plan to test an electronic EHC instrument
![Page 4: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/4.jpg)
“Re-SIPP” Development
* Following successful completion of • the EHC Paper Field Test
* Develop the 2010 plan to test an electronic EHC instrument
* Broad involvement across Census Bureau- DID - FLD - TMO- DSD - HHES- DSMD - SRD
![Page 5: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/5.jpg)
Primary Goals of 2010 Test
![Page 6: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/6.jpg)
Primary Goals of 2010 Test(1) Strong evidence of comparable data quality
![Page 7: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/7.jpg)
Primary Goals of 2010 Test(1) Strong evidence of comparable data quality
- How well do the calendar year 2009 data from the 2010 EHC-CAPI Field Test match data from the 2008 SIPP panel?
![Page 8: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/8.jpg)
Primary Goals of 2010 Test(1) Strong evidence of comparable data quality
- How well do the calendar year 2009 data from the 2010 EHC-CAPI Field Test match data from the 2008 SIPP panel?
- Especially for income transfer programs
![Page 9: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/9.jpg)
Primary Goals of 2010 Test(1) Strong evidence of comparable data quality
- How well do the calendar year 2009 data from the 2010 EHC-CAPI Field Test match data from the 2008 SIPP panel?
- Especially for income transfer programs
(2) Strong evidence to guide development and refinement before implementation in 2013 as the production SIPP instrument
![Page 10: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/10.jpg)
Basic Design Features (1)
![Page 11: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/11.jpg)
Basic Design Features (1)
8,000 Sample Addresses
![Page 12: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/12.jpg)
Basic Design Features (1)
8,000 Sample Addresses
- could have been larger!
- enough sample and budget to support research and field activities
![Page 13: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/13.jpg)
Basic Design Features (1)
8,000 Sample Addresses
- could have been larger!
- enough sample and budget to support research and field activities
“High Poverty” Sample Stratum
![Page 14: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/14.jpg)
Basic Design Features (1)
8,000 Sample Addresses
- could have been larger!
- enough sample and budget to support research and field activities
“High Poverty” Sample Stratum
- to evaluate how well income transfer program data are collected
![Page 15: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/15.jpg)
Basic Design Features (1)
8,000 Sample Addresses- could have been larger!- enough sample and budget to support research and field activities
“High Poverty” Sample Stratum- to evaluate how well income transfer program data are collected
State-Based Design
![Page 16: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/16.jpg)
Basic Design Features (1)
8,000 Sample Addresses- could have been larger!- enough sample and budget to support research and field activities
“High Poverty” Sample Stratum- to evaluate how well income transfer program data are collected
State-Based Design- likely (possible?) access to admin records
![Page 17: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/17.jpg)
RO State Sample N Notes
BOS Connecticut
Massachusetts
New York
Rhode Island
204
465
366
120
1,155
covers upstate (non-NYC) NY
![Page 18: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/18.jpg)
RO State Sample N Notes
BOS Connecticut
Massachusetts
New York
Rhode Island
204
465
366
120
1,155
covers upstate (non-NYC) NY
NY New York 1,681 covers NYC portion of NY
![Page 19: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/19.jpg)
RO State Sample N Notes
BOS Connecticut
Massachusetts
New York
Rhode Island
204
465
366
120
1,155
covers upstate (non-NYC) NY
NY New York 1,681 covers NYC portion of NY
PHIL Maryland 280
![Page 20: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/20.jpg)
RO State Sample N Notes
BOS Connecticut
Massachusetts
New York
Rhode Island
204
465
366
120
1,155
covers upstate (non-NYC) NY
NY New York 1,681 covers NYC portion of NY
PHIL Maryland 280
CHI Illinois
Wisconsin
620
132
752
excludes 57 IL addresses in KC-RO
![Page 21: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/21.jpg)
RO State Sample N Notes
BOS Connecticut
Massachusetts
New York
Rhode Island
204
465
366
120
1,155
covers upstate (non-NYC) NY
NY New York 1,681 covers NYC portion of NY
PHIL Maryland 280
CHI Illinois
Wisconsin
620
132
752
excludes 57 IL addresses in KC-RO
DAL Texas
Louisiana
1,382
325
1,707
![Page 22: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/22.jpg)
RO State Sample N Notes
BOS Connecticut
Massachusetts
New York
Rhode Island
204
465
366
120
1,155
covers upstate (non-NYC) NY
NY New York 1,681 covers NYC portion of NY
PHIL Maryland 280
CHI Illinois
Wisconsin
620
132
752
excludes 57 IL addresses in KC-RO
DAL Texas
Louisiana
1,382
325
1,707
LA California 2,407 excludes 445 CA addresses in SEA-RO
![Page 23: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/23.jpg)
RO State Sample N Notes
BOS Connecticut
Massachusetts
New York
Rhode Island
204
465
366
120
1,155
covers upstate (non-NYC) NY
NY New York 1,681 covers NYC portion of NY
PHIL Maryland 280
CHI Illinois
Wisconsin
620
132
752
excludes 57 IL addresses in KC-RO
DAL Texas
Louisiana
1,382
325
1,707
LA California 2,407 excludes 445 CA addresses in SEA-RO
TOTAL N: 7,982
![Page 24: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/24.jpg)
RO State Sample N Notes
BOS Connecticut
Massachusetts
New York
Rhode Island
204
465
366
120
1,155
covers upstate (non-NYC) NY
NY New York 1,681 covers NYC portion of NY
PHIL Maryland 280
CHI Illinois
Wisconsin
620
132
752
excludes 57 IL addresses in KC-RO
DAL Texas
Louisiana
1,382
325
1,707
LA California 2,407 excludes 445 CA addresses in SEA-RO
TOTAL N: 7,982
TOTAL ADMIN RECS (?) N: 6,736
![Page 25: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/25.jpg)
Basic Design Features (2)
![Page 26: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/26.jpg)
Basic Design Features (2)
Field Period: Early Jan - mid March 2010
![Page 27: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/27.jpg)
Basic Design Features (2)
Field Period: Early Jan - mid March 2010- collect data about calendar year 2009
![Page 28: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/28.jpg)
Basic Design Features (2)
Field Period: Early Jan - mid March 2010- collect data about calendar year 2009
Field Representative training in Dec/Jan
![Page 29: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/29.jpg)
Basic Design Features (2)
Field Period: Early Jan - mid March 2010- collect data about calendar year 2009
Field Representative training in Dec/Jan- goal: minimize # of FRs with post-training “down-time”- evaluation and improvement of training
![Page 30: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/30.jpg)
Basic Design Features (2)
Field Period: Early Jan - mid March 2010- collect data about calendar year 2009
Field Representative training in Dec/Jan- goal: minimize # of FRs with post-training “down-time”- evaluation and improvement of training
Use FRs with a wide range of experience
![Page 31: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/31.jpg)
Basic Design Features (2)
Field Period: Early Jan - mid March 2010- collect data about calendar year 2009
Field Representative training in Dec/Jan- goal: minimize # of FRs with post-training “down-time”- evaluation and improvement of training
Use FRs with a wide range of experience
Expand RO involvement
![Page 32: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/32.jpg)
Research Agenda
![Page 33: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/33.jpg)
Research Agenda
1. Quantify likely cost savings
![Page 34: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/34.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system
![Page 35: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/35.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality
![Page 36: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/36.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality4. Evaluate “field support” materials
![Page 37: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/37.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality4. Evaluate “field support” materials5. Evaluate FR training
![Page 38: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/38.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality4. Evaluate “field support” materials5. Evaluate FR training6. Identify & document instrument “bugs”
![Page 39: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/39.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality4. Evaluate “field support” materials5. Evaluate FR training6. Identify & document instrument “bugs”7. Identify “interview process” issues
![Page 40: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/40.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality4. Evaluate “field support” materials5. Evaluate FR training6. Identify & document instrument “bugs”7. Identify “interview process” issues8. Identify usability issues (esp. EHC)
![Page 41: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/41.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality4. Evaluate “field support” materials5. Evaluate FR training6. Identify & document instrument “bugs”7. Identify “interview process” issues8. Identify usability issues (esp. EHC)
HOW CAN WE IMPROVE FOR 2013?
![Page 42: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/42.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality4. Evaluate “field support” materials5. Evaluate FR training6. Identify & document instrument “bugs”7. Identify “interview process” issues8. Identify usability issues (esp. EHC)
HOW CAN WE IMPROVE FOR 2013?
![Page 43: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/43.jpg)
Special Methods
1. Quantify likely cost savings
![Page 44: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/44.jpg)
Special Methods
1. Quantify likely cost savings
- new cost code(s) established- timing interview length- exchange between 12-month recall and 3 interviews per year
![Page 45: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/45.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality4. Evaluate “field support” materials5. Evaluate FR training6. Identify & document instrument “bugs”7. Identify “interview process” issues8. Identify usability issues (esp. EHC)
HOW CAN WE IMPROVE FOR 2013?
![Page 46: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/46.jpg)
Special Methods
2. Test the data processing system
![Page 47: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/47.jpg)
Special Methods
2. Test the data processing system
The data collected in this test will be used to develop and test a new data processing system.
![Page 48: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/48.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality4. Evaluate “field support” materials5. Evaluate FR training6. Identify & document instrument “bugs”7. Identify “interview process” issues8. Identify usability issues (esp. EHC)
HOW CAN WE IMPROVE FOR 2013?
![Page 49: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/49.jpg)
Special Methods
3. Evaluate data quality
![Page 50: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/50.jpg)
Special Methods
3. Evaluate data quality
- administrative records
![Page 51: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/51.jpg)
Special Methods
3. Evaluate data quality
- administrative records- recording of selected interviews
![Page 52: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/52.jpg)
Special Methods
3. Evaluate data quality
- administrative records- recording of selected interviews- extract SIPP 2008 panel data; compareCY2009 estimates from the two surveys
![Page 53: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/53.jpg)
Special Methods
3. Evaluate data quality
- administrative records- recording of selected interviews- extract SIPP 2008 panel data; compareCY2009 estimates from the two surveys
![Page 54: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/54.jpg)
(Details) Interview Recording
![Page 55: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/55.jpg)
(Details) Interview Recording
- close-to-RO FRs (approximately 80)
![Page 56: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/56.jpg)
(Details) Interview Recording
- close-to-RO FRs (approximately 80)
- 3 recording windows (early Jan, late Jan, mid Feb)
![Page 57: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/57.jpg)
(Details) Interview Recording
- close-to-RO FRs (approximately 80)
- 3 recording windows (early Jan, late Jan, mid Feb)
- message: “record the next two interviews”
![Page 58: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/58.jpg)
(Details) Interview Recording
- close-to-RO FRs (approximately 80)
- 3 recording windows (early Jan, late Jan, mid Feb)
- message: “record the next two interviews”
- with consent; adults only (21+)
![Page 59: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/59.jpg)
(Details) Interview Recording
- close-to-RO FRs (approximately 80)
- 3 recording windows (early Jan, late Jan, mid Feb)
- message: “record the next two interviews”
- with consent; adults only (21+)
- record R’s entire continuous “turn”
![Page 60: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/60.jpg)
(Details) Interview Recording
- close-to-RO FRs (approximately 80)- 3 recording windows (early Jan, late Jan, mid Feb)- message: “record the next two interviews”- approximately 480 recorded interviews- with consent; adults only (21+)- record R’s entire continuous “turn”- in RO, with the assistance of the ROCS transfer recordings to the secure HQ network
![Page 61: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/61.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality4. Evaluate “field support” materials5. Evaluate FR training6. Identify & document instrument “bugs”7. Identify “interview process” issues8. Identify usability issues (esp. EHC)
HOW CAN WE IMPROVE FOR 2013?
![Page 62: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/62.jpg)
Special Methods
4. Evaluate “field support” materials(advance letter, brochure, calendar aid)
![Page 63: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/63.jpg)
Special Methods
4. Evaluate “field support” materials(advance letter, brochure, calendar aid)
- Respondent debriefing instrument block
![Page 64: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/64.jpg)
Special Methods
4. Evaluate “field support” materials(advance letter, brochure, calendar aid)
- Respondent debriefing instrument block- FR debriefing sessions
![Page 65: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/65.jpg)
Special Methods
4. Evaluate “field support” materials(advance letter, brochure, calendar aid)
- Respondent debriefing instrument block- FR debriefing sessions- recording of selected interviews
![Page 66: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/66.jpg)
Special Methods
4. Evaluate “field support” materials(advance letter, brochure, calendar aid)
- Respondent debriefing instrument block- FR debriefing sessions- recording of selected interviews
![Page 67: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/67.jpg)
(Details) R Debriefing Block
![Page 68: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/68.jpg)
(Details) R Debriefing Block
- at end of interview (status=“complete”)
![Page 69: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/69.jpg)
(Details) R Debriefing Block
- at end of interview (status=“complete”)
- focus on “field support” materials:
![Page 70: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/70.jpg)
(Details) R Debriefing Block
- at end of interview (status=“complete”)
- focus on “field support” materials: advance letter, brochure, calendar aid
![Page 71: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/71.jpg)
(Details) R Debriefing Block
- at end of interview (status=“complete”)
- focus on “field support” materials: advance letter, brochure, calendar aid
- very brief question set:
![Page 72: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/72.jpg)
(Details) R Debriefing Block
- at end of interview (status=“complete”)
- focus on “field support” materials: advance letter, brochure, calendar aid
- very brief question set: “did you see [X]?”
![Page 73: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/73.jpg)
(Details) R Debriefing Block
- at end of interview (status=“complete”)
- focus on “field support” materials: advance letter, brochure, calendar aid
- very brief question set: “did you see [X]?” “did you read [X]?”
![Page 74: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/74.jpg)
(Details) R Debriefing Block
- at end of interview (status=“complete”)
- focus on “field support” materials: advance letter, brochure, calendar aid
- very brief question set: “did you see [X]?” “did you read [X]?” “did [X] have [+/-/0] impact?”
![Page 75: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/75.jpg)
(Details) R Debriefing Block
- at end of interview (status=“complete”)
- focus on “field support” materials: advance letter, brochure, calendar aid
- very brief question set: “did you see [X]?” “did you read [X]?” “did [X] have [+/-/0] impact?”
- with most convenient respondent
![Page 76: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/76.jpg)
Special Methods
4. Evaluate “field support” materials(advance letter, brochure, calendar aid)
- Respondent debriefing instrument block- FR debriefing sessions- recording of selected interviews
![Page 77: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/77.jpg)
Special Methods
4. Evaluate “field support” materials(advance letter, brochure, calendar aid)
- Respondent debriefing instrument block- FR debriefing sessions- recording of selected interviews
![Page 78: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/78.jpg)
(Details) FR Debriefings
![Page 79: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/79.jpg)
(Details) FR Debriefings
- at (or near) end of field period
![Page 80: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/80.jpg)
(Details) FR Debriefings
- at (or near) end of field period
- at least one session per RO
![Page 81: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/81.jpg)
(Details) FR Debriefings
- at (or near) end of field period
- at least one session per RO
- with 8-10 FRs/SFRs
![Page 82: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/82.jpg)
(Details) FR Debriefings
- at (or near) end of field period
- at least one session per RO
- with 8-10 FRs/SFRs
- guided 2-3 hour discussion
![Page 83: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/83.jpg)
(Details) FR Debriefings
- at (or near) end of field period
- at least one session per RO
- with 8-10 FRs/SFRs
- guided 2-3 hour discussion
- wide range of issues – e.g., training, EHC procedures, usability, interview “process” issues, etc.
![Page 84: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/84.jpg)
(Details) FR Debriefings
- at (or near) end of field period
- at least one session per RO
- with 8-10 FRs/SFRs
- guided 2-3 hour discussion
- wide range of issues – e.g., training, EHC procedures, usability, interview “process” issues, etc.
- improvements for 2013
![Page 85: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/85.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality4. Evaluate “field support” materials5. Evaluate FR training6. Identify & document instrument “bugs”7. Identify “interview process” issues8. Identify usability issues (esp. EHC)
HOW CAN WE IMPROVE FOR 2013?
![Page 86: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/86.jpg)
Special Methods
5. Evaluate FR training
![Page 87: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/87.jpg)
Special Methods
5. Evaluate FR training
- recording of selected interviews
![Page 88: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/88.jpg)
Special Methods
5. Evaluate FR training
- recording of selected interviews- certification (and other) testing
![Page 89: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/89.jpg)
Special Methods
5. Evaluate FR training
- recording of selected interviews- certification (and other) testing- HQ (and RO) training observation
![Page 90: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/90.jpg)
Special Methods
5. Evaluate FR training
- recording of selected interviews- certification (and other) testing- HQ (and RO) training observation- HQ (and RO) interview observation
![Page 91: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/91.jpg)
Special Methods
5. Evaluate FR training
- recording of selected interviews- certification (and other) testing- HQ (and RO) training observation- HQ (and RO) interview observation- FR debriefing sessions
![Page 92: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/92.jpg)
Special Methods
5. Evaluate FR training
- recording of selected interviews- certification (and other) testing- HQ (and RO) training observation- HQ (and RO) interview observation- FR debriefing sessions- FR feedback instrument block
![Page 93: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/93.jpg)
Special Methods
5. Evaluate FR training
- recording of selected interviews- certification (and other) testing- HQ (and RO) training observation- HQ (and RO) interview observation- FR debriefing sessions- FR feedback instrument block- FR training assessment form
![Page 94: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/94.jpg)
Special Methods
5. Evaluate FR training
- recording of selected interviews- certification (and other) testing- HQ (and RO) training observation- HQ (and RO) interview observation- FR debriefing sessions- FR feedback instrument block- FR training assessment form- Trainers’ debriefing
![Page 95: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/95.jpg)
Special Methods
5. Evaluate FR training
- recording of selected interviews- certification (and other) testing- HQ (and RO) training observation- HQ (and RO) interview observation- FR debriefing sessions- FR feedback instrument block- FR training assessment form- Trainers’ debriefing
![Page 96: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/96.jpg)
(Details) HQ/RO Interview Observations
![Page 97: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/97.jpg)
(Details) HQ/RO Interview Observations
- intensive HQ/RO observation of field test
![Page 98: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/98.jpg)
(Details) HQ/RO Interview Observations
- intensive HQ/RO observation of field test
- key observation themes:
![Page 99: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/99.jpg)
(Details) HQ/RO Interview Observations
- intensive HQ/RO observation of field test
- key observation themes: use of EHC techniques (landmarks, cross-domain referencing, calendar aid)
![Page 100: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/100.jpg)
(Details) HQ/RO Interview Observations
- intensive HQ/RO observation of field test
- key observation themes: use of EHC techniques (landmarks, cross-domain referencing, calendar aid)
instrument usability/navigation
![Page 101: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/101.jpg)
(Details) HQ/RO Interview Observations
- intensive HQ/RO observation of field test
- key observation themes: use of EHC techniques (landmarks, cross-domain referencing, calendar aid)
instrument usability/navigation FR preparedness/training
![Page 102: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/102.jpg)
(Details) HQ/RO Interview Observations
- intensive HQ/RO observation of field test
- key observation themes: use of EHC techniques (landmarks, cross-domain referencing, calendar aid)
instrument usability/navigation FR preparedness/training R interest/engagement
![Page 103: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/103.jpg)
(Details) HQ/RO Interview Observations
- intensive HQ/RO observation of field test
- key observation themes: use of EHC techniques (landmarks, cross-domain referencing, calendar aid)
instrument usability/navigation FR preparedness/training R interest/engagement
- R debriefing regarding landmarks
![Page 104: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/104.jpg)
Special Methods
5. Evaluate FR training
- recording of selected interviews- certification (and other) testing- HQ (and RO) training observation- HQ (and RO) interview observation- FR debriefing sessions- FR feedback instrument block- FR training assessment form- Trainers’ debriefing
![Page 105: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/105.jpg)
Special Methods
5. Evaluate FR training
- recording of selected interviews- certification (and other) testing- HQ (and RO) training observation- HQ (and RO) interview observation- FR debriefing sessions- FR feedback instrument block- FR training assessment form- Trainers’ debriefing
![Page 106: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/106.jpg)
(Details) FR Feedback Block
![Page 107: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/107.jpg)
(Details) FR Feedback Block
- at end of interview (status=“complete”)
![Page 108: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/108.jpg)
(Details) FR Feedback Block
- at end of interview (status=“complete”)- brief set of Qs about:
![Page 109: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/109.jpg)
(Details) FR Feedback Block
- at end of interview (status=“complete”)- brief set of Qs about:
use of EHC methods (domains; success)
![Page 110: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/110.jpg)
(Details) FR Feedback Block
- at end of interview (status=“complete”)- brief set of Qs about:
use of EHC methods (domains; success)
EHC instrument bugs
![Page 111: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/111.jpg)
(Details) FR Feedback Block
- at end of interview (status=“complete”)- brief set of Qs about:
use of EHC methods (domains; success)
EHC instrument bugs perceived +/- R reactions
![Page 112: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/112.jpg)
(Details) FR Feedback Block
- at end of interview (status=“complete”)- brief set of Qs about:
use of EHC methods (domains; success)
EHC instrument bugs perceived +/- R reactions training gaps
![Page 113: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/113.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality4. Evaluate “field support” materials5. Evaluate FR training6. Identify & document instrument “bugs”7. Identify “interview process” issues8. Identify usability issues (esp. EHC)
HOW CAN WE IMPROVE FOR 2013?
![Page 114: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/114.jpg)
Special Methods
6. Identify & document instrument “bugs”
![Page 115: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/115.jpg)
Special Methods
6. Identify & document instrument “bugs”
- HQ (and RO) interview observations
![Page 116: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/116.jpg)
Special Methods
6. Identify & document instrument “bugs”
- HQ (and RO) interview observations- FR debriefing sessions
![Page 117: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/117.jpg)
Special Methods
6. Identify & document instrument “bugs”
- HQ (and RO) interview observations- FR debriefing sessions- FR feedback instrument block
![Page 118: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/118.jpg)
Special Methods
6. Identify & document instrument “bugs”
- HQ (and RO) interview observations- FR debriefing sessions- FR feedback instrument block- item-level notes
![Page 119: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/119.jpg)
Special Methods
6. Identify & document instrument “bugs”
- HQ (and RO) interview observations- FR debriefing sessions- FR feedback instrument block- item-level notes
![Page 120: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/120.jpg)
(Details) Item-Level Notes
![Page 121: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/121.jpg)
(Details) Item-Level Notes
- accessible throughout Blaise interview
![Page 122: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/122.jpg)
(Details) Item-Level Notes
- accessible throughout Blaise interview
non-calendar sections standarized Q “script”
![Page 123: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/123.jpg)
(Details) Item-Level Notes
- accessible throughout Blaise interview- FR training will encourage & instruct
![Page 124: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/124.jpg)
(Details) Item-Level Notes
- accessible throughout Blaise interview- FR training will encourage & instruct- focus on “bugs” – instrument not working as planned, e.g.:
![Page 125: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/125.jpg)
(Details) Item-Level Notes
- accessible throughout Blaise interview- FR training will encourage & instruct- focus on “bugs” – instrument not working as planned, e.g.:
wrong/missing fills
![Page 126: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/126.jpg)
(Details) Item-Level Notes
- accessible throughout Blaise interview- FR training will encourage & instruct- focus on “bugs” – instrument not working as planned, e.g.:
wrong/missing fills garbled wording
![Page 127: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/127.jpg)
(Details) Item-Level Notes
- accessible throughout Blaise interview- FR training will encourage & instruct- focus on “bugs” – instrument not working as planned, e.g.:
wrong/missing fills garbled wording wrong/missing Qs
![Page 128: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/128.jpg)
(Details) Item-Level Notes
- accessible throughout Blaise interview- FR training will encourage & instruct- focus on “bugs” – instrument not working as planned, e.g.:
wrong/missing fills garbled wording wrong/missing Qs FR “work-arounds”
![Page 129: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/129.jpg)
(Details) Item-Level Notes
- accessible throughout Blaise interview- FR training will encourage & instruct- focus on “bugs” – instrument not working as planned, e.g.:
wrong/missing fills garbled wording wrong/missing Qs FR “work-arounds” missing help screens
![Page 130: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/130.jpg)
(Details) Item-Level Notes
- accessible throughout Blaise interview- FR training will encourage & instruct- focus on “bugs” – instrument not working as planned, e.g.:
wrong/missing fills garbled wording wrong/missing Qs FR “work-arounds” missing help screens confusing/inapp./redundant/etc. Qs
![Page 131: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/131.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality4. Evaluate “field support” materials5. Evaluate FR training6. Identify & document instrument “bugs”7. Identify “interview process” issues8. Identify usability issues (esp. EHC)
HOW CAN WE IMPROVE FOR 2013?
![Page 132: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/132.jpg)
Special Methods
7. Identify “interview process” issues
![Page 133: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/133.jpg)
Special Methods
7. Identify “interview process” issues(interview “flow,” R interest/engagement, EHCinteraction, mix of structured/unstructured Qs)
![Page 134: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/134.jpg)
Special Methods
7. Identify “interview process” issues(interview “flow,” R interest/engagement, EHCinteraction, mix of structured/unstructured Qs)
- HQ (and RO) interview observations
![Page 135: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/135.jpg)
Special Methods
7. Identify “interview process” issues(interview “flow,” R interest/engagement, EHCinteraction, mix of structured/unstructured Qs)
- HQ (and RO) interview observations- FR debriefing sessions
![Page 136: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/136.jpg)
Special Methods
7. Identify “interview process” issues(interview “flow,” R interest/engagement, EHCinteraction, mix of structured/unstructured Qs)
- HQ (and RO) interview observations- FR debriefing sessions- FR feedback instrument block
![Page 137: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/137.jpg)
Special Methods
7. Identify “interview process” issues(interview “flow,” R interest/engagement, EHCinteraction, mix of structured/unstructured Qs)
- HQ (and RO) interview observations- FR debriefing sessions- FR feedback instrument block- recording of selected interviews
![Page 138: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/138.jpg)
Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality4. Evaluate “field support” materials5. Evaluate FR training6. Identify & document instrument “bugs”7. Identify “interview process” issues8. Identify usability issues (esp. EHC)
HOW CAN WE IMPROVE FOR 2013?
![Page 139: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/139.jpg)
Special Methods
8. Identify usability issues (esp. EHC)(instrument navigation, FRs’ ability to accessand use special features of the EHC)
![Page 140: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/140.jpg)
Special Methods
8. Identify usability issues (esp. EHC)(instrument navigation, FRs’ ability to accessand use special features of the EHC)
- HQ (and RO) interview observations
![Page 141: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/141.jpg)
Special Methods
8. Identify usability issues (esp. EHC)(instrument navigation, FRs’ ability to accessand use special features of the EHC)
- HQ (and RO) interview observations - FR debriefing sessions
![Page 142: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/142.jpg)
Special Methods
8. Identify usability issues (esp. EHC)(instrument navigation, FRs’ ability to accessand use special features of the EHC)
- HQ (and RO) interview observations - FR debriefing sessions - FR feedback instrument block
![Page 143: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/143.jpg)
Special Methods
8. Identify usability issues (esp. EHC)(instrument navigation, FRs’ ability to accessand use special features of the EHC)
- HQ (and RO) interview observations - FR debriefing sessions - FR feedback instrument block - recording of selected interviews
![Page 144: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/144.jpg)
Special Methods
8. Identify usability issues (esp. EHC)(instrument navigation, FRs’ ability to accessand use special features of the EHC)
- HQ (and RO) interview observations - FR debriefing sessions - FR feedback instrument block - recording of selected interviews - FR testing sessions at HQ
![Page 145: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/145.jpg)
Summary: Research Agenda
1. Quantify likely cost savings2. Test the data processing system3. Evaluate data quality4. Evaluate “field support” materials5. Evaluate FR training6. Identify & document instrument “bugs”7. Identify “interview process” issues8. Identify usability issues (esp. EHC)
![Page 146: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/146.jpg)
Summary: Research Agenda
Lots of Extra “Stuff” – 2010 Test is Loaded- Data quality- Instrument quality- Training quality
![Page 147: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/147.jpg)
Summary: Research Agenda
Lots of Extra “Stuff” – 2010 Test is Loaded- Data quality- Instrument quality- Training quality
GOAL: Fully Exploit the Test’s InformationPotential
![Page 148: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/148.jpg)
Summary: Research Agenda
Lots of Extra “Stuff” – 2010 Test is Loaded- Data quality- Instrument quality- Training quality
GOAL: Fully Exploit the Test’s InformationPotential
Improvements/Refinements for 2013
![Page 149: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/149.jpg)
What’s Missing from 2010?
![Page 150: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/150.jpg)
What’s Missing from 2010?
- Attrition/mover effects in an annual interview
![Page 151: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/151.jpg)
What’s Missing from 2010?
- Attrition/mover effects in an annual interview
- Year to year data quality - seams between waves of a 12-month reference period interview
![Page 152: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/152.jpg)
What’s Missing from 2010?
- Attrition/mover effects in an annual interview
- Year to year data quality - seams between waves of a 12-month reference period interview
- Wave 2+ instrument and procedures
![Page 153: Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the](https://reader030.vdocuments.us/reader030/viewer/2022032414/56649ef25503460f94c0462f/html5/thumbnails/153.jpg)
What’s Missing from 2010?
- Attrition/mover effects in an annual interview
- Year to year data quality - seams between waves of a 12-month reference period interview
- Wave 2+ instrument and procedures
- In Development – 2011 / 2012 Testing Plans