nis & slaits program overview: national immunization survey nchs bsc meeting september 17, 2007...

51
NIS & SLAITS NIS & SLAITS Program Overview: Program Overview: National Immunization National Immunization Survey Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization Services Division NCIRD/CDC

Upload: charity-james

Post on 29-Dec-2015

216 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

NIS & SLAITS NIS & SLAITS Program Overview:Program Overview:

National Immunization National Immunization SurveySurvey

NIS & SLAITS NIS & SLAITS Program Overview:Program Overview:

National Immunization National Immunization SurveySurvey

NCHS BSC MeetingSeptember 17, 2007

James A. Singleton, M.S.Chief, Assessment Branch

Immunization Services DivisionNCIRD/CDC

Page 2: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

OutlineOutline History of the NISHistory of the NIS PurposePurpose MethodsMethods ResourcesResources Information DisseminationInformation Dissemination Proposed objectives of program reviewProposed objectives of program review

Page 3: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Development of the U.S. Development of the U.S. Immunization ProgramImmunization Program

Vaccination Assistance Act, 1962Vaccination Assistance Act, 1962– Established Section 317 grant programEstablished Section 317 grant program

Childhood Immunization Initiative, 1977Childhood Immunization Initiative, 1977– Focus on enacting school entry lawsFocus on enacting school entry laws

Vaccine coverage monitoring, 1957-91Vaccine coverage monitoring, 1957-91– U.S. Immunization Survey, CPSU.S. Immunization Survey, CPS

Parental report of vaccinationsParental report of vaccinations Dropped after 1985; cost, validity concernsDropped after 1985; cost, validity concerns

– Retrospective school surveys, 1985-91Retrospective school surveys, 1985-91

Page 4: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Polio, DTP, Measles-Containing Polio, DTP, Measles-Containing Vaccination Coverage Levels: 1959-Vaccination Coverage Levels: 1959-

1990, U.S. Immunization Survey1990, U.S. Immunization Survey

0102030405060708090

100

59

61

63

65

67

69

71

73

75

77

79

81

83

85

87

89

91

Polio DTP MCV

Page 5: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

U.S. Measles ResurgenceU.S. Measles Resurgence1989-19911989-1991

CasesCases 55,62255,622

Age group affectedAge group affected <5 yrs<5 yrs

HospitalizationsHospitalizations >11,000>11,000

DeathsDeaths 132132

Direct medical costsDirect medical costs >$150 million>$150 million

Page 6: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Childhood Immunization Childhood Immunization Initiative (CII), 1993Initiative (CII), 1993

Achieve 90% coverage for preschool childrenAchieve 90% coverage for preschool children Vaccines for Children ProgramVaccines for Children Program

– Entitlement program funded by MedicaidEntitlement program funded by Medicaid– ACIP recommendations translated into appropriationsACIP recommendations translated into appropriations

Increase in Section 317 fundingIncrease in Section 317 funding Funding for the National Immunization Survey (NIS)Funding for the National Immunization Survey (NIS)

– Created in 1994 to measure coverage goals of the CII by Created in 1994 to measure coverage goals of the CII by state and selected urban areasstate and selected urban areas

NHIS NIPRCS 1994-1999NHIS NIPRCS 1994-1999– National provider-reported data on vaccination of children National provider-reported data on vaccination of children

19-35 mo19-35 mo– Used in NIS weighting adjustments for households without Used in NIS weighting adjustments for households without

telephonestelephones

Page 7: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

MissionMission

National Center for Immunization and National Center for Immunization and Respiratory Diseases (NCIRD)Respiratory Diseases (NCIRD)– Prevent disease, disability and death through Prevent disease, disability and death through

immunization and by control of respiratory and immunization and by control of respiratory and related diseasesrelated diseases

Immunization Services DivisionImmunization Services Division– Protects individuals and communities from Protects individuals and communities from

vaccine-preventable diseases through provision vaccine-preventable diseases through provision of federal funds and contracts to purchase of federal funds and contracts to purchase vaccine, the provision of technical and financial vaccine, the provision of technical and financial support of immunization programs, provider and support of immunization programs, provider and public education, evaluation and researchpublic education, evaluation and research

Page 8: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization
Page 9: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

What gets What gets measured measured

– – gets donegets done

Page 10: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Purpose of CDC Vaccine Purpose of CDC Vaccine AssessmentAssessment

Overarching goal - facilitate program Overarching goal - facilitate program improvement and behavior change improvement and behavior change leading to increased vaccination levels, leading to increased vaccination levels, thus reducing health and societal thus reducing health and societal impact of vaccine-preventable diseases impact of vaccine-preventable diseases (VPD’s) (VPD’s)

Need vaccine assessment system for Need vaccine assessment system for immunization programsimmunization programs– Children <3, 4-6, 11-18 yearsChildren <3, 4-6, 11-18 years– Adults Adults

Page 11: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Purpose of CDC Vaccine Purpose of CDC Vaccine AssessmentAssessment

Evaluate effectiveness of immunization Evaluate effectiveness of immunization grant programs over timegrant programs over time

Help with allocation of Vaccines for Help with allocation of Vaccines for Children (VFC) program resourcesChildren (VFC) program resources

Monitor progress toward national Monitor progress toward national Healthy PeopleHealthy People objectives objectives

Build and maintain support for national Build and maintain support for national & state immunization programs& state immunization programs

Page 12: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Purpose of CDC Vaccine Purpose of CDC Vaccine AssessmentAssessment

Identify subgroups at higher VPD riskIdentify subgroups at higher VPD risk Identify facilitators & barriers to Identify facilitators & barriers to

vaccination to improve interventionsvaccination to improve interventions Evaluate implementation of vaccine Evaluate implementation of vaccine

recommendations from the Advisory recommendations from the Advisory Committee on Immunization Practices Committee on Immunization Practices (ACIP)(ACIP)

Assess differential impact of vaccine Assess differential impact of vaccine shortagesshortages

Evaluate uptake of new vaccinesEvaluate uptake of new vaccines

Page 13: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Purpose of CDC Vaccine Purpose of CDC Vaccine AssessmentAssessment

Assist in evaluating health impact of Assist in evaluating health impact of vaccinationvaccination– Proxy for immunityProxy for immunity

– Ecologic analysis of trendsEcologic analysis of trends

– Vaccine effectiveness studiesVaccine effectiveness studies

– Vaccine safety studiesVaccine safety studies

Emergency preparednessEmergency preparedness– Influenza pandemic monitoringInfluenza pandemic monitoring

Page 14: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Designing a Vaccine Coverage Designing a Vaccine Coverage Assessment System Assessment System

Target populationTarget population Sampling methodSampling method Vaccines assessedVaccines assessed Auxiliary data collectedAuxiliary data collected Geographic specificityGeographic specificity Periodicity of data collection and reportingPeriodicity of data collection and reporting Timeliness (vaccination to data availability)Timeliness (vaccination to data availability) Comparability across areas and over timeComparability across areas and over time RepresentativenessRepresentativeness AccuracyAccuracy ResourcesResources

Page 15: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Overview of theOverview of theNational Immunization National Immunization

Survey (NIS)Survey (NIS)

Overview of theOverview of theNational Immunization National Immunization

Survey (NIS)Survey (NIS)

Page 16: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Target PopulationTarget Population

Noninstitutionalized children aged Noninstitutionalized children aged 19-35 months at time of telephone 19-35 months at time of telephone interviewinterview

Page 17: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Sample DesignSample Design

Stratified, two phase survey:Stratified, two phase survey:– List-assisted, random-digit-dialing survey to List-assisted, random-digit-dialing survey to

identify age-eligible childrenidentify age-eligible children Spanish interviewers & CATI versionSpanish interviewers & CATI version

– 9% of 2005 interviewers conducted in Spanish9% of 2005 interviewers conducted in Spanish

Language Line Services used for 187 interviews Language Line Services used for 187 interviews (0.67%) in 2005(0.67%) in 2005

– Mailed survey to providers identified during Mailed survey to providers identified during telephone interview to collect provider-telephone interview to collect provider-reported vaccination historiesreported vaccination histories

Page 18: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization
Page 19: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

VaccinesVaccines

All ACIP recommended vaccines All ACIP recommended vaccines that children should have received that children should have received by 19 months of ageby 19 months of age

Page 20: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization
Page 21: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Demographics and Other Demographics and Other Data CollectedData Collected

HouseholdHousehold– Race/ethnicity of Race/ethnicity of

mother, childmother, child

– Mother’s age, Mother’s age, education, marital education, marital statusstatus

– Family incomeFamily income

– Health insuranceHealth insurance

– WIC participationWIC participation

– Shot card availableShot card available

– BreastfeedingBreastfeeding

ProvidersProviders– # physicians at # physicians at

practicepractice

– Facility typeFacility type

– VFC providerVFC provider

Page 22: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

NIS Special Purpose NIS Special Purpose Supplements Supplements

(Topical Modules)(Topical Modules)

Subsamples of NIS survey can be asked Subsamples of NIS survey can be asked special-purpose questionsspecial-purpose questions– Insurance Status (2001-02; 2006+)Insurance Status (2001-02; 2006+)– Day Care and Breast Feeding (2001-02)Day Care and Breast Feeding (2001-02)– Attitudes and Beliefs (2001-02)Attitudes and Beliefs (2001-02)– Vaccine Safety (2003-04)Vaccine Safety (2003-04)– Vaccine Shortage (2003-04)Vaccine Shortage (2003-04)– Childhood Influenza (2004)Childhood Influenza (2004)– SES (planned 2008)SES (planned 2008)– Parental concerns (planned 2008)Parental concerns (planned 2008)

Page 23: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

New NIS ModulesNew NIS Modules Develop 2007, collect data 2008Develop 2007, collect data 2008 SES Module (national)SES Module (national)

– Barriers to immunizationBarriers to immunization

– Factors associated with racial/ethnic and income-Factors associated with racial/ethnic and income-related coverage disparitiesrelated coverage disparities

– Add key questions to NIS core laterAdd key questions to NIS core later

Parental Concerns ModuleParental Concerns Module– Early warning system for parental concerns about Early warning system for parental concerns about

vaccinationvaccination

– Developed with NVAC Subcommittee on Public Developed with NVAC Subcommittee on Public EngagementEngagement

– Consider periodic state-specific estimatesConsider periodic state-specific estimates

Page 24: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Geographic SpecificityGeographic Specificity

National levelNational level State levelState level City levelCity level

– Six cities receiving Section 317 Six cities receiving Section 317 immunization grant fundingimmunization grant funding

Other city/county areasOther city/county areas– chosen/funded by state granteeschosen/funded by state grantees

– Eight areas chosen for 2007Eight areas chosen for 2007

Page 25: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

NIS is More Than One NIS is More Than One Survey...Survey...

AtlantaAtlanta

SeattleSeattle

San DiegoSan Diego

PhoenixPhoenix

El PasoEl Paso

SanSanAntonioAntonio

DallasDallas

MemphisMemphis

NashvilleNashville

IndianapolisIndianapolis

DetroitDetroit

ClevelandCleveland

ColumbusColumbus

MiamiMiami

JacksonvilleJacksonville

LosLosAngelesAngeles

SantaSantaClaraClara

NewNewOrleansOrleans

BirminghamBirmingham

HoustonHouston

MilwaukeeMilwaukee

PhiladelphiaPhiladelphia

NewarkNewark

NYCNYC

BostonBoston

BaltimoreBaltimore

DCDC

ChicagoChicago

Page 26: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

PeriodicityPeriodicity

Conducted continuously based on Conducted continuously based on quarterly samplesquarterly samples

Reported biannually based on data Reported biannually based on data delivered in June and Decemberdelivered in June and December

Focus on data reporting each summer Focus on data reporting each summer using calendar year datausing calendar year data

Page 27: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

TimelinessTimeliness Average time from Average time from vaccinationvaccination to delivery of to delivery of

calendar year data (months):calendar year data (months):

– 38m for HepB birth dose (range 25-52m).38m for HepB birth dose (range 25-52m). (19m in Dec + 6m till data deliv. = 25)(19m in Dec + 6m till data deliv. = 25)

(34m in Jan + 12m data col. y + 6m till data deliv. = 52)(34m in Jan + 12m data col. y + 6m till data deliv. = 52)

– 32m for 332m for 3rdrd Rota (range 19-46m). Rota (range 19-46m).

– 26m for MMR1, VAR1 (range 13-40m).26m for MMR1, VAR1 (range 13-40m).

– 19m for DTaP4 (range 6-33m).19m for DTaP4 (range 6-33m).

– 17m from end of flu vacc. Period (Jan)17m from end of flu vacc. Period (Jan)

Page 28: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

ComparabilityComparability Same methods and contractor conduct survey Same methods and contractor conduct survey

in all sampling areasin all sampling areas

Sample size chosen to achieve effective Sample size chosen to achieve effective sample size of 180 children with adequate sample size of 180 children with adequate provider data in each areaprovider data in each area

95% CI half-width of 7.5% or less95% CI half-width of 7.5% or less

Comparability of methodology means Comparability of methodology means estimates are comparable among states and estimates are comparable among states and urban areas over timeurban areas over time

Page 29: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

RepresentativenessRepresentativeness

Data weighted to account for Data weighted to account for households without landline phones households without landline phones and for nonresponseand for nonresponse

In Q1/Q2 of 2006, 10.4% of children in In Q1/Q2 of 2006, 10.4% of children in US lived in HH w/o landline phonesUS lived in HH w/o landline phones

Research underway to possibly Research underway to possibly improve the noncoverage improve the noncoverage adjustmentsadjustments

Page 30: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

NIS 2005 SampleNIS 2005 SampleTotal sample releasedTotal sample released 4,465,2614,465,261

Resolved sampleResolved sample 3,721,224 (83%)3,721,224 (83%)

Households identifiedHouseholds identified 1,085,0401,085,040

Households screenedHouseholds screened 1,006,435 (93%)1,006,435 (93%)

Eligible householdsEligible households 31,909 (3.2%)31,909 (3.2%)

Complete interviewsComplete interviews 26,867 (84%)26,867 (84%)

27,627 children27,627 childrenChildren with adequateChildren with adequate

Provider dataProvider data

17,448 (63%)17,448 (63%)

Page 31: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Wireless Substitution: Preliminary Data from the 2006 National Health Interview Survey

NCHS E-Stat article by S.J. Blumberg and JV Luke, NCHS

Page 32: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

AccuracyAccuracy

Parental report of childhood Parental report of childhood vaccination has been shown to be vaccination has been shown to be unreliableunreliable

For all NIS estimates, only provider-For all NIS estimates, only provider-reported vaccinations are used for reported vaccinations are used for estimation of vaccine coverageestimation of vaccine coverage

Page 33: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization
Page 34: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

NIS-TeenNIS-Teen Children aged 13-17 years at time of Children aged 13-17 years at time of

telephone interview with parenttelephone interview with parent Vaccination histories from providersVaccination histories from providers Measures vaccinations ages Measures vaccinations ages ≥11 years≥11 years Conducted national survey Q4 2006Conducted national survey Q4 2006

–5,483 completed interviews5,483 completed interviews Repeat Q4 2007Repeat Q4 2007 Expansion to state/grantee level survey Expansion to state/grantee level survey

high priority for 2008high priority for 2008

Page 35: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Strengths of the NISStrengths of the NIS States and selected city/county areas use States and selected city/county areas use

estimates for program improvementestimates for program improvement

Comparability of methodology means Comparability of methodology means estimates are comparable among states estimates are comparable among states and urban areas over timeand urban areas over time

Identifies areas, populations and factors Identifies areas, populations and factors associated with under-immunizationassociated with under-immunization

Provider-verified resultsProvider-verified results

Provides sampling frame for other health Provides sampling frame for other health surveys (SLAITS)surveys (SLAITS)

Page 36: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Challenges for NISChallenges for NIS

Declining telephone survey response Declining telephone survey response rates - 87% (1994) to 64.5% (2006)rates - 87% (1994) to 64.5% (2006)

Wireless-only householdsWireless-only households Some non-coverage and non-response Some non-coverage and non-response

bias may remain after weighting bias may remain after weighting adjustmentsadjustments

Increasing costsIncreasing costs

Page 37: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

NIS Operational/Methods NIS Operational/Methods ResearchResearch

Research to decrease bias, increase cost-Research to decrease bias, increase cost-efficiency, and guide future NIS methodologyefficiency, and guide future NIS methodology– Use of IIS sample frame & age-targeted phone Use of IIS sample frame & age-targeted phone

lists, 2+ phone banks, redesign questionnaire, lists, 2+ phone banks, redesign questionnaire, advance letter, calling rules, answering machine advance letter, calling rules, answering machine messages, sensitivity analysis model to evaluate messages, sensitivity analysis model to evaluate potential biaspotential bias

Research to address wireless only and Research to address wireless only and phoneless householdsphoneless households– Analysis of NHIS by phone statusAnalysis of NHIS by phone status

– Pilot studies calling cell phonesPilot studies calling cell phones

Page 38: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

NIS and Immunization NIS and Immunization Information Systems (IIS) Information Systems (IIS)

““The quality and completeness of the registry data The quality and completeness of the registry data must be improved and must be comparable across must be improved and must be comparable across all states before consideration may be given to all states before consideration may be given to supplement or replace the provider-reported data in supplement or replace the provider-reported data in the NIS.the NIS.””

– Khare et al., Arch Pediatr Adolesc Med 2006Khare et al., Arch Pediatr Adolesc Med 2006

NIS provider question on use of IIS to obtain NIS provider question on use of IIS to obtain vaccination histories (2006)vaccination histories (2006)

Offering service to grantees to evaluate IIS Offering service to grantees to evaluate IIS via match with NIS samplevia match with NIS sample

Page 39: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

NIS and Immunization NIS and Immunization Information Systems (IIS)Information Systems (IIS)

Conducting NIS survey & provider Conducting NIS survey & provider record check on IIS sample in 2 statesrecord check on IIS sample in 2 states– Dual frame approach may reduce cost, Dual frame approach may reduce cost,

increase validityincrease validity– Evaluate use of provider record check on Evaluate use of provider record check on

IIS sample to estimate local vaccination IIS sample to estimate local vaccination coveragecoverage

– Evaluate non-response bias in the RDD Evaluate non-response bias in the RDD frame using IIS data as “gold” standardframe using IIS data as “gold” standard

Encourage use of IIS for local Encourage use of IIS for local assessmentassessment

Page 40: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Vaccine Assessment Vaccine Assessment Funding Sources (FY07)Funding Sources (FY07)

Total $23.3mTotal $23.3m– <1% of annual $2.5b VFC vaccine purchase<1% of annual $2.5b VFC vaccine purchase

$12.8m PHS Evaluation$12.8m PHS Evaluation $ 7.7m Vaccines for Children Program$ 7.7m Vaccines for Children Program

– Additional VFC $ for NIS-Teen, FY08Additional VFC $ for NIS-Teen, FY08 $ 1.4m state Section 317 grants$ 1.4m state Section 317 grants

– NIS oversampling in areas chosen by stateNIS oversampling in areas chosen by state $ 0.9m Division (ISD) research funds$ 0.9m Division (ISD) research funds $ 0.6m influenza pandemic planning$ 0.6m influenza pandemic planning

Page 41: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Vaccine Assessment Vaccine Assessment Funding Allocation (FY07)Funding Allocation (FY07)

$20.5m NIS contract (NORC)$20.5m NIS contract (NORC)– $12.2m core NIS$12.2m core NIS– $ 2.2m NIS-Teen$ 2.2m NIS-Teen– $ 2.7m modules (adult, SES, Concerns)$ 2.7m modules (adult, SES, Concerns)– $ 1.5m operational/methods research$ 1.5m operational/methods research– $ 1.4m NIS oversampling in selected areas$ 1.4m NIS oversampling in selected areas– $ 0.6m influenza pandemic survey module$ 0.6m influenza pandemic survey module

$ 1.1m IAA’s with NCHS$ 1.1m IAA’s with NCHS– Support of NHIS immunization questionsSupport of NHIS immunization questions– NCHS staff support of NIS (~1.5 fte)NCHS staff support of NIS (~1.5 fte)

$ 1.7m other assessment activities$ 1.7m other assessment activities

Page 42: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Vaccine AssessmentVaccine AssessmentStaff ResourcesStaff Resources

Assessment Branch (AB), ISD/NCIRDAssessment Branch (AB), ISD/NCIRD– 14 FTE’s, 3 contractors14 FTE’s, 3 contractors

Statisticians, epidemiologists, health scientistsStatisticians, epidemiologists, health scientists ~ 9 FTE-equivalents devoted to NIS~ 9 FTE-equivalents devoted to NIS

NCHS (~1.5 FTE)NCHS (~1.5 FTE)– NIS contract originally managed by NCHSNIS contract originally managed by NCHS– Effective 2005, co-project officers establishedEffective 2005, co-project officers established

AB/ISD responsible for NISAB/ISD responsible for NIS NCHS responsible for SLAITSNCHS responsible for SLAITS

– Also handles NIS IRBAlso handles NIS IRB

– StatisticianStatistician Methods research, public use file developmentMethods research, public use file development

Page 43: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Information DisseminationInformation Dissemination Annual MMWR articlesAnnual MMWR articles

– Briefings with states/local granteesBriefings with states/local grantees Post detailed tables online twice yearlyPost detailed tables online twice yearly

– Q3-4 2005 + Q1-2 2006 data ~ Jan. 2007Q3-4 2005 + Q1-2 2006 data ~ Jan. 2007– Q1-4 2006 data ~ summer 2007Q1-4 2006 data ~ summer 2007

Public use file available annuallyPublic use file available annually In-house analysisIn-house analysis

– 13 NIS papers published in 200613 NIS papers published in 2006 Ad hoc requests from states, CDC, otherAd hoc requests from states, CDC, other Developing online data query systemDeveloping online data query system

Page 44: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Uses of NIS DataUses of NIS Data State immunization program improvementsState immunization program improvements Assist in management of the Vaccines for Children Assist in management of the Vaccines for Children

(VFC) entitlement program (health insurance)(VFC) entitlement program (health insurance) Monitoring Monitoring Healthy People 2010Healthy People 2010 objectives objectives Uptake of new vaccinesUptake of new vaccines Factors associated with coverageFactors associated with coverage Racial/ethnic disparitiesRacial/ethnic disparities Parental vaccine safety concernsParental vaccine safety concerns Quality performance measures Quality performance measures

– timeliness, age-appropriate & validly-spaced dosestimeliness, age-appropriate & validly-spaced doses Use of combination vaccinesUse of combination vaccines County-level coverage estimationCounty-level coverage estimation Coverage trends by birth cohortCoverage trends by birth cohort Cost-effectiveness analysisCost-effectiveness analysis Vaccine-effectiveness studiesVaccine-effectiveness studies

Page 45: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Strategic PlanningStrategic Planning April 2007 External Review of Intramural April 2007 External Review of Intramural

ResearchResearch– Prioritization of vaccination assessmentPrioritization of vaccination assessment

““What should we be assessing?”What should we be assessing?”

CDC vaccination assessment work groupCDC vaccination assessment work group Feedback on prioritiesFeedback on priorities

– National Vaccine Advisory CommitteeNational Vaccine Advisory Committee

– Immunization stakeholdersImmunization stakeholders

October 2007 CCID BSC NCIRD October 2007 CCID BSC NCIRD subcommitteesubcommittee– Issues in data analysis and reportingIssues in data analysis and reporting

Page 46: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

NCHS Program ReviewNCHS Program ReviewProposed QuestionsProposed Questions

What could be done to improve the What could be done to improve the validity and efficiency of the NIS?validity and efficiency of the NIS?

Are we conducting the appropriate Are we conducting the appropriate types of methods research to guide types of methods research to guide improvement of the NIS?improvement of the NIS?

How should we deal with increasing How should we deal with increasing prevalence of households with only cell prevalence of households with only cell phones?phones?

What alternative sampling designs What alternative sampling designs should be considered?should be considered?

Page 47: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Additional SlidesAdditional SlidesAdditional SlidesAdditional Slides

Page 48: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

DTP(3+)†

MMR(1+)

Hib (3+)

Hep B (3+)

Polio (3+)

Varicella (1+)

PCV 7 (3+)

2005

Vaccine-Specific Coverage:Preschool-Aged Children

Note: † DTP(3+) is not a Healthy People 2010 objective. DTP(4) is used to assess Healthy People 2010 objective 14-22a. Source: USIS (1967-1985), NHIS (1991-1993) CDC, NCHS, and NIS (1994-2005), CDC, NCIRD and NCHS;

2010 Target: 90Percent

0

20

40

60

80

100

1967 1970 1973 1976 1979 1982 1985 1988 1991 1994 1997 2000 2003

Page 49: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Trends in Vaccine Coverage in Vermont, Trends in Vaccine Coverage in Vermont, NIS 2000-2006NIS 2000-2006431331 coverage for Vermont

0

20

40

60

80

100

2000 2001 2002 2003 2004 2005 2006

Year

% Vermont

1+ varicella vaccine coverage for Vermont

0

20

40

60

80

100

2000 2001 2002 2003 2004 2005 2006

YEAR

% Vermont

Page 50: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Estimated PCV7 Coverage (3+ doses), by State, Estimated PCV7 Coverage (3+ doses), by State, National Immunization Survey, U.S., 2004National Immunization Survey, U.S., 2004

40-49%40-49%50-59%50-59%60-69%60-69%

D.C.D.C.

70-79%70-79%80-89%80-89%90-99%90-99%Estimated coverage among 19-35

month olds, 3rd quarter 2003-2nd quarter 2004

Page 51: NIS & SLAITS Program Overview: National Immunization Survey NCHS BSC Meeting September 17, 2007 James A. Singleton, M.S. Chief, Assessment Branch Immunization

Data Analysis & ReportingData Analysis & Reporting

Reporting coverage for vaccine seriesReporting coverage for vaccine series Defining vaccination outcomeDefining vaccination outcome Other measures of coverageOther measures of coverage

– Timeliness Timeliness – Cumulative % vaccinated by ageCumulative % vaccinated by age

Trends by birth cohort vs. data Trends by birth cohort vs. data collection yearcollection year

Small area estimationSmall area estimation– Estimates for 181 counties using data from Estimates for 181 counties using data from

2004-05 combined2004-05 combined