evaluation and research corrections reporting program (ncrp)€¦ · points of view in this...

33
Evaluation and Research Using the National Corrections Reporting Program (NCRP) A Bureau of Justice Statistics, Office of Justice Programs, U.S. Department of Justice Data Collection November 1, 2016 Gerald Gaes, Ph.D.

Upload: others

Post on 29-May-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Evaluation and Research Using the National Corrections Reporting Program (NCRP)

A Bureau of Justice Statistics, Office of Justice Programs, U.S. Department of Justice Data Collection November 1, 2016 Gerald Gaes, Ph.D.

Page 2: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 2

Acknowledgement

This work was supported by Grant No. 2015-R2-CX-K135 awarded by the Bureau of Justice Statistics, Office of Justice Programs, U.S. Department of Justice to Abt Associates.

Points of view in this presentation are those of the authors and do not represent the official position of the U.S. Department of Justice.

Page 3: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 3

Presentation Overview

NCRP brief overview Evaluation and research applications

– Alternative definitions of recidivism that were developed using NCRP

– Evaluation of the impact of the Affordable Care Act on recidivism

– A quasi-experimental evaluation of the impact of welfare benefits on prisoner recidivism

Page 4: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

NCRP 101 The Basics

Page 5: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 5

NCRP Collects Movement- and Offender-Level Data Bureau of Justice Statistics Data Collection

State prison system movements

– Admissions

– Releases

Prison custody at year end

Post-confinement community supervision movements (PCCS)

– Admissions

– Releases

Page 6: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 6

Key NCRP Data Elements

Offender ID #s – Unique Offender ID, State ID, FBI #, SSN

Offender characteristics – Name, DOB, Race, Ethnicity, Gender, Education, Veteran

Status, Last Known Address

Sentence characteristics – County where sentence imposed, Offenses, Sentence Length

Admission date and type – new commitment, revocation

Release date and type – community supervision, full term

Page 7: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 7

State Term Files from 2000 to 2015

12/31/2015 1/1/2000 Prison Term

Annual Prison Files

Page 8: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 8

States Prison and PCCS Terms Are Integrated

PCCS Term 12/31/2015 1/1/2000 Prison Term

Annual Prison and PCCS Files

Page 9: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Alternative Measures of Recidivism

William Rhodes, G Gaes, J Luallen, R Kling, T Rich, and M Shively. Crime & Delinquency, 2014.

Page 10: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 10

PRELIMINARY ANALYSIS: DO NOT CITE

Event- and Offender- Based Recidivism Event-Based

– Most Common Approach Used in Criminal Justice Applications

– Start with a cohort of prison releasees

– Observe if and when they return to prison

Offender-based

– Observe the individual offender pattern of returning to prison over time

– Reweight a release cohort to look like a cohort of offenders admitted and released over a period of time -- requires longitudinal data such as the NCRP

Page 11: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 11

PRELIMINARY ANALYSIS: DO NOT CITE PRELIMINARY ANALYSIS: DO NOT CITE

Event-Based Recidivism: 2000 release cohort (16 states)

0%

10%

20%

30%

40%

50%

60%

1 2 3 4 5 6 7 8 9 10 11 12 13 14

Retu

rnin

g Pe

rcen

t

Years-at-Risk

Event

Based on NCRP Term Records from 16 states : AZ, CA, CO, FL, GA, KY, MN, MO, NY, NC, OK, SC, TN, UT, WA, WI

Page 12: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 12

PRELIMINARY ANALYSIS: DO NOT CITE PRELIMINARY ANALYSIS: DO NOT CITE

Event- and Offender-Based Recidivism Estimates -- 2000 release cohort (16 states)

0%

10%

20%

30%

40%

50%

60%

1 2 3 4 5 6 7 8 9 10 11 12 13 14

Retu

rnin

g Pe

rcen

t

Years-at-Risk

EventOffender

Based on NCRP Term Records from 16 states : AZ, CA, CO, FL, GA, KY, MN, MO, NY, NC, OK, SC, TN, UT, WA, WI

Page 13: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 13

PRELIMINARY ANALYSIS: DO NOT CITE

Offender-based approach: Few offenders return to prison more than once

0%

10%

20%

30%

40%

50%

60%

70%

0 1 2 3 4 5+

% o

f Rel

ease

s

Number of Returns after 2000 Release up to 2014 Based on NCRP Term Records from 16 states : AZ, CA, CO, FL, GA, KY, MN, MO, NY, NC, OK, SC, TN, UT, WA, WI

Page 14: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 14

PRELIMINARY ANALYSIS: DO NOT CITE

Use Event and Offender-Based Recidivism to Answer Different Policy Question

Event-based

– Focus on the risk posed by members of a release cohort

– Used to allocate rehabilitation and supervision resources for a release cohort

– Allocate more resources to the high rather than low risk releasees

Offender-based

– Focus on persistence/desistance of offenders’ recidivism

– Leads to better understanding of the trajectory of individual level offending and recidivism and potentially factors that can modify that trajectory

Page 15: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

PRELIMINARY ANALYSIS: DO NOT CITE

Early Evidence on the Impact of the Affordable Care Act on Recidivism Sharmini Radakrishnan Lauren Olsho Holly Swan

Presenter
Presentation Notes
Mention definition of recidivism: return to prison, either because of a new sentence or a parole violation Emphasize that these are preliminary results, not to be cited
Page 16: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 16

PRELIMINARY ANALYSIS: DO NOT CITE

Offender Populations About ~600K released from state prisons annually

High prevalence of health conditions needing ongoing management

– HIV

– hepatitis C

– mental health

– substance abuse

Lack of access on release may cause lapses in treatment

Mental health and substance use disorders in particular are correlated with criminal behavior

Page 17: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 17

PRELIMINARY ANALYSIS: DO NOT CITE

Medicaid Basics

Pre-ACA, mandatory eligibility of Medicaid primarily limited to:

– low-income individuals & families (with specific income limits set at the state level)

– only if disabled, elderly, pregnant, or with dependent children

relatively few ex-offenders eligible unless their state had expanded eligibility beyond federal minimums

Presenter
Presentation Notes
Bullet 3: in other words, federal govt says states have to cover certain groups of people, and beyond that it’s up to the states to expand coverage to different groups. Because many ex-offenders are young, not disabled, and don’t have dependent children, they weren’t eligible for Medicaid.
Page 18: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 18

PRELIMINARY ANALYSIS: DO NOT CITE

ACA Medicaid Expansion Before the ACA Medicaid expansions

– majority of offenders ineligible for Medicaid

– few states pursued Medicaid reimbursement

After ACA Medicaid expansions

– great majority of offenders now eligible

Page 19: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 19

PRELIMINARY ANALYSIS: DO NOT CITE

Analytic Approach 33 states included in analysis

Nearly 1 million prison terms in 2013-2015 analytic file

Compare short-term trends in recidivism in NCRP data

– before & after implementation of ACA Medicaid expansion

– in expansion states vs. non-expansion states

– difference in differences design

Validity hinges on there being no other changes/trends correlated with both state participation in ACA expansions and recidivism

Presenter
Presentation Notes
The Weibull hazard is proportional hazard with general form shown in the equation above. h(t|xj) represents individual offender j’s hazard of returning to prison at time t conditional on his survival to time t. The coefficient of interest for each state is βPost-ACA . Exp(βPost-ACA) represents the relative hazard of returning to prison when an offender is released after the ACA Medicaid expansion. A negative value of βPost-ACA would indicate that on average, offenders’ likelihood of returning to prison declined after the ACA Medicaid expansion (if the state expanded Medicaid), or after January 1, 2014 (if the state did not expand Medicaid.)
Page 20: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 20

PRELIMINARY ANALYSIS: DO NOT CITE

Return Rates in Sample

0.00

0.05

0.10

0.15

0.20

1 31 61 91 121 151 181 211 241 271 301 331 361Days from Release

Non-Expansion States

0.00

0.05

0.10

0.15

0.20

1 31 61 91 121 151 181 211 241 271 301 331 361Days from Release

Expansion States

2013

0.00

0.05

0.10

0.15

0.20

1 31 61 91 121 151 181 211 241 271 301 331 361Days from Release

Non-Expansion States

0.00

0.05

0.10

0.15

0.20

1 31 61 91 121 151 181 211 241 271 301 331 361Days from Release

Expansion States

2013

2014

Presenter
Presentation Notes
ADD Y-AXIS LABEL: Probability of returning to prison at or before time t. P(t)=1-S(t) - Build the curves and walk through the analysis. Explain why we use expansion vs non-expansion. Graphical illustration of analytic approach. Return rate shown here is the Kaplan Meier failure function: Probability of returning to prison at or before time t. P(t)=1-S(t) Data restricted to returns in 2013 and later. Terms at risk censored at 2014, so 2013 returns are from 2013 releases, and all 2014 returns are from 2014 releases.
Page 21: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 21

PRELIMINARY ANALYSIS: DO NOT CITE

ACA Expansion Results

Estimate of ACA impact on recidivism was not statistically significant

Presenter
Presentation Notes
Interpret point estimate: The hazard of returning to prison after the ACA Medicaid expansions is about 3.4%-4.4% lower in expansion states vs non-expansion states. Note that standard errors are large, not stat sig. Next steps are to improve precision of our estimate. Weighted average of Weibull coefficients on the post ACA variable (first difference) for expansion and nonexpansion states. DiD is the difference in weighted average of Weibull coefficients for expansion vs non-expansion states. Exponentiated coefficient is the hazard ratio for 1–unit change in the expansion var.
Page 22: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 22

PRELIMINARY ANALYSIS: DO NOT CITE

Discussion

ACA Medicaid expansions have not yet had a significant effect on recidivism in expansion states vs non-expansion states

– May need more years of post-ACA data to detect effect

– Or maybe expanded eligibility alone is insufficient to impact recidivism

Presenter
Presentation Notes
Taken at face value, it appears that the ACA will not reduce prison pop. Bullet 2: One one hand, maybe Emily Wang is right: must connect offenders to care for law to have any impact. On the other had, we may just need more precise estimates. Illustrates usefulness of NCRP in studying policy changes in a timely manner.
Page 23: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

PRELIMINARY ANALYSIS: DO NOT CITE

A Quasi-Experimental Evaluation of the Impact of Welfare Benefits on Prisoner Recidivism Jeremy Luallen

Page 24: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 24

PRELIMINARY ANALYSIS: DO NOT CITE

Motivation

Why should welfare benefits matter?

– Improved economic circumstances reduced need for criminal behavior

– Scholars argue “public assistance [eligibility] is critical to successful reintegration” (Petersilia, 2003).

The opportunity to test public assistance impact occurred as a result of the application and subsequent removal of a ban on public assistance for drug felons

Page 25: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 25

PRELIMINARY ANALYSIS: DO NOT CITE

Drug Felony Ban

Section 115 of the 1996 Welfare Reform Act (Personal Responsibility and Work Opportunity Reconciliation Act -- PRWORA)

Bans food stamps (SNAP) and welfare assistance (TANF) to convicted drug felons

Applies to drug felons convicted after August 22, 1996

However, PRWORA allows for states to opt-out or modify bans.

Page 26: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 26

PRELIMINARY ANALYSIS: DO NOT CITE

Drug Felony Ban

Within 18 months, 4 states had opted-out of the ban entirely (“No Ban”)

– Today that number has grown to 14

10 states have not altered their use of the ban at all (“Full Ban”)

Page 27: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 27

PRELIMINARY ANALYSIS: DO NOT CITE

Drug Felony Ban

26 states have modified the ban (“Modified Ban”) – subject to additional requirements imposed on drug

felons such as:

(1) participation in or completion of drug treatment

(2) allowances for less serious drug offenders

(3) allowances for benefits after a probationary period

– SNAP & TANF not always modified simultaneously

Page 28: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 28

PRELIMINARY ANALYSIS: DO NOT CITE

Drug Felony Ban

These policy changes can be characterized with three types of transitions:

– Full Ban → Modified Ban

– Modified Ban → No Ban

– Full Ban → No Ban

Estimate 19 impacts of ban changes between 1996 and 2013 across 18 states.

The remaining states had no ban transitions or there was insufficient data

Page 29: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 29

PRELIMINARY ANALYSIS: DO NOT CITE

Timelines in Analysis of 18 States State Pre-96 1996 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013

State 1

State 2

State 3

State 4

State 5

State 6

State 7

State 8

State 9

State 10

State 11

State 12

State 13

State 14

State 15

State 16

State 17

State 18

Page 30: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 30

PRELIMINARY ANALYSIS: DO NOT CITE

Methods

Compare trends in recidivism prior to and after a ban change

Analyze these changes in trends separately for

– Drug offenders

– Nondrug offenders

Compare differences in impacts – difference in differences design

Page 31: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 31

PRELIMINARY ANALYSIS: DO NOT CITE

Graphical Illustration of the Analysis

An illustration: Full Ban → Partial Ban

Non-Drug Offenders

Weekly Returns: Females

Drug Offenders

0

20

40

60

80

100

120

140

-52 -26 0 26 52

Weeks to Ban

Tot

al R

etur

ns to

Pris

on

0

5

10

15

20

25

30

35

40

-52 -26 0 26 52Weeks to Ban

Page 32: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 32

PRELIMINARY ANALYSIS: DO NOT CITE

Results

Restricting benefits has no impact on the rate of returns (recidivism) and therefore the size of drug offender populations in state prisons. Results hold for both men and

for women.

Page 33: Evaluation and Research Corrections Reporting Program (NCRP)€¦ · Points of view in this presentation are those of the authors and do not represent the official position of the

Abt Associates | pg 33

Summary: Utility of NCRP Administrative Records Presentation demonstrated the utility of NCRP with three

applications – Analysis of offender- and event-based recidivism

– Potential impact of health policy changes (ACA) on recidivism

– Potential impact of welfare policy changes on recidivism

NCRP data collection is highly automated, flexible, and economical

Every year the NCRP’s observation window gets wider enhancing its utility – currently 2000 – 2015, and even wider for selected states

Linking NCRP with other administrative records as well as survey data will have a multiplier effect on its utility for program and policy evaluation – a goal BJS is already supporting