new york state assisted outpatient treatment evaluation: review of major findings
Post on 30-Jun-2015
839 Views
Preview:
DESCRIPTION
TRANSCRIPT
MEASUREMENT & DATA
COLLECTION UNITPolicy Research Associates,
Inc.H. Steadman, PhD; P. Robbins,
K. Keator
INTERNAL AOT EVALUATION ADVISORY
GROUPMacArthur Research Network on Mandated Community Treatment
J. Monahan, PhD (Dir);
CONTRACT ORGANIZATIONDept. of Psychiatry & Behavioral Sciences, Duke University Medical
Center, Durham, NCM. Swartz, MD, Principal Investigator & J. Swanson, PhD,
Co-Principal Investigator
SUBCONTRACT ORGANIZATIONPolicy Research Associates, Inc., Delmar, NY
H. Steadman, PhD, Co-Principal Investigator amd P. Robbins
NYS OFFICE OF MENTAL HEALTH
DATA ANALYSIS UNITDept. of Psychiatry & Behavioral
Sciences, Duke University Medical Center
M. Swartz, MD; J. Swanson, PhD, R. Van Dorn, PhD;
Duke/PRA AOT Evaluation Organization Chart
Report Outline
1. Description of AOT program and regional variations
2. Service engagement during AOT 3. Recipient outcomes4. Recipient perceptions of AOT5. Service engagement and outcomes after
AOT ends 6. Impact of AOT on New York’s public
mental health system
Description of AOT Program and Regional Variations: Summary of Findings
• New York’s AOT Program features more comprehensive implementation, infrastructure and oversight than any other comparable program in the U.S.
• NY a critical test of how a comprehensively implemented program of assisted outpatient treatment can perform.
• New York’s program design is unique, so these evaluation findings may not generalize to other states.
Description of AOT Program and Regional Variations: Summary of Findings
• AOT statute can be used to prevent relapse or deterioration before hospitalization is needed.
• In nearly 3/4s of all cases used as a discharge planning tool for hospitalized patients.
• AOT is largely used as a transition plan intended to improve the effectiveness of treatment following a hospitalization and as a method to reduce hospital recidivism.
Description of AOT Program and Regional Variations: Summary of Findings
• Considerable variability in how AOT is implemented across the State.
• Difference between regions in use of enhanced voluntary service (EVS) agreements in lieu of a formal AOT court order.
• In the New York City region: “AOT First” model.
• In other counties: “Enhanced Voluntary Services First” model.
Racial Bias in AOT Program? Summary of Findings
• We find that the over-representation of African Americans in the AOT Program:– is a function of African Americans’ higher likelihood of
being uninsured, – higher likelihood of being served by the public mental
health system (rather than by private mental health professionals),
– and higher likelihood of having a history of psychiatric hospitalization.
• We find no evidence that the AOT Program is disproportionately selecting African Americans or other minorities for court orders.
2005 AOT order density compared to estimated total SMI population
Dots represent distribution of AOT orders in
2005
0%
20%
40%
60%
80%
100%
Total Central Hudson Long Island New York West
Hospital Prison/Jail Community
Pe
rce
nt t
ota
l AO
T o
rde
rs
Exhibit 1.3. Origin of AOT orders, 2002-2007, for various regions of New York.
n=186 n=264n=2068 n=1551n=29 n=38
Source: OMH evaluation data
Recipient Outcomes: Summary of Findings
During AOT: • Substantial reduction in psychiatric hospitalizations and in
days in the hospital. • Modest evidence that AOT reduces the likelihood of being
arrested. • Substantial increases in receipt of intensive case management
services during AOT. • More likely to consistently receive psychotropic medications
appropriate to their psychiatric conditions. • Subjective improvements in many areas of personal
functioning.
14%
11%
9%
0%
2%
4%
6%
8%
10%
12%
14%
16%
Pre-AOT AOT 1-6 months
AOT 7-12 months
Exhibit 3.8 Adjusted percent* with psychiatric inpatient admission in month, by AOT status
*Adjusted probability estimates were generated from repeated measures regression models controlled for time, region, race, age, sex, diagnosis, and co-insurance status. Models were also weighted for propensity to initially receive AOT and to receive more than 6 months of AOT.
Source: Medicaid claims and OMH admissions data.
Adju
sted p
erc
en
t
Exhibit 3.9. Adjusted* average inpatient days during any 6 month period, by AOT status
*Adjusted mean estimates were generated from repeated measures regression models controlled for time, region, race, age, sex, diagnosis, and co-insurance status. Models were also weighted for propensity to initially receive AOT and to receive more than 6 months of AOT. Source: Medicaid claims and AOT Evaluation database.
Ave
rag
e n
um
be
r of
da
ys
18
1110
0
2
4
6
8
10
12
14
16
18
20
Pre-AOT AOT 1-6 months AOT 7-12 months
35%
44%
50%
20%
25%
30%
35%
40%
45%
50%
55%
Pre-AOT AOT 1-6 months
AOT 7-12 months
Exhibit 3.10 Adjusted percent* with at least 80% medication possession in month by AOT status
*Adjusted probability estimates were generated from repeated measures regression models controlled for time, region, race, age, sex, diagnosis, and co-insurance status. Models were also weighted for propensity to initially receive AOT and to receive more than 6 months of AOT.
Source: Medicaid and OMH records.
Adju
ste
d p
erc
ent
3.7
1.9
2.8
0
0.5
1
1.5
2
2.5
3
3.5
4
Pre-AOT and Pre-EVS Current AOT Current EVS
Exhibit 3.2. Adjusted* percent arrested in month by current receipt ofAOT and EVS
Ad
just
ed
pe
rce
nt a
rrest
ed
in m
on
th
*Adjusted arrest rate estimates were produced using multivariable time-series regression analysis, controlling for time, region, age, sex, race, education, and diagnosis. Months spent in hospital are excluded from analysis.
Source: 6-county interviews and Division of Criminal Justice Services.
Recipient Perceptions of AOT: Summary of Findings
• AOT recipients and non-AOT recipients have remarkably similar attitudes and treatment experiences.
• AOT recipients feel neither more positive or more negative about their mental health treatment experiences than comparable individuals who are not under AOT.
• Positive and negative attitudes about AOT are more strongly influenced by other experiences than AOT itself.
Service Engagement and Outcomes after AOT Ends: Summary of Findings
• Sustained improvement after AOT ends varies according to the length of time the recipient spends under the AOT order.
• After 6 months, decreased rates of hospitalization and improved receipt of psychotropic medications are only sustained if recipients receive intensive services after AOT is discontinued.
• After 12 months or longer, decreased rates of hospitalization and improved receipt of medications are sustained whether or not intensive services are continued after AOT is discontinued.
• Improvements are more likely to be sustained if AOT continues at least12 months.
11%
8%
7% 7%
0%
2%
4%
6%
8%
10%
12%
14%
Pre-AOT, no ACT or ICM AOT w ith ACT-ICM for 7-12months
Discontinues AOT after 7-12months, but remains on ACT-
ICM
Discontinues both AOT andACT-ICM after 7-12 months
Ad
just
ed
pe
rce
nt
Exhibit 5.2 Adjusted percent* with psychiatric inpatient treatment in month over long-term AOT course
*Adjusted probability estimates were generated from repeated measures regression models controlled for time, region, race, age, sex, diagnosis, and co-insurance status.
After long-term AOTDuring
long-term AOTBefore AOT
ACT-ICM No ACT-ICM
37%
52%50%
43%
0%
10%
20%
30%
40%
50%
60%
70%
Pre-AOT, no ACT or ICM AOT w ith ACT-ICM for 7-12months
Discontinues AOT after 7-12months, but remains on ACT-
ICM
Discontinues both AOT andACT-ICM after 7-12 months
Exhibit 5.4 Adjusted percent* with at least 80% medication possession in month over long-term AOT course
*Adjusted probability estimates were generated from repeated measures regression models controlled for time, region, race, age, sex, diagnosis, and co-insurance status.
After long-term AOTDuring
long-term AOTBefore AOT
ACT-ICM No ACT-ICM
Ad
just
ed
pe
rce
nt
3.7
1.9
3.4
2.8
3.3
0
0.5
1
1.5
2
2.5
3
3.5
4
Pre-AOT andPre-EVS
Current AOT Post-AOT Current EVS Post-EVS
Number of individuals=181; Number of person-month observations=9,229. Adjusted arrest rate estimates were produced using multivariable time-series regression analysis, controlling for time, region, age, sex, race, education, and diagnosis. Months spent in hospital are excluded from analysis.
Source: 6-county interviews and Division of Criminal Justice Services
Exhibit 5.5 Adjusted percent arrested in month by receipt of AOT and Enhanced Voluntary Services
Pe
rce
nt
The Impact of AOT on New York’s Public Mental Health System: Summary of Findings
• First several years of the AOT Program, between 1999-2003, preference for intensive case management services was given to AOT cases.
• After 2003, new AOT orders leveled off in the state and then declined.
• New treatment capacity then available to other individuals who needed these services, irrespective of AOT status.
• After ramp-up of the AOT programs intensive community-based services increased for individuals on AOT and not on AOT alike.
• New service capacity is now fully utilized, competition for services in the near future may intensify, with unknown relative effects on AOT and non-AOT recipients.
• It is impossible to generalize these findings to states where services do not simultaneously increase.
Num
ber
of
AC
T/IC
M c
laim
s
0
10
20
30
40
50
60
70
80
90
100
1 13 25 37 49 61 73 85
Exhibit 6.4 Non-AOT share of ACT-ICM services by month
(2000)Month
(2007)
Perc
ent
of
tota
l AC
T-IC
M M
ed
icaid
cla
ims
for
non-A
OT
reci
pie
nts
Overall Summary of Findings (1)
• We find that New York State’s AOT Program improves a range of important outcomes for its recipients.
• The increased services available under AOT clearly improve recipient outcomes, however, the AOT court order and its monitoring do appear to offer additional benefits in improving outcomes.
• It is also important to recognize that the AOT order exerts a critical effect on service providers stimulating their efforts to prioritize care for AOT recipients.
Overall Summary of Findings (2)• Once AOT recipients leave the program, improvements are more likely
sustained among those who continue to receive intensive treatment services or had longer periods of AOT—especially 6 months or longer.
• Perceptions of the AOT Program, experiences of stigma, coercion and treatment satisfaction appear to be largely unaffected by participation in the program and are likely more strongly shaped by other experiences with mental illness and treatment.
• In its early years the AOT Program did appear to reduce access to services for non-AOT recipients, but in recent years the reduction in new AOT cases has attenuated this effect.
• Lack of continued growth of new service dollars will likely increase competition for access to services once again.
Overall Summary of Findings (3)
• Available data allow only a limited assessment of whether voluntary agreements are effective alternatives to initiating or continuing AOT.
• There are relatively few voluntary agreements and they typically occur in counties that use the "EVS First" model.
• However, we found some evidence that AOT recipients are at lower risk of arrest than their counterparts in enhanced voluntary services.
• We also found evidence in the case manager data that receiving AOT combined with ACT services substantially lowers risk of hospitalization compared to receiving ACT alone.
That’s all, folks!
top related