state hmo accreditation and external quality review requirements: implications for hmos serving...

13
Rural Health Policv State HMO Accreditation and External Quality Review Requirements: Implications for HMOs Serving Rural Areas Michelle Casey, M.S. ABSTRACT The purpose of this article is to analyze state regulations regarding health maintenance organization ( H M O ) accreditation and external quality review; to briefly describe states’ experiences implementing these regulations; and to discuss the implications of these reg- ulations for HMOs serving rural areas. The incorporation of HMO accreditation and external quality review requirements into state H M O licensure processes and state employee contract- ing raises many policy issues, including several that are especially relmnt to HMOs serving rural populations. A key issue is whether the linkage of accreditation and external quality re- view requirements to HMO licensure will be an additional deterrent to the development of nao HMOs or the expansion of existing HMOs into rural areas. Other issues relate to the costs and benefits of accreditation for HMOs serving rural populations, and the potential im- pact of HMO accreditation requirements on eforts to expand managed care enrollment of ru- ral Medicaid and Medicare beneficiaries and rural state employees. Nine states w r e identified that have regulations requiring HMOs to seek accreditation or to undergo an external quality review as a condition of licensure. Four states weye identified as implementing requirements that an HMO be accredited in order to serw state employees. Many of these requirements are still in the early stages of implementation. Several states with the requirements have signifi- cant rural populations and will provide opportunities to mluate their impact on HMOs serw ing rural areas, rural providers and rural consumers. n response to concerns among health care con- sumers and policy-makers about the quality of care provided by managed care organizations (MCOs), states have passed managed care re- form legislation at unprecedented rates in recent years (Noble and Brennan, 1999). Several states now require health maintenance organizations (HMOs) to undergo external quality reviews or accreditation sur- veys as a condition of HMO licensure or to serve state employees. The adoption of accreditation requirements is viewed by these states as a means of assessing and improving the quality of care provided by HMOs. I The Journal of Rural Health 40 Vol. 17, No. 1

Upload: michelle-casey

Post on 21-Jul-2016

216 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: State HMO Accreditation and External Quality Review Requirements: Implications for HMOs Serving Rural Areas

Rural Health Policv

State HMO Accreditation and External Quality Review Requirements: Implications

for HMOs Serving Rural Areas Michelle Casey, M.S.

ABSTRACT The purpose of this article is to analyze state regulations regarding health maintenance organization (HMO) accreditation and external quality review; to briefly describe states’ experiences implementing these regulations; and to discuss the implications of these reg- ulations for HMOs serving rural areas. The incorporation of HMO accreditation and external quality review requirements into state HMO licensure processes and state employee contract- ing raises many policy issues, including several that are especially relmnt to HMOs serving rural populations. A key issue is whether the linkage of accreditation and external quality re- view requirements to HMO licensure will be an additional deterrent to the development of nao HMOs or the expansion of existing HMOs into rural areas. Other issues relate to the costs and benefits of accreditation for HMOs serving rural populations, and the potential im- pact of HMO accreditation requirements on eforts to expand managed care enrollment of ru- ral Medicaid and Medicare beneficiaries and rural state employees. Nine states w r e identified that have regulations requiring HMOs to seek accreditation or to undergo an external quality review as a condition of licensure. Four states weye identified as implementing requirements that an HMO be accredited in order to serw state employees. Many of these requirements are still in the early stages of implementation. Several states with the requirements have signifi- cant rural populations and will provide opportunities to mluate their impact on HMOs serw ing rural areas, rural providers and rural consumers.

n response to concerns among health care con- sumers and policy-makers about the quality of care provided by managed care organizations (MCOs), states have passed managed care re- form legislation at unprecedented rates in recent

years (Noble and Brennan, 1999). Several states now

require health maintenance organizations (HMOs) to undergo external quality reviews or accreditation sur- veys as a condition of HMO licensure or to serve state employees. The adoption of accreditation requirements is viewed by these states as a means of assessing and improving the quality of care provided by HMOs.

I The Journal of Rural Health 40 Vol. 17, No. 1

Page 2: State HMO Accreditation and External Quality Review Requirements: Implications for HMOs Serving Rural Areas

However, the incorporation of accreditation require- ments into state HMO licensure processes and state employee contracting raises many policy issues. For example, what are the appropriate roles of state HMO regulatory agencies and private accreditation organiza- tions in assessing and ensuring the quality of care provided to HMO enrollees? To what extent are state HMO regulatory and accreditation processes duplica- tive, and how should they be coordinated? Should HMOs' decisions to obtain accreditation result from employer demand or state mandates? Does the impo- sition of HMO accreditation requirements raise equity issues if a state does not impose similar requirements for other health plans? How many HMOs that would not otherwise chose to apply for accreditation are do- ing so as a result of these requirements, and at what cost? On the benefit side, how has the incorporation of HMO accreditation and external quality requirements in licensure processes improved the quality of care provided to enrollees?

Some of the policy issues raised by accreditation re- quirements are especially relevant to HMOs serving rural populations, because of certain characteristics of rural health care markets.

ment, commercial, Medicare and Medicaid managed care rates in rural areas remain considerably lower than those of urban areas (Moscovice, et al., 1998). The costs of applying and preparing for accreditation are a significant barrier for some HMOs that serve rural ar- eas, particularly smaller and younger HMOs. Both ac- credited and nonaccredited HMOs that serve rural ar- eas have identified a number of difficulties with Na- tional Committee for Quality Assurance (NCQA) ac- creditation standards in the categories of quality improvement, preventive health and medical records (Casey and Klingner, 2000). Many of these difficulties relate to characteristics of the HMOs and of the physi- cian practices with which they contract in rural areas (e.g., independent practice associations composed of predominantly solo or small group practices).

A key issue for rural areas, therefore, is whether the linkage of accreditation and external quality review re- quirements to HMO licensure will be an additional de- terrent to the development of new HMOs or the expan- sion of existing HMOs into rural areas. State HMO ac- creditation requirements have the potential to affect how many and which types of HMOs enter rural mar- kets. They may promote the expansion of large, nation- ally affiliated and urban-based HMOs, while creating an additional barrier to the development of regionally based HMOs that serve rural areas. Equity consider-

Despite recent growth in rural managed care enroll-

ations between HMOs and other types of health plans may be especially important in many rural health care markets where HMO penetration is limited and the predominant form of competition for an HMO may be indemnity insurers and preferred provider organiza- tions (PPOs) rather than other HMOs.

Additional policy issues relate to the potential im- pact of HMO accreditation requirements on future ef- forts to expand managed care enrollment of Medicaid and Medicare beneficiaries. Implementation of capitat- ed Medicaid and Medicare managed care programs in rural areas has been a challenge for the federal and state governments as well as the MCOs involved in the process (Silberman, et al., 1997; Casey, 1998). To date, neither state Medicaid agencies nor the Health Care Financing Administration (HCFA) have required Medicaid or Medicare plans to obtain HMO accredita- tion as a condition of serving Medicaid or Medicare enrollees, although several states require Medicaid plans to report Health Plan Employer Data and Infor- mation Set (HEDIS) data, and HCFA requires HEDIS data reporting from Medicare plans (Health Care Fi- nancing Administration, 1997; Partridge and Torda, 1997). If some states or HCFA require accreditation of Medicaid or Medicare plans in the future, these re- quirements may conflict with efforts to expand man- aged care enrollment of Medicaid and Medicare bene- ficiaries in rural areas. Plans that are not traditional HMOs, such as Medicaid plans composed of commu- nity-based providers or Medicare provider sponsored organizations (PSOs), may find it especially difficult to commit the resources needed to attain accreditation. To date, very few Medicaid "safety net" plans spon- sored by community providers have obtained accredi- tation (Gray & Rowe, 2000).

Requirements that HMOs be accredited to serve state employees also may be in potential conflict with state policies to expand managed care options for public employees, including those who reside in rural areas. Depending on the number of accredited HMOs that are serving rural areas, this type of requirement

Support for this paper wlls provided by the W c e of Rural Health Policy, Health Resources and Services Administration, PHS Grant No. CSRUC 0002-02. The author thanks the state HMO regulatory stafi state employee benefits staff and representatives of accrediting organizations zvho provided injormation for this project, and Anthony Wellever, Ira Moscovice and tw anonymous reuieuws who provided helpful comments on an earlier version of the p a p a For further information, contact: Michelle Casey, University of Minnesota Rural Health Research Center, 2221 University Ave., S.E., #112, Minneapolis, M N 55414.

caspy 41 Winter 2001

Page 3: State HMO Accreditation and External Quality Review Requirements: Implications for HMOs Serving Rural Areas

may eliminate a managed care option for some state employees living in rural areas.

The purpose of this paper is to (1) analyze state regulations regarding HMO accreditation and external quality review; (2) briefly describe states' experiences implementing these regulations, and (3) discuss the implications of these regulations for HMOs serving ru- ral areas. The primary focus is on state regulations that require an HMO to seek accreditation or undergo external quality review as a condition of licensure. A secondary focus is on state regulations or contract provisions that require an HMO to be accredited in order to serve state employees. The research for this paper was conducted as part of a larger study that ex- amined the statistical relationship between NCQA ac- creditation and the extent to which an HMO serves rural populations (Casey and Brasure, 1998), the expe- riences of a sample of HMOs serving rural areas with NCQA accreditation and HEDIS data reporting (Casey and Klingner, 2000), and rural hospitals' experiences with Joint Commission on Accreditation of Healthcare Organizations (JCAHO) accreditation (Brasure, et al., in press).

Study Design and Methods

Several national accrediting organizations accredit and conduct external quality reviews of HMOs and other managed care organizations, including the Ac- creditation Association for Ambulatory Health Care (AAAHC)', the American Accreditation Healthcare Commission/Utilization Review Accreditation Com- mission (URAC)*, JCAH03, and NCQA4. In addition, peer review organizations (PROS) in some states con- duct external quality reviews of HMOs.

Using information from NCQA, URAC, AAAHC and JCAHO, 11 states (Connecticut, Florida, Kansas, Nevada, New Jersey, Oklahoma, Pennsylvania, Rhode Island, South Carolina, Vermont and West Virginia) were initially identified as having some type of state external quality review or accreditation requirements for HMOs (Accreditation Association for Ambulatory Health Care, 1998; S. Lamb, NCQA [personal commu- nication, Feb. 19, 19981; NCQA, 1998; Utilization Re- view Accreditation commission, 1998a). Five states (Alabama, Iowa, New York, Ohio and Tennessee) were also initially identified as having some type of accred- itation requirement for HMOs wishing to serve state employees (S. Lamb, NCQA [personal communication, Feb. 19, 19981).

Those 16 states were contacted for copies of relevant laws or regulations relating to HMO accreditation or external quality review. The laws and regulations were reviewed, and phone interviews with state officials fol- lowed during August and September 1998 to clarify provisions of the laws and regulations and to ask about states' implementation experiences. The informa- tion in this article was current as of September 1998. In September 2000, a review of state Internet sites for the nine states previously identified as having HMO accreditation or external review requirements indicat- ed that these requirements remained in state statute or regulations.

State Regulations Requiring HMO Accreditation or External Quality Reviews as a Condition of Lieensure

HMO Accreditation and External Review Require- ments. Analysis of state regulations and interviews with state officials identified nine states that have reg- ulations requiring HMOs to apply for or obtain ac- creditation, or to undergo an external quality review, as a condition of licensure (Table 1). Seven of those states require the accreditation survey or external quality review to be conducted using the accrediting organization's standards or a combination of the ac- crediting organization's and state standards. The Flori- da and Rhode Island regulations specifically require HMOs operating in those states to obtain accredita- tion. The New Jersey, Oklahoma, Pennsylvania, South Carolina and West Virginia regulations require HMOs to apply for accreditation or undergo an external qual- ity review, but they do not specifically require the HMO to obtain accreditation. Two states, Kansas and Nevada, require HMOs to obtain an external quality review using state standards.

In addition, Alabama and New Mexico allow state regulators to require an HMO to obtain an external quality review at the discretion of the regulatory agen- cy-for example, when the agency determines that an HMO has a significant quality problem. The Alabama regulations require an HMO to have an external quali- ty assessment performed by an approved expert "when the Department [of Public Health] may direct for cause" (Code of Ala. 420-5-6.13). In New Mexico, an HMO must have an external quality audit conduct- ed by an approved independent quality review organi- zation "upon request by the Superintendent [of Insur- ance]" (13 NMAC 10.20.8).

The Iournal of Rural Health 42 Vol. 17, No. 1

Page 4: State HMO Accreditation and External Quality Review Requirements: Implications for HMOs Serving Rural Areas

Time Frame for Meeting Accreditation and Exter nal Review Requirements. In Kansas, Nevada, Oklahoma, South Carolina and West Virginia, HMOs have three years from the date of initial licensure to meet the state’s accreditation or external quality re- view requirement. New Jersey links the time frame for its external quality review requirement to the state’s schedule for comprehensive HMO assessments. This schedule is based on each HMO’s date of licensure, with oldest HMOs being assessed first; any HMOs with certificates of authority issued after July 1997 will be reviewed in three years. Rhode Island allows HMOs two years from the date of initial licensure. Florida requires HMOs to apply for accreditation within one year and be accredited within two years. Pennsylvania requires an external review within one year, which the Pennsylvania Department of Health interprets to mean one year from the time the HMO has enrollees, since some HMOs have their certificates of authority for several months before enrolling members.

Approved Accrediting and External Quality Re- view organizations. All nine states require that the external quality review or accrediting organization be approved by the state HMO regulatory agency, usual- ly the insurance or health department. Several state regulations do not include the specific criteria to be used in approving the external quality review or ac- crediting organizations. Florida, Pennsylvania and West Virginia require the organizations to be “experi- enced in the appraisal of medical practice and quality assurance in an HMO setting.” The Florida regula- tions also specify that the organizations must have “at least three years of experience in reviewing all of the types of HMOs commonly found doing business in the State of Florida” and ”experience in conducting ac- creditation reviews for HMOs in at least five states of the United States or two regions of the Health Care Financing Administration.” Oklahoma has five criteria, including that the quality examiner have written crite- ria and standards for assessing the quality of clinical care and the availability, accessibility and continuity of care, and that it limit clinical judgments to physicians with experience in the delivery of health care in an HMO setting.

NCQA is an approved organization in all nine states with HMO accreditation or external quality re- view requirements. JCAHO is an approved organiza- tion in five states. AAAHC is approved in four states, and URAC in three states. Two states, Kansas and

New Jersey, have approved state-level PROS as external quality-review organizations.

In states that have approved more than one accredi- tation or external review organization, state officials indicate that various factors, such as the HMO’s expe- rience with one of the accrediting or review organiza- tions, costs and Medicaid review requirements, appear to influence HMOs’ choices of organizations. Some state officials indicate that a number of HMOs in their states were accredited by NCQA before the state im- plemented an external review or accreditation require- ment. In some states, such as Oklahoma, the older, na- tionally affiliated HMOs are NCQA-accredited, while newer HMOs have chosen one of the other accrediting organizations. The lower cost of a PRO review, com- pared with other options, has influenced several HMOs in Kansas to choose that option. The PRO of New Jersey has a contract with the state Medicaid agency to review HMOs with Medicaid products. Some New Jersey HMOs with Medicaid products have chosen to also have the PRO review their commercial side; others have chosen a different review organiza- tion, usually NCQA, for their commercial business.

Sanctions for Failure to Meet Accreditation or Ex- ternal Quality Review Requirements. The majority of state regulations do not include specific sanctions for an HMO’s failure to undergo an accreditation survey or external quality review, or to obtain accreditation or a favorable review. Florida is an exception, with sanc- tions ranging from fines and temporary suspension of enrollment for failure to apply for accreditation or be surveyed within required time frames, up to revoca- tion of the HMO’s certificate of authority for failure to obtain accreditation from a follow-up survey conduct- ed subsequent to a failed survey. In states without specific sanctions, state officials may apply general sanctions for failure to meet any state HMO regulato- ry requirements, including implementation of correc- tive plans, fines and ultimately denial, suspension or revocation of an HMO’s license or certificate of authority.

Many of the state HMO accreditation and external quality review requirements were implemented quite recently. Consequently, few states have had experience dealing with failures to meet these requirements. Flor- ida has fined one HMO for failure to obtain accredita- tion within the time required. In the first round of ex- ternal quality reviews, some Kansas HMOs did not obtain a review within the required time and were as- sessed penalties; state officials now send reminder let- ters to help ensure compliance. One Pennsylvania

ci=Y 43 Winter 2002

Page 5: State HMO Accreditation and External Quality Review Requirements: Implications for HMOs Serving Rural Areas

b

E 3- i2 f

Tab

le 1

. St

ate

HM

O A

ccre

dita

tion

and

Ext

erna

l Rev

iew

Req

uire

men

ts.

Stat

e R

equi

rem

ent

App

rove

d A

ccre

ditin

g/R

evie

w

Eff

ectiv

e D

ate

Org

aniz

atio

ns

Flor

ida

As

a co

nditi

on o

f do

ing

busi

ness

in th

e st

ate,

eac

h H

MO

and

pre

paid

hea

lth

clin

ic s

hall

appl

y fo

r ac

cred

itatio

n with

in 1

year

and

be

accr

edite

d w

ithin

2

year

s of

the

org

aniz

atio

n’s r

ecei

pt o

f its

cer

tific

ate

of a

utho

rity

. All

HM

Os

and

PHC

s m

ust u

nder

go re

accr

edita

tion

not

less

than

onc

e ev

ery

3 ye

ars.

A

ccre

dita

tion

and

reac

cred

itatio

n mus

t be

by a

n or

gani

zatio

n ap

prov

ed b

y th

e A

genc

y fo

r H

ealth

Car

e A

dmin

istra

tion.

A r

epre

sent

ativ

e of

the

agen

cy

shal

l acc

ompa

ny th

e ac

cred

itatio

n or

revi

ew o

rgan

izat

ion

thro

ugho

ut th

e

1992

A

AA

HC

, JCA

HO

, NC

QA

t

Nev

ada

New

Jer

sey

<

F z P

accr

edita

tion

or a

sses

smen

t pro

cess

, and

a c

opy

of t

he w

ritte

n re

port

of

the

accr

edita

tion

orga

niza

tion

mus

t be

subm

itted

to th

e de

part

men

t with

in 3

0 da

ys o

f re

ceip

t. T

he a

genc

y w

ill m

onito

r th

e ac

cred

itatio

n sta

tus o

f al

l HM

Os

and

PHC

s, an

d in

itiat

e ac

tions

for

HM

Os

that

hav

e no

t ap

plie

d or

not

bee

n su

rvey

ed w

ithin

the

appr

opri

ate

time

fram

e, o

r fa

iled

the

accr

edita

tion

surv

ey. (

641.

512

Flor

ida

Stat

ute,

59A

-12.

0071

-120

0.72

. F.A

.C.)

At l

east

onc

e w

ery

3 ye

ars

and

at s

uch

othe

r tim

es as

the

com

mis

sion

er m

ay

requ

ire, a

n H

MO

sha

ll obtain a

n on

-site

qua

hty

of care a

sses

smen

t by

an

inde

pend

ent quality r

evie

w o

rgan

izat

ion

acce

ptab

le to

the

com

mis

sion

er. T

he

Insu

ranc

e D

epar

tmen

t has

app

rove

d 7 +ty

as

sura

nce

guid

elin

es fo

r us

e in

this

revi

ew. U

pon

com

plet

ion

of the

revi

ew, t

he r

evie

win

g or

gani

zatio

n pr

epar

m

a le

tter t

o the

Insu

ranc

e D

epar

tmen

t rep

ortin

g w

heth

er th

e H

MO

is c

ompl

iant

, no

n-co

mpl

iant

, or

in q

ualif

ied

com

plia

nce

with

eac

h gu

idel

ine.

(K.S

.A. 4

0-32

11)

The

stat

e bo

ard

of he

alth

sha

ll m

ake

an e

xam

inat

ion

conc

erni

ng th

e qu

ality

of

heal

th c

are

serv

ices

of a

ny H

MO

and

pro

vide

rs w

ith w

hom

suc

h or

gani

zatio

n ha

s co

ntra

cts,

agr

eem

ents

, or

othe

r ar

rang

emen

ts p

ursu

ant t

o its

hea

lth c

are

plan

as

ofte

n as

it d

eem

s ne

cess

ary,

but

not

les

s fr

eque

ntly

than

onc

e ev

ery

3 ye

ars.

The

stat

e de

lega

tes

the

revi

ew p

roce

ss to

NC

QA

and

JCA

HO

. Rev

iew

s ar

e co

nduc

ted using

stat

e qu

ality

sta

ndar

ds. (

NR

S 69

5C.3

10)

Each

HM

O s

hall

subm

it, a

s pa

rt o

f th

e co

mpr

ehen

sive

ass

essm

ent r

evie

w

proc

ess,

evi

denc

e of

the

mos

t rec

ent

exte

rnal

qua

lity

audi

t tha

t has

bee

n co

nduc

ted

with

in 3

yea

rs o

f th

e da

te o

f th

e co

mpr

ehen

sive

ass

essm

ent

revi

ew. S

uch

audi

t sha

ll be

per

form

ed b

y an

ext

erna

l qua

lity

revi

ew

orga

niza

tion

(EQ

RO

) app

rove

d by

the

Dep

artm

ent.

The

rep

ort s

hall

desc

ribe

in d

etai

l the

HM

Os

conf

orm

ance

to p

erfo

rman

ce s

tand

ards

est

ablis

hed

by

the

EQRO

, oth

er n

atio

nal s

tand

ard-

setti

ng b

odie

s fo

r H

MO

s, an

d/or

sta

te

HM

O r

ules

. The

rep

ort s

hall

also

des

crib

e in

det

ail a

ny c

orre

ctiv

e ac

tions

pr

opos

ed a

nd/o

r un

dert

aken

and

app

rove

d by

the

EQ

RO

. The

rep

ort s

hall

be s

ubm

itted

to th

e D

epar

tmen

t with

in 6

0 da

ys o

f its

rece

ipt

in f

inal

form

by

the

HM

O. T

he H

MO

sha

ll no

t be

requ

ired

to r

ecei

ve ”

accr

edita

tion”

or

“cer

tific

atio

n” o

r ot

her such s

tatu

s gr

ante

d by

the

EQ

RO. T

he C

omm

issi

oner

m

ay g

rant

an

HM

O a

def

erra

l of

the

exte

rnal

qua

lity

audi

t req

uire

men

t fo

r a

12 m

onth

per

iod

if it

is i

n th

e in

itial

3 y

ears

of

star

t-up

ope

ratio

ns, a

nd it

de

mon

stra

tes a

fin

anci

al o

r op

erat

iona

l har

dshi

p (N

JAC

838

-7.2

)

1987

1991

1997

AA

AH

C, J

CA

HO

, NC

QA

, Kan

sas

Foun

datio

n fo

r H

ealth

Car

e (lo

cal p

eer

revi

ew o

rgan

izat

ion)

Stat

e de

lega

tes r

evie

w p

roce

ss t

o N

CQ

A a

nd J

CA

HO

AA

HC

/UR

AC

, JC

AH

O, N

CQ

A,

Peer

Rev

iew

Org

aniz

atio

n of

New

Jer

sey

Y

Page 6: State HMO Accreditation and External Quality Review Requirements: Implications for HMOs Serving Rural Areas

8661

L86T

P661

Page 7: State HMO Accreditation and External Quality Review Requirements: Implications for HMOs Serving Rural Areas

Table 2. States Allowing Deemed Compliance With HMO Regulations for Accredited HMOs.’

State Description of Regulation Effective Date

New Jersey If an HMO attains ”accreditation” or “certification” or other such status granted by the external quality review organization (EQRO) within the 12 months prior to the Department’s comprehensive assessment review, the HMO shall be exempted from examination by the

New Mexico

Ohio

Oklahoma

Vermont

Department in any area in which the Commissioner determines that the EQROs review demonstrated specific compliance with standards substantially equivalent to those in state HMO regulations. (NJAC.8:38-7.2[c]) An MHCP may submit accreditation by a nationally recognized accrediting entity as evidence of compliance with the credentialing, utilization management, and performance and outcome measurement requirements in state HMO regulations. The MHCP may be deemed to have met the relevant state requirements where comparable standards exist, and the private accrediting agency is recognized and approved by the Superintendent. (13 NMAC 10.13.11, 10.19.5, 10.20.10) A health insuring corporation may present evidence of compliance with state requirements for a quality assurance program and for utilization review by submitting certification to the Superintendent of Insurance of its accreditation by an independent, private accrediting organization. Upon review of the organization’s accreditation process, the Superintendent may determine that accreditation constitutes compliance with the requirements. (ORC.1751.75) The Commissioner shall treat a managed care plan as meeting a specific state standard if the plan is accredited by a national private accreditation body recognized by the Commissioner, and the Commissioner finds that the specific state standard is at least equivalent to a requirement used by the national private accreditation body in accrediting the managed care plan. (OAC.310:656-3-2) Each managed care plan shall, on a continual basis, evaluate the quality of health and medical care provided to its members in Vermont. A managed care plan may fulfill this requirement through an independent accreditation organization approved by the Department as capable of analyzing, in an in-depth manner, a managed care plan’s provision of quality health and medical care to its members. (HCA Rule 10.000, Section 10.204)

March 1997

March 1997

October 1998

1997

1997

1. These states were identified in the process of analyzing state HMO accreditation and external quality review requirements, so the list may not include all states with regulations allowing accredited HMOs to be deemed in compliance with certain state HMO requirements.

HMO failed to achieve accreditation in an initial re- view because it was not conducting primary verifica- tion correctly, although it had an above-average quali- ty assurance program. The problem was dealt with in- ternally, and the HMO was accredited on a subse- quent review.

ipate a lack of compliance with their external quality review and accreditation requirements but that they will handle any violations that do occur on a case-by- case basis. Several state regulators noted that denial of accreditation, or the identification of significant quality problems in an HMO’s external quality review, would cause them to examine an HMOs quality assurance program very carefully.

A few state officials indicated that they do not antic-

Deemed Compliance with State HMO Regulations for Accredited HMOs. Deemed-compliance provisions in state regulations, which allow an HMO to use in- formation from an HMO’s accreditation survey as evi- dence that the HMO complies with an equivalent state regulation, are a means of reducing HMOs’ regulatory burden and potential duplication of effort by the state and accrediting organizations. In the process of ana- lyzing state HMO accreditation and external quality review requirements, five states were identified that have implemented regulations allowing accredited HMOs to be deemed in compliance with certain state HMO requirements: New Jersey, New Mexico, Ohio, Oklahoma and Vermont (Table 2). Additional states where officials were interviewed, including West Vir-

The ]oumal of Rural Health 46 Vol. 27, No. 1

Page 8: State HMO Accreditation and External Quality Review Requirements: Implications for HMOs Serving Rural Areas

~ ~~

Table 3. State HMO Accreditation Requirements for HMOs Serving State Employees.

State Requirement

Approved Accrediting

Effective Date Organizations

Iowa

Alabama The State Employee Insurance Board’s quality assurance/quality improvement Jan. 1, 1998 NCQA standard in its contracts with HMOs states that the HMO must have NCQA accreditation by Jan. 1, 1998. The contract provides that 10 percent of the HMOs total annual premium is at risk for failure to meet this standard, with the penalty to be assessed on a monthly basis.

approval to offer benefits to state employees shall provide evidence of accreditation by NCQA or JCAHO. Where an HMO or ODs seeks approval to offer benefits to state employees for the first time and has not received the required accreditation, the department will waive the requirement for up to two consecutive benefit years providing the HMO or ODs provides clear evidence of its intent to receive the required accreditation.

status of full or one-year. This is a contracting requirement that was agreed upon by the state of Ohio and unions representing state employees.

within two years of contracting with the state to serve state employees. This is a state Division of Insurance Administration contracting requirement.

Beginning with the benefit year starting Jan. 1, 2001, any HMO or ODs seeking January 2001 JCAHO, NCQA

Ohio HMOs serving state employees must be NCQA accredited, with an accreditation November 1997 NCQA

Tennessee HMOs serving state employees must be NCQA accredited, or become accredited 1995 NCQA

ginia and Alabama, are considering implementation of regulations allowing deemed compliance for accredit- ed HMOs. (This may not include all states with these regulations or proposed regulations, since all states were not surveyed.)

ry agency to evaluate the standards used by the ac- crediting organization and to determine that those standards are equivalent to the state HMO standards. New Mexico allows deemed compliance with creden- tialing, utilization management, and performance and outcome measurement requirements, and Ohio allows deemed compliance with quality assurance and utili- zation management requirements.

Because deemed-compliance provisions are relative- ly new, states have had limited experience with imple- mentation. The state regulators interviewed were gen- erally supportive of deemed-compliance provisions but cautioned that they would continue to exercise regulatory authority over accredited HMOs as neces- sary. Regulators in some states noted that a number of NCQA accrediting standards were equivalent to or more comprehensive than state standards. However, a few regulators cited examples where state standards were stricter than comparable accreditation standards (for example, one state requires a complete work histo-

The five states identified require the HMO regulato-

ry from HMO participating physicians rather than five years of history, and another requires more frequent examination of HMOs’ credentialing processes).

State Requirements That an HMO be Accredited as a Condition of Serving State Employees

Accreditation Requirements for HMOs Serving State Employees. Four states have implemented or are implementing requirements that an HMO be accredit- ed in order to serve state employees: Alabama, Iowa, Ohio and Tennessee (Table 3). A fifth state, New York, had initially decided in 1995 to phase in a require- ment that HMOs serving state employees be NCQA- accredited. However, New York State’s Joint Labor Management Committee has since moved away from requiring accreditation. The state’s request for propos- als for health plans to serve state employees asks HMOs to provide information about their current NCQA accreditation status and their accreditation sta- tus from other nationally recognized accreditation or- ganizations. This information is one factor considered in selecting HMOs, and most HMOs now serving state

47 winter 2001

Page 9: State HMO Accreditation and External Quality Review Requirements: Implications for HMOs Serving Rural Areas

employees are NCQA-accredited, but accreditation is not required. New York‘s policy is similar to that of the Federal Employees Health Benefit (FEHB) Pro- gram, which “encourage(s) all FEHB plans to get ac- creditation from a national accrediting organization” but does not require accreditation (U.S. Office of Per- sonnel Management, 1999).

-The State Employee Insurance Board in Alabama began requiring HMOs serving state employees to be NCQA-accredited in 1997. The board’s contracts with HMOs require them to have NCQA accreditation by Jan. 1, 1998, and place 10 percent of the HMO’s total annual premium at risk for failure to meet this stan- dard. The board now contracts with four HMOs that together serve about 5 percent of state employees. As of September 1998, none of the four HMOs had ob- tained NCQA accreditation. As provided in its con- tracts, the board is withholding a portion of premi- ums for the two older HMOs and has the two newer HMOs on a schedule to obtain accreditation.

In Iowa, the HMO accreditation requirement is be- ing implemented by state regulation. HMOs seeking approval to offer benefits to state employees must be accredited by NCQA or JCAHO for the benefit year beginning in January 2001 (Chapter 581, Section 15.1[3]). The requirement may be waived for up to two consecutive benefit years for an unaccredited HMO seeking approval to offer benefits to state em- ployees for the first time, if the HMO ”provides clear evidence of its intent to receive the required accredita- tion.” The original time frame for implementation of the accreditation requirement was 1999. However, in 1998 the Department of Personnel proposed a rule change delaying the date to 2001 to give HMOs more time to comply.

The Iowa Department of Personnel contracts with HMOs to serve state employees county by county. Two Blue Cross products, a fee-for-service plan and a preferred provider organization (PPO) plan, are of- fered statewide to state employees, but no HMOs are offered statewide. The department would like to see a statewide HMO product offered to state employees and is considering options for encouraging HMOs to serve additional rural counties, including the possibili- ty of combining its HMO bidding process with Medic- aid bidding in the future. The department recognizes that the HMO accreditation requirement may elimi- nate some HMOs from the state employees’ health in- surance program, and it plans to monitor the effect.

As of 1997, HMOs serving state employees in Ohio were required to be NCQA-accredited, with a status of full or one-year accreditation. There are no exceptions

for new HMOs. The Ohio Department of Administra- tive Services contracts with HMOs to serve state em- ployees county by county and has also adopted a poli- cy of limiting the number of HMOs with which the state contracts to five per county. A PPO option is of- fered in all counties, and about 40 percent of state em- ployees chose the PPO. A total of 19 HMO options are offered, with one to five HMO offerings per county. Three of the NCQA-accredited HMOs offered to state employees have large statewide networks, and most rural counties have two or more HMO offerings. Im- plementation of the accreditation requirement may have reduced the number of HMOs applying to serve state employees. However, the state does not view this as a problem, given the large number of accredited HMOs in Ohio and the five-HMOs-per-county limit it has imposed.

In Tennessee, state contracting procedures require HMOs serving state employees to be NCQA-accredited or become accredited within two years of contracting with the state; this policy began in 1995. At the mo- ment, the Division of Insurance Administration offers PPO, point-of-service (POS) and HMO plans to state employees. About 57 percent of state employees are enrolled in the PPO plan, 7 percent in the POS plan (it is in its first year) and 36 percent in HMOs. The division contracts with five HMOs, all of which are accredited or scheduled for an accreditation review.

Implications for HMOs Serving Rural Areas

External quality reviews conducted by an accredit- ing or review organization using state standards, such as those required by Kansas and Nevada, are compa- rable to HMO quality reviews conducted by state reg- ulators in some other states. In contrast, state regula- tions that require an HMO to apply for or receive ac- creditation from an approved accrediting organization are likely to necessitate a significantly greater commit- ment of resources from the HMO, especially if it is re- quired to achieve a certain level of accreditation. Con- sequently, this type of requirement has much greater potential impact on HMOs that have limited resources (e.g., new, small, regionally based HMOs and those that primarily or only serve Medicaid enrollees).

Clearly, an accreditation requirement will have a greater impact on HMOs that were not previously ac- credited and would not have applied for accreditation in the absence of such a requirement. Research has found that HMOs with large proportions of their ser-

The ]oumal of Rural Health 48 Vol. 17, No. 7

Page 10: State HMO Accreditation and External Quality Review Requirements: Implications for HMOs Serving Rural Areas

vice area populations in rural areas are significantly less likely to apply for NCQA accreditation than those with moderate rural proportions, controlling for sever- al HMO organizational and market area characteristics (Casey and Brasure, 1998). In addition to the rural proportion of an HMO’s service area population, sev- eral other HMO characteristics are significantly related to the probability of applying for NCQA accreditation. HMO size, affiliation, federal qualification and age, the HMO market penetration rate, and operating in a state with HMO accreditation requirements are positively related to the probability of applying for NCQA ac- creditation, while Medicaid enrollment as a proportion of an HMO’s total enrollment is negatively related (Casey and Brasure, 1998).

likely to apply for NCQA accreditation than older HMOs (Casey and Brasure, 1998). Most of the states with HMO accreditation or external review require- ments require HMOs to apply for accreditation or ob- tain an external review within two to three years from the date of initial licensure. The relatively short time frame for meeting those requirements compels new HMOs to seek accreditation sooner than they might have in the absence of such a requirement and may be an additional deterrent to the development of new HMOs in rural areas not previously served by HMOs. In late 1997, NCQA began offering a ”New Health Plan Accreditation” process on an accredited-not ac- credited basis for HMOs less than two years old. However, few HMOs have sought accreditation through this process; as of March 2000, 11 HMOs had New Health Plan Accreditation, one HMO had a deci- sion pending, and five had surveys scheduled (Nation- a l Committee for Quality Assurance, 2000).

HMOs serving rural areas that have chosen not to seek accreditation describe a variety of reasons for their decisions, including the cost of accreditation, the HMOs’ judgments that they lacked the necessary re- sources to devote to the accreditation process, uncer- tainty about their ability to meet NCQA standards (es- pecially among younger and smaller plans) and a lack of competitive pressures for accreditation in their mar- ket area (Casey & Klingner, 2000).

In the states with HMO accreditation or external re- view requirements, the number of approved accredit- ing or review organizations ranges from one to five. Restricting HMOs to one accrediting or review organi- zation may make it easier for state HMO regulators to develop and maintain expertise about that organiza- tion’s accreditation or review process. However, allow- ing HMOs to choose among multiple accrediting or

HMOs less than two years old are significantly less

review organizations permits HMOs with different characteristics (e.g., size, age, model type and propor- tion of rural enrollees) to select the accreditation or re- view process that they believe is best suited to their structure, resources and needs.

Accreditation requirements for HMOs that serve state employees have less critical implications for HMOs serving rural areas than accreditation and ex- ternal review requirements linked to licensure. In states that have an accreditation requirement for HMOs to serve state employees, unaccredited HMOs will not be able to bid on state employee contracts but may still operate as HMOs. It should also be noted that accreditation is not a guarantee of receiving a contract to serve state employees but is one of several factors that these states use to select health plans.

Although state employee HMO accreditation re- quirements are less important than accreditation and external quality review requirements linked to licen- sure, they do have significance for HMOs serving ru- ral areas. While many state employees live and work in urban population centers, a substantial number are employed in rural areas in correctional institutions, mental health facilities and regional offices of state agencies (e.g., departments of transportation and natu- ral resources), especially in predominantly rural states. Thus, state employees can be a desirable employer group for HMOs serving rural areas, because of both the size of the group and the possibility that having a state contract will encourage other rural employers to contract with the HMO. From a state’s perspective, of- fering a managed care option to rural state employees may be a way to demonstrate the feasibility of man- aged care in rural areas, in addition to reducing costs and expanding coverage for state employees (Chris- tianson and Hart, 1997).

Obviously, the potential impact of a state employee HMO accreditation requirement on HMOs serving ru- ral areas will vary depending on the content of the re- quirement and how it is implemented. It will also de- pend on the number of state employees in rural areas and the number of accredited HMOs that are serving rural areas. For example, an HMO may choose not to bid on the state employee contract rather than obtain accreditation. If that HMO is one of several serving rural state employees and the other HMOs are all ac- credited, enrollees in that HMO will have to change plans but will still be able to choose an HMO. The im- plications are very different if the HMO that chooses not to bid is the only HMO with a significant rural presence, and its absence will eliminate an HMO op- tion for rural state employees.

cflsty 49 Wintii 2001

Page 11: State HMO Accreditation and External Quality Review Requirements: Implications for HMOs Serving Rural Areas

Conclusion

Motivated by concern about the quality of care pro- vided to HMO enrollees, several states have incorpo- rated accreditation and external quality review re- quirements into their HMO licensure and state-em- ployee contracting processes. Because many HMO ac- creditation requirements are still in the early stages of implementation, there has been limited experience on which to assess their impact. As states gain more ex- perience implementing HMO accreditation and exter- nal quality-review requirements, it will be especially important to evaluate the rural impact of those re- quirements. Several states that have incorporated HMO accreditation or external quality-review require- ments into their HMO licensure processes have signifi- cant rural populations (e.g., Oklahoma, Pennsylvania, South Carolina and West Virginia). The states with state employee HMO accreditation requirements (Ala- bama, Iowa, Ohio and Tennessee) also have substan- tial rural populations. These states will provide oppor- tunities to evaluate the impact of these requirements on HMOs serving rural areas and on rural providers and consumers.

As purchasers of health care for state employees, states fulfill a role analogous to that of private sector employers. Their decisions to require accreditation of participating health plans may be viewed as similarly justifiable efforts to insure that they are purchasing high quality care for their employees. However, the adoption of mandatory accreditation requirements as a condition of HMO licensure has larger implications and raises several policy issues related to states’ roles as regulators of health care that will need to be addressed.

The decision to mandate accreditation of HMOs as a condition of state licensure represents a significant de- parture from the approach taken by states to hospital accreditation. In 44 states, JCAHO accreditation fulfills some or all state licensure requirements for hospitals; JCAHO-accredited hospitals also are deemed as meet- ing the federal conditions of participation for the Medicare and Medicaid programs (JCAHO, 2000). Some states have adopted regulatory provisions that allow accredited HMOs to be deemed in compliance with equivalent state regulations, thereby reducing po- tential duplication between the regulatory and accredi- tation processes. However, states do not require hospi- tals to be accredited, and only 58 percent of rural hos- pitals were JCAHO-accredited as of 1996, compared

with 95 percent of urban hospitals (Brasure, et al., in press).

cused on managed care, quality-of-care issues are re- ceiving increased attention in the fee-for-service and PPO sectors. For example, HCFA has been examining ways to implement performance measurement in Medicare fee-for-service (McCall, et al., 2000), and NCQA is drafting accreditation standards for PPOs (Benko, 2000). However, technical issues relating to quality measurement are even more difficult to deal with in the fee-for-service and PPO environments than in the HMO sector, suggesting that it may be some time before it will be feasible to adopt similar require- ments for HMOs and non-HMO health plans.

In the absence of similar requirements for other types of health plans, accreditation requirements for HMOs raise questions about the need for similar pro- tections for enrollees in other types of health plans, as well as equitable treatment of different types of health plans under state regulations. These issues may have particular relevance in rural health care markets that are primarily served by indemnity insurers and PPOs.

The impact of costs on HMOs’ accreditation deci- sions, especially for smaller and newer plans, needs further analysis. The total costs of implementing HMO accreditation requirements are difficult to quantify. Calculation of direct costs in terms of accreditation application fees, and staff time to prepare materials and participate in the accreditation survey process, are relatively straightforward. Beyond that, the difficulty lies in determining which costs are attributable to the accreditation process and which represent expendi- tures that an HMO should make on its quality assur- ance program whether it applies for accreditation or not. Both unaccredited HMOs serving rural areas and unaccredited rural hospitals cite costs as an important reason for not seeking accreditation (Brasure, et al., in press; Casey and Klingner, 2000), suggesting that poli- cy makers need to consider whether it is feasible to require all HMOs to seek accreditation regardless of their financial and organizational resources.

In considering whether states should mandate ac- creditation as a condition of HMO licensure, it is im- portant to remember that a lack of accreditation does not mean that an HMO is operating without any qual- ity oversight. In states that do not require accredita- tion, unaccredited HMOs are still subject to state reg- ulatory oversight through the HMO licensure process. Plans that serve Medicaid or Medicare enrollees are also subject to additional regulatory oversight from state Medicaid agencies and HCFA.

While much of the quality-of-care discussion has fo-

The Journal of Rural Health 50 Vol. 17, No. 1

Page 12: State HMO Accreditation and External Quality Review Requirements: Implications for HMOs Serving Rural Areas

The intent of this article is not to imply that states should have lower quality-of-care standards for HMOs serving rural areas than for those serving urban areas. Rather, its purpose is to recommend that policy mak- ers evaluate the potential effect of HMO accreditation requirements on the development of managed-care op- tions for rural populations and incorporate quality as- surance requirements in regulations governing other types of health plans as well.

Notes

The Accreditation Association for Ambulatory Health Care (AAAHC) accredits ambulatory health care organizations, in- cluding ambulatory clinics and surgery centers, single-specialty and multispecialty group practices, community health centers, urgent and intermediate care centers, HMOs and 1PAs. The AAAHC accreditation process involves an organizational self-as- sessment and an on-site survey, using core standards in the fol- lowing areas: rights of patients, governance, administration, quality of care, quality management and improvement, clinical records, professional improvement, and facilities and environ- ment (AAAHC, 1998a). As of September 1998, 12 HMOs were accredited by AAAHC (AAAHC, 1998b). The American Accreditation Healthcare Commission/Utilization Review Accreditation Commission (URAC) offers the following accreditation programs: credentials verification organization, health utilization management, health networks, health care practitioner credentialing, telephone triage and health informa- tion, workers’ compensation utilization management and work- ers‘ compensation networks. The accreditation process includes R detailed analysis of an applicant’s policies and procedures and on-si te verifications (URAC, 1998). URAC employs a ”modular” approach, which allows MCOs to seek accreditation only for the functions they perform and permits MCOs to achieve compre- hensive accreditation one function at a time. Its largest accredi- tation program is health utilization management. As of August 1998, 16 health plans had health network accreditation from URAC (URAC, 1998). ‘The Joint Commission on Accreditation of Healthcare Organiza- tions (JCAHO) began evaluating hospitals in 1951 and now pro- vides evaluation and accreditation services for hospitals, home care organizations, long-term care facilities, behavioral health care organizations, ambulatory care providers, clinical laborato- ries and health care networks (Joint Commission on Accredita- tion of Healthcare Organizations, 1998). HMOs and PPOs are accredited under JCAHOs health care network accreditation program, which began in 1994. The network standards largely address issues of network-wide integration, coordination and ac- countability not covered by the accreditation standards for indi- vidual network components accredited by JCAHO (e.g., hospi- tals and long term care facilities). Network components not ac- credited by JCAHO or another accrediting body recognized by JCAHO are surveyed as part of the network accreditation pro- cess. As of September 1998, 36 health care systems and man- aged care organizations were accredited by JCAHO (JCAHO, 1998). The National Committee for Quality Assurance (NCQA) began

accrediting MCOs in 1991. NCQA evaluates plan performance using accreditation standards in six categories: credentialing quality improvement; members’ rights and responsibilities; pre- ventive health services; utilization management; and medical re- cords. During an on-site accreditation survey, an NCQA team reviews an MCO’s quality-related systems and assesses the ex- tent to which the systems are in compliance with NCQA stan- dards. NCQA is also responsible for continued development of the Health Plan Employer Data and Information Set (HEDIS), a set of standardized performance measures designed to provide purchasers and consumers with information to compare MCOs’ performance. As of Aug. 31, 1998, 260 health plans were accred- ited by NCQA (NCQA, 1998).

References

Accreditation Association for Ambulatory Health Care. (1998). Who, what, why? Skokie, IL: AAAHC. Retrieved Sept. 4, 1998, from the world wide web: http:/ /www.aaahc.org/consumers/ faq.htm1

Accreditation Association for Ambulatory Health Care. (1998). Ac- credited Organizations in Sfate-Alpha Order as of September 2998. Skokie, I L AAAHC.

American Accreditation Health Care Commission/Utilization Re- view Accreditation Commission. (1998). States that rccogriize AAAHCIURAC accreditation. Washington, DC: URAC. Retrieved Sept. 4, 1998, from the world wide web. http://www.urac.org/ state-requirements.htm

American Accreditation Health Care Cornmission/Utilization Re- view Accreditation Commission. (1998). Accredited Companies as of August 1, 2998. Washington, DC: URAC. Retrieved Sept. 4, 1998, from the world wide web. http://www.urac.org

Benko, L. (2000). PPOs get turn under the microscope. Modern Healthcure, 30(23), 58.

Brasure, M, Stensland, J, & Wellever, A. (2000). Quality oversight: Why are rural hospitals less likely to be JCAHO accredited? Journal of Rural Health, 16(4), 324-336.

Casey, M. (1998). Serving rural Medicare risk enrollees: HMOs’ deci- sions, experiences, and future plans. Health Care Financing Rr- vim, 20(1), 73-81.

Casey, M, & Brasure, M. (1998). The NCQA accreditation process: Do HMOs serving rural areas apply for and obtain accreditatiorz? Rural Health Research Center, Working Paper Series #26. Minneapo- lis, MN: University of Minnesota, Division of Health Services Research and Policy.

Casey, M, & Klingner, J. (2000). HMOs serving rural areas: Experi- ences with HMO accreditation and HEDIS reporting. Managed Care Quarterly, 8(2), 48-59.

Christianson, JB, & Hart, JP. (1997). Importing employer-based man- aged care initiatives to rural areas: The experience of the South Dakota State Employees Group. journal of Rural Health, 13(2), 145-151.

Gray, B, & Rowe, C. (2000). Safety-net health plans: A status report. Health Afairs, 19(1), 185-193.

Health Care Financing Administration. (1997). Operational policy let- ter #59: Rqorting requirmentsfor Medicare health plans in 1998: Health Plan Employer Data Information Set (HEDIS 3.0/2998) and the Medicare Consumer Assessment of Health Plans Study (CAHPS). Baltimore, MD: HCFA. Retrieved Sept. 4, 1998, from the world wide web: http:/ /www.hcfa.gov/medicare/opl059.htm

G q 52 Winter 2001

Page 13: State HMO Accreditation and External Quality Review Requirements: Implications for HMOs Serving Rural Areas

Joint Commission on Accreditation of Healthcare Organizations. (1998). Facts about the Joint Commission on Accreditation of Health- care Organizations. Oakbrook Terrace, IL: JCAHO. Retrieved Sept. 9, 1998, from the world wide web. http://www.jcaho.org/ aboutjc/mlunissn.htm

Joint Commission on Accreditation of Healthcare Organizations. (2000). State legislative and regulatory activity. Oakbrook Terrace, IL: JCAHO. Retrieved June 19, 2000, from the world wide web. http:/ /www.jcaho.org/ trkepufrm.htm1

McCall, N, Pope, G, Griggs, M, Adamache, K, Dayhoff, D, Caswell, C, & Smith, K. (2000). Research and analytic support for implementing perjormance measurement in Medicare fee for service: Second annual re- port. Prepared for Health Care Financing Administration, January 6, 2000. http:/ /www.hcfa.gov/quality/docs/ffs2-cov.htm

Moscovice, 1, Casey, M, & Krein, S. (1998). Expanding rural man- aged care: Enrollment patterns and prospects. Health Aflairs, 17(1), 172-179.

National Committee for Quality Assurance. (1996). States' Roles in Monitoring Quality Evolving. NCQA Policy Watch. Washington, DC: NCQA. Retrieved Feb. 1, 1998, from the world wide web. http:/ /www.ncqa.org/govern/PWWINT96.HTM

National Committee for Quality Assurance. (1998). Managed care or-

ganization accreditation status list. August 31, 1998. Washington, DC: NCQA. Retrieved Oct. 1, 1998, from the world wide web: http:/ /www.ncqa.org/

National Committee for Quality Assurance. (2000). Nay plan accredi- tation status list. Washington, DC: NCQA. Retrieved June 19, 2000, from the world wide web: http://www.ncqa.org/pages/ policy /accreditation/newhealthplan/newplan.html

Noble, A, & Brennan, T. (1999). The stages of managed care regula- tion: Developing better rules. Journal of Health Politics, Policy, and h, 24(6), 1275-1305.

Partridge, L, & Torda, I? (1997). Performance measurement in Medicaid managed care: States' adoption of Medicaid HEDIS. Princeton, NJ: Center for Health Care Strategies.

Silberman, P, Slifkin, R, Popkin, 8, & Skatrud, J. (1997). TIE experi- e m and consequences of Medicaid managed care for rural popula- tions (North Carolina Rural Health Research Program, Working Paper #51J Chapel Hill, NC: Unizwsity of North Carolina, Sheps Center for Health Services Research.

U.S. Office of Personnel Management. (2000). Federal employees health ber- rfits program: Quality healthcare is important. Dec. 20, 2000. Washing- ton, Dc: OPM. Retrieved Jan. 17,2001, from the world wide web. http:/ /www.opm.gov/hr/insure/health/about.qual

"he Journal of Rural Health 52 Val. 17, No. 1