17th annual ashp conference for leaders in health …ashpadvantage.com/leaders2012/docs/proceedings...
TRANSCRIPT
17th Annual ASHP Conference
for Leaders in Health-System Pharmacy
Brian O’Neal, Pharm.D., M.S. Mark H. Siska, M.B.A./TM, B.S.Pharm. eHIT: Effectively Harnessing Information to Drive Change Activity Overview You’ve got the data, but do you use it? Learn how pharmacy leaders translate data from electronic health information technology (eHIT) into business intelligence and change in day-to-day activities to maximize the pharmacy staff’s impact on patient care. Learning Objectives After participating in this application-based educational activity, participants should be able to
• List strategic dashboards that pharmacy departments should be monitoring in real time. • Describe innovative approaches to business intelligence. • Develop an analytic and predictive analysis for the pharmacy business environment.
1
Leading the Pharmacy Enterprise:Advancing Practice with Transitions in Health CareLeading the Pharmacy Enterprise:
Advancing Practice with Transitions in Health Care
eHIT: Effectively Harnessing Information to Drive Change
Brian O’Neal, Pharm.D., M.S.
Assistant Director of Pharmacy
The University of Kansas Hospital
Kansas City, Kansas
Mark H. Siska, M.B.A./TM, B.S.Pharm.
Assistant Director Pharmacy Informatics and Technology Pharmacy Services
Mayo Clinic
Rochester, Minnesota
Outline
• Definitions and background
• Suggestions and infrastructure for effective analytics
• Analytics and predictive analysis in business– Small groups: Business case study
• Business intelligence in healthcare– Small groups: Dashboard development, part I
• Business intelligence in pharmacy– Small groups: Dashboard development, part II
• Innovative approaches to business intelligence
What is your understanding of business intelligence as it relates to health care?
1. I am a wizard at predictive analytics and data mining and I don’t get out of bed without creating a dashboard.
2. I know what “business intelligence” is, but don’t know as much as I probably should.
3. I have no idea what you are talking about.
2
Where are you with use of a data warehouse for pharmacy initiatives?
1. We routinely use a data warehouse for drug utilization efforts, population management, and/or pharmacy efficiency projects.
2. We have access to data, but don’t use it as effectively as we probably should.
3. We have a warehouse, but it is full of boxes (i.e., we don’t have the data we need).
Where are you with use of dashboards to monitor pharmacy performance?
1. We use multiple dashboards for everything from financial performance to medication safety.
2. We pull together data as needed, but don’t have dashboards that we routinely monitor.
3. The only dashboard I ever see is in my car.
Does your department analyze drug utilization data and report trends and/or external benchmarking data?
1. We have access to a database that we use to benchmark drug utilization against our peers.
2. We have access, but rarely use the database.
3. We don’t have the means for comparing our drug utilization to our peers.
3
eHIT: Effectively Harnessing Information to Drive Change
The Next Era of Healthcare IT
Business Intelligence
and Analytics
The Next Era of Healthcare IT
CQI/TQM
Patient Financial Systems
Clinical Systems
Process Integration
Workflow Transformation
Data Integration: Patient-Centric View
Clinical Decision Support – CPOE
Analytics ����
Continuous Improvement
19801990 20102000 2020
OperationalEfficiency
Efficacyof Care
PatientSafety
HIMSS. 2012 HIMSS Leadership Survey. http://www.himss.org/content/files/2012FINAL%20Leadership%20Survey%20with%20Cover.pdf2
Current State
4
HIMSS. 2012 HIMSS Leadership Survey. http://www.himss.org/content/files/201HIMSS. 2012 HIMSS Leadership Survey.
http://www.himss.org/content/files/2012FINAL%20Leadership%20Survey%20with%20Cover.pdf2 2FINAL%20Leadership%20Survey%20with%20Cover.pdf2 (accessed 2012 Oct 1).
Current State
Business Intelligence& Analytics Drivers
• Reporting / Transparency requirements
– CMS Core Measures
– Leapfrog
– Meaningful Use Measures
– Value-Based Purchasing
– Quality & Health Grades
Business Intelligence & Analytics
WATER, WATER EVERYWHERE…..
….BUT NOT A DROP TO DRINK
no shortage of data
but limited ability to
effectively use data for decision making
5
Business Intelligence & Analytics
“One can only separate necessary from unnecessary care by using reliable, relevant clinical data. With the inexhaustible mass of data available today, deciding which to collect and analyze will require judgment and experience”
James Lock, M.D.Chairman, Pediatric CardiologyChildren’s Hospital Boston
BI versus BA
Business Intelligence
• Answers the questions
– What happened?
– When?
– Who?
– How many?
• Includes
– Reporting (KPI’s, metrics)
– Automated monitoring/alerting thresholds
– Dashboards
– Scorecards
– Ad Hoc queries
Business Analytics
• Answers the questions
– Why did it happen?
– Will it happen again?
– What will happen if we change X?
– What else does the data tell us?
• Includes
– Statistical/Quantitative
analysis
– Data mining
– Predictive modeling
– Multivariate testing
Degree of Intelligence
COMPETITVE
ADVANTAGE
OptimizationPredictive ModelingForecastingStatistical analysis
AlertsQuery/Drill downAd Hoc ReportsStandard Reports
What's the best that can happen?What will happen next?What if these trends continue?Why is this happening?
What actions are needed?What exactly is the problem?How many, how often, where?What happened?
Analytics& Predictive
Modeling
Access &Reporting
Source: Competing on Analytics, Thomas Davenport & Jeanne G. Harris, Harvard Business School Press, 2007, p. 8.
Business Intelligence & Analytics
6
Population Health Management
• Management of “health outcomes” for a group of individuals, including the distribution of such outcomes within the group
• Factors affecting health outcomes include– Medical care
– Public health interventions
– Social environment (income, education, employment, social support, and culture)
– Physical environment (urban design, clean air and water),
– Genetics, and individual behavior
Population Health Management
• Addresses health needs at all points along the continuum of health and well being, through participation of, engagement with and targeted interventions for the population
• The goal is to maintain and/or improve the physical and psychosocial well being of individuals through cost-effective and tailored health solutions
• Automation makes population health management feasible, scalable and sustainable
Population Health Management
Population MonitoringMonitoring / Identification
Health AssessmentHealth Assessment
Risk Stratification
Care ContinuumCare Continuum
Health Management InterventionHealth Management Intervention
Low Risk Moderate Risk High Risk
Health PromotionWellness
Health Risk
Management
Care Coordination
DiseaseManagement
Community Resources
OrganizationInterventions
Cultural/EnvironmentalTailored Interventions
Person
Operational Measures
7
Analytic Challenges
Inconsistent Data Quality
Siloed Information Systems
Inefficient reporting
Inconsistent representation of data
Data lockedin disparate systems
Report generationis technically challenging
limiting adoption
Mark Siska
Marc Siska
Siska, Mark H.
ICU
Registration
Pharmacy
ADT CIS
RXBill
Keys to BI success
• Design - single source of truth
• Architecture - virtual data warehouse strategy
• Stewardship - Data quality oversight
• Governance - Standardization
• Education & Skills
Design & Architecture
8
Design & Architecture
EMR ADC
Pump
Packaging
Sterile
Comp
ICU
Oncology
SCM
RX
Radiology
Lab
Other
Virtual DataWarehouse & BI Tool
Clinical
Financial
Operational
Business Views
Design & Architecture
Stewardship & Governance
Data Data GovernanceGovernance
Data Standards
Data Quality
Data Architecture &
Data Management
Data Governance Support ServicesData Governance Support Services
Policies
9
Stewardship & Governance
• Model
• Element
• Types & Formats
• Business Rules
• Terminology
• Provenance
• Transport protocols
Data Standards
Types of Data Standards
Stewardship & Governance
• Defines relationships between important data
• Focuses on structure, not process
• Improved reporting analytics
• Promotes standardization
• Identifies information needed to operate the business
Business
Information
Model
Business Information Model
Stewardship & Governance
Business Information Model
10
Stewardship & Governance
• Accuracy
• Timeliness
• Reliability
• Completeness
• Relevance
• Understandability
• Conformance
Data Quality
Components of Data Quality
Stewardship & Governance
• Patient care compromised
• Safety risks increased
• Financial reporting
• Regulatory and compliance fines
• Increased legal costs
• Higher liability rates
Data Quality
Risks of poor data quality
Stewardship & Governance
• Dissimilar data definitions & formats
• Non-standard terminologies
• Source data cannot be accepted downstream
• Context differs between input & output for the same data element
• Repeatable human error perpetuated through multiple systems
Data Quality
Types of data quality issues
11
Stewardship & Governance
• Infrastructure for knowledge, metadata, & terminology management
• Architecture that supports data interchange
• Consistent use of maps to internal & external standards & reference data
Data Architecture &
Data Management
What do you think of when I say the word
“apple”
Is this your “Apple”
Metadata
Data
About
Data
Fundamentals of Metadata
Stewardship & Governance
Metadata
Data
About
Data
The answers to the ?’s
=metadata about your
Stewardship & Governance
Fundamentals of Metadata
12
Data Standards
Data Quality
Data Architecture
& Data Management
Stewardship & Governance
For each pillar, identify 3 examples of needs in your operational work area that can be resolved through better data standards, data quality & data architecture and systems
-------------------------
-------------------------
-------------------------
-------------------------
-------------------------
-------------------------
-------------------------
-------------------------
-------------------------
Upskilling the Analytics Team
# Item
1 Work Experience (Management, Enterprise insight, Leadership)
2 IT Interest and Acumen
3 Pharmacy Informatics Residency Program Graduate (≅ 12-15/year)
4 HIT Certifications (e.g., CPHIMS)
5 AMIA 10x10 course
6 Graduate Studies in Health Informatics
7 Health IT domain examinations (HIT PRO)
8 Computer Science coursework
9 Vendor-specific Credentials
Business Analytics Workshop
• The good news…
– As more human interactions move to digital platforms consumers will be more likely to leave behind a trail of data about what they are interested in….
• The bad news...
– Not all data sources will come from a single customer view controlled by your business.
• As a business owner how much and what data are you willing to pay for…
13
Business Analytics Workshop
• Drivers for data / information
–Predictiveness
–Newness
–Uniqueness
Business Analytics Workshop
Analytics Project• You currently own a bicycle shop business in your home town and
are concerned that the new shop across town may have an effect on your bottom line.
• Identify 20 sources of data that will help you identify potential customers or products that will grow your customer base and keep you competitive in this growing market.
• Determine data sources that would be of greater value in real time.
• Facilitators will aggregate data sources and assign costs.
• Small groups will then be given $5000 to create a data and
information budget based on available sources of data.
eHIT: Effectively Harnessing Information to Drive Change
Clinical Surveillance Systems
Detection and Monitoring of
High-Risk Patients
14
Careveillance
• 2009 approached by Computer Sciences Corporation (CSC, Inc.) to partner in development of a computer-based clinical decision support tool
• Goal: Improve the quality and safety of patient care at Univ of Kansas Hospital– Leverage the power of EMR documentation
– Continuous surveillance of patient information
– Real-time detection and management of high-risk patients
Careveillance
• Pattern-detecting algorithms applied to O2
• At-risk patients populate to a list continuously monitored by Surveillance and Triage Nurses– Review and validate clinical information
– If warranted, CARE ALERT notification to RN/MD
• Conditions to be monitored– Sepsis
– VTE Prophylaxis
– Core Measures
– Glycemic Control
– Readmissions
Sepsis Algorithm
15
Careveillance Sepsis Screen Shot: Potential List
Careveillance Sepsis Screen Shot: Patient Detail Screen
Careveillance Sepsis Screen Shot: Task List and Patient Status
16
eHIT: Effectively Harnessing Information to Drive Change
Drug Utilization Reporting
Use of a Clinical Benchmarking
Database to Drive Prescribing Change
UHC Clinical Database
• University Health-System Consortium
• 96 participating institutions submit charge data for inpatient and outpatient encounters
• Allows for resource use evaluation for drugs, imaging, lab, and blood products at focus institution and peer UHC institutions
• Many fields available for query
UHC Clinical Database
MS-DRG Physician Service Sex Individual Drug
ICD-9 Diagnosis Discharge Physician Race Drug Class
ICD-9 Procedure Procedure Physician Ethnicity Imaging
Core Measure Cases Length of Stay Age Accommodations
Severity of Illness ICU Days Payer Lab
Risk of Mortality Admission Source Med Record Number Blood Products
Hosp-Acq Conditions Discharge Status Encounter Number Materials Mgmt
• Fields for query
• Select fields to assess:– Patient outcomes (length of stay, mortality, readmissions)
– Cost (drug cost per case, total cost per case)
– Resource utilization (% of population, duration of use)
17
UHC Clinical Database
• Applications– Research
• Does alvimopan reduce length of stay?
• Does dexmedetomidine reduce days on a ventilator?
• Readmissions analysis
– Pharmacy & Therapeutics Committee• Support for drug use evaluations
• Market share calculations
– Drug Utilization and Financial Management• Identify variance in drug use versus top performers
• Payer mix and patient demographics
Treprostinil Utilization
Drug Utilization Improvement Initiative
• Historically we have provided high quality care while being a relatively poor performer in terms of drug cost per case
• Project involved use of UHC clinical database to identify areas where cost per case significantly exceeded UHC average, then reporting of variances in these areas to key prescribers
• Question: Can we lower our drug cost per case without negatively impacting quality?
18
Target Area Identification
• Calculate savings opportunity, or variance between drug cost per case and University Health-System Consortium (UHC) average, times annual cases
MS-DRG Hospital Cases
Resource
Total $
Cost per
Case
Annual
Variance
005 liver transplant w mcc Kansas 45 393,770 $ 8,750 $ 114,435
005 liver transplant w mcc Comparison 1,226 7,610,322 $ 6,207
Variance = (KUH cost per case – UHC avg cost per case) x KUH cases
Target Area Identification
• Don’t cut corners when selecting a patient group for analysis
• If unsure, run a case profile report and look at the diagnosis codes of patients within an MS-DRG
MS-DRG 009 Bone Marrow Transplant
ICD-9 41.04 Auto BMT with NHL
ICD-9 41.04 Auto BMT with HL
ICD-9 41.05 Allo BMT with AML
ICD-9 41.05 Allo BMT with MDS
ICD-9 41.04 Auto BMT with MM
Drug Utilization Improvement Initiative
• Run drug utilization reports for the selected MS-DRG to view line item-level detail
– Compare data to top performing peer group
• Factor VIIa use in liver transplant
Individual
Resource Hospital
% Cases
Receiving
Resource
Mean Days
Resource
Used/Case
Resource
Total $
Cost per
Case
Annual
Variancefactor viia Kansas 15.38 1.5 14,310 $ 367 $ 7,253
factor viia Comparison 8.04 1.6 103,509 $ 181
19
Select Compare Group
• Identify top performers for comparison
– Unless your cost per case is worst in peer group, no sense in comparing against peer group average
• 96 institutions in UHC database for comparison
• Four measures used by KUH to select top performing peer group:
Case volume Expected mortality/LOS
Mortality/LOS index Name recognition
Prepare Outcomes Data
• Include outcomes data in the drug utilization reports
• Goal is to identify and benchmark against similar organizations who have achieved outstanding outcomes with lesser use of high-cost drugs
Hospital Cases
LOS
Index
% Deaths
(Obs)
% Deaths
(Exp)
Mortality
Index
Cost per
Case
Kansas 39 1.38 2.56 5.58 0.46 $ 6,881
Comparison - Top 572 1.30 2.27 5.82 0.39 $ 6,995
Comparison - All 1,229 1.25 3.91 5.31 0.74 $ 6,232
Notice difference in mortality index
Index = Observed / Expected
Drug Utilization Reports
• Comparison of outcomes data
• Inpatient drug cost per case
• Comparison of our utilization of high-impact drugs to top performer average
PHARMACY AND THERAPEUTICS DRUG UTILIZATION SUBCOMMITTEE KIDNEY TRANSPLANT (LIVING-DONOR) DRUG UTILIZATION BENCHMARKING
SPRING 2011
GLOBAL MEASURES - MS-DRG 652 (KIDNEY TRANSPLANT; LIVING DONOR)
All information was obtained through the University Health-System Consortium (UHC) clinical database,
using a time period of January 1, 2010 through December 31, 2010. Compare group (i.e., UHC Top
Performers) consists of 17 institutions with similar (or higher) expected length of stay or mortality rates
and similar (or lower) length of stay or mortality indices. Length of stay and early death outliers have been
excluded.
Measure Univ of Kansas
Hospital
UHC Top
Performers
All UHC Database
Participants
Total cases during time period 21 783 1,919
Mean observed length of stay 5.4 days 5.3 days 5.5 days
Mean expected length of stay 5.4 days 5.6 days 5.5 days
Length of stay index (observed/expected) 1.01 0.95 0.99
Mean observed mortality 0.0 % 0.0 % 0.1 %
Percent with ICU stay 100.0 % 30.5 % 37.0 %
Mean ICU days 1.4 days 2.2 days 2.7 days
Inpatient drug cost per case $ 4,073 $ 5,815 $ 5,404
NOTE: The role that our drug utilization behaviors contribute to our greater outcomes must be considered
carefully.
High Impact Drug Utilization Comparison to UHC Top Performers – Jan 2010 through Dec 2010
20
• Utilization breakdown by drug class
• Example of how to interpret data
Drug Utilization Reports
MS-DRG 652 KIDNEY TRANSPLANT DRUG UTILIZATION EXTERNAL BENCHMARKING
Induction and Post-Transplant Immunosuppression
Drug Name/Class # of Cases
receiving
drug (KUH)
% Cases
(KUH)
% Cases
(UHC)
Mean
Duration
(KUH)
Mean
Duration
(UHC)
Typical Cost
per Day
Alemtuzumab 0 of 21 0.0 9.3 0.0 days 1.0 days $ 1,705
Anti-thymo (rabbit) 3 of 21 14.3 45.3 5.7 days 3.7 days $ 1,700
Basiliximab 21 of 21 100.0 27.8 1.9 days 1.7 days $ 1,650
Cyclosporine 6 of 21 28.6 7.4 4.0 days 5.4 days $ 60 (IV)
Immune globulin (IV) 1 of 21 4.8 16.0 3.0 days 3.8 days $ 2,920
Mycophenolate 21 of 21 100.0 95.8 6.3 days 5.8 days $ 20 (IV)
Tacrolimus 15 of 21 71.4 90.9 4.3 days 4.8 days $ 140 (IV)
Example of how to interpret data: KUH used cyclosporine in 6 of 21 cases (28.6%) during the selected time
period. This exceeds the utilization rate of the UHC compare group average (7.4%). The average duration of
cyclosporine use at KUH is 4.0 days of treatment versus 5.4 days for the compare group. Cyclosporine costs
roughly $ 60 per day of intravenous treatment.
Key variances that exceed top performer average: basiliximab, thymoglobulin (duration), cyclosporine
Key variances that are less than top performer average: thymoglobulin, ivig, tacrolimus
Anti-Bacterials and Anti-Fungals
Drug Name/Class # of Cases
receiving
drug (KUH)
% Cases
(KUH)
% Cases
(UHC)
Mean
Duration
(KUH)
Mean
Duration
(UHC)
Typical Cost
per Day
Aminoglycosides 0 of 21 0.0 22.2 0.0 days 1.0 days $ 2
Cephalexin 11 of 21 52.4 0.8 3.6 days 1.7 days $ 1
Fluconazole 0 of 21 0.0 21.7 0.0 days 3.5 days $ 2 (PO)
Fluoroquinolones 10 of 21 47.6 14.6 5.1 days 2.3 days $ 6 (PO)
Vancomycin 0 of 21 0.0 7.9 0.0 days 1.9 days $ 12
Key variances that exceed top performer average: fluoroquinolones (utilization and duration)
Key variances that are less than top performer average: none
Anti-Virals
Drug Name/Class # of Cases
receiving
drug (KUH)
% Cases
(KUH)
% Cases
(UHC)
Mean
Duration
(KUH)
Mean
Duration
(UHC)
Typical Cost
per Day
Acyclovir 9 of 21 42.9 21.1 3.0 days 3.4 days $ 1
Ganciclovir 0 of 21 0.0 17.4 0.0 days 2.8 days $ 34
Valganciclovir 1 of 21 4.8 77.3 1.0 days 3.6 days $ 80
Key variances that exceed top performer average: none
Key variances that are less than top performer average: ganciclovir, valganciclovir
Drug Utilization Reports
• Historical trends versus top performers
• Compare group listed at end of report
Use of Thymoglobulin by calendar year – KUH versus UHC Compare Group
Thymoglobulin % utilization by institution – includes all top performing institutions
Nicardipine % utilization by institution – includes all top performing institutions
Report Distribution
• Reports are distributed via hard copy and electronically to all attending physicians involved in care of patients for selected MS-DRG
• Cover letter describing drug utilization improvement initiative accompanies each report– Focus on variance in utilization
– Prompt prescribers to question whether this variance is positively impacting outcomes
• Email summarizes key findings and progress
• Direct response to reports has varied, but indirect results have exceeded expectations
21
Opportunity Knocks
• Reports do not always produce results on their own, but they may open the door for discussion
– Albumin utilization pilot in critical care areas
– Meet with BMT physicians to discuss transition from melphalan to cyclophosphamide
– Collaboration with liver transplant to develop induction protocol
– Factor VIIa protocol re-design and increased awareness
Summary of Results
• 18 reporting areas
• Comparing drug utilization to top performers
• Annualized savings of over $900,000
• Weighted average reduction of 12.2% in length of stay
– 1.1% decrease across non-reporting areas
• No detrimental impact on mortality
– Significant reduction in mortality index in severe sepsis w/ mechanical ventilation
Physician-Specific Reporting
• Pitfalls
– Do you really know who was responsible for prescribing a given drug?
– Drilling down to physician level may reduce patient volumes to the point of insignificance
• Potential value
– Drug use tied to a particular procedure
– Example: Peri-operative Factor VIIa use in cardiothoracic surgery
22
What about me?
• Consider reporting your own internal utilization and cost trends, even in the absence of external benchmarking data
• UHC may consider data from non-UHC institutions
• Encourage your group purchasing organization or hospital system to develop similar external benchmarking tools
Benchmarking Lessons Learned
• Beware of the DRG– Even MS-DRGs often require further drill down to the
ICD-9 diagnosis/procedure level
• Avoid physician-specific reporting– Tyranny of small numbers
• Do not cut corners when selecting a compare group– No sense in comparing against those with inferior
clinical outcomes
• Focus on variance in utilization and avoid emphasis on cost
Key Points
• Find out where your dollars are going
• If you cannot benchmark externally, find out what your physicians would like to see and find a way to report it
• If you can benchmark, prompt your physicians to question whether drug-related variances are positively impacting outcomes
• Let competitive people know how they match up against the best and many of them will change their behaviors
23
eHIT: Effectively Harnessing Information to Drive Change
Pharmacy Workflow Scorecards
Patient Prioritization and
Productivity Management
Pharmacy Workflow Scorecards
• IT system-generated scorecard in use at multiple institutions
• University of Kansas Hospital patterned scorecard after one in use by Exempla Healthcare of Colorado
• Aim was to develop a workflow prioritization tool to support practice model change
Pharmacy Workflow Scorecards
• Scorecard allows pharmacists to view their assigned patients and any changes in clinical status that warrant review or intervention
• Clinical metrics that populate dashboard include drug levels, an IV-to-PO indicator, creatinine score, and presence of high-alert and/or monitor-able drugs
24
Pharmacy Workflow Scorecards
• Workflow indicators include status of VTE prophylaxis and immunizations along with indicators for completeness of admission history and medication reconciliation activities
• Metrics roll up into a total score that allows for quick prioritization of assigned patients
• Pharmacists can also see a calculation of how the score has changed since the last profile review
25
Design & Architecture
Design & Architecture
EMR ADC
Pump
Packaging
Sterile
Comp
ICU
Oncology
SCM
RX
Radiology
Lab
Other
Virtual Data
Warehouse & BI Tool
Clinical
Financial
Operational
Business Views
26
Careveillance Sepsis Screen Shot: Potential List
Careveillance Sepsis Screen Shot: Patient Detail Screen
28
17th Annual ASHP Conference
for Leaders in Health-System Pharmacy
S U G G E S T E D R E A D I N G S
1. ASHP Section of Pharmacy Informatics and Technology Executive Committee,
2008-09. Technology-enabled practice: A vision statement by the ASHP Section of
Pharmacy Informatics and Technology. Am J Health Syst Pharm. 2009; 66:1573-7.
2. Bahl V, McCreadie SR, Stevenson JG. Developing dashboards to measure and
manage inpatient pharmacy costs. Am J Health Syst Pharm. 64:1859-66.
3. Granko RP, Poppe LB, Savage SW et al. Method to determine allocation of clinical pharmacist resources. Am J Health Syst Pharm. 2012; 69:1398-404.
4. Jenkins A, Eckel SF. Analyzing methods for improved management of workflow in an outpatient pharmacy setting. Am J Health Syst Pharm. 2012; 69:966-71.
5. Krogh P, Ernster J, Knoer S. Creating pharmacy staffing-to-demand models: Predictive tools used at two institutions. Am J Health Syst Pharm. 2012; 69:1574-80.
6. Nowak MA, Nelson RE, Breidenbach JL et al. Clinical and economic outcomes of a prospective antimicrobial stewardship program. Am J Health Syst Pharm. 2012; 69:1500-08.
7. Pawloski P, Cusick D, Amborn L. Development of clinical pharmacy productivity metrics. Am J Health Syst Pharm. 2012; 69:49-54.
8. Pickette SG, Muncey L, Wham D. Implementation of a standard pharmacy clinical practice model in a multihospital system. Am J Health Syst Pharm. 2010; 67:751-6.
9. Rough SS, McDaniel M, Rinehart JR. Effective use of workload and productivity monitoring tools in health-system pharmacy, part 2. Am J Health Syst Pharm. 2010; 67:380-8.
10. Rough SS, McDaniel M, Rinehart JR. Effective use of workload and productivity monitoring tools in health-system pharmacy, part 1. Am J Health Syst Pharm. 2010; 67:300-11.
11. Schumock GT, Shields KL, Walton SM, Barnum DT. Data envelopment analysis: A method for comparing hospital pharmacy productivity. Am J Health Syst Pharm. 2009; 66:1660-5.
12. Siska MH, Tribble DA. Advancing the Application of Information Technology in the Medication-Use Process: Opportunities and challenges related to technology in supporting optimal pharmacy practice models in hospitals and health systems. Am J Health Syst Pharm. 2011; 68:1116-26.
13. Waitman LR, Phillips IE, McCoy AB et al. Adopting real-time surveillance dashboards as a component of an enterprisewide medication safety strategy. Jt Comm J Qual Patient Saf. 2011: 37:326-32.
29