researching and selecting ebips workbook k-12 tools gt

14
Gt © Hanover Research, 2021 1 RESEARCHING AND SELECTING EBIPS WORKBOOK Prepared for Virginia Department of Education (VDOE) K-12 Tools OVERVIEW This Researching and Selecting EBIPs Workbook is designed to supplement the content of the Researching and Selecting EBIPs info-brief. Specifically, the workbook contains three separate tools to support division and school leaders in Virginia in identifying and conducting research into evidence-based interventions and practices (EBIPs) that may potentially address the needs and priorities determined via the comprehensive needs assessment (CNA) process. These tools will also inform selection of relevant EBIPs that best match established needs and that are most feasible for a given division or school to implement. The directions for using each tool and a corresponding hyperlink are presented below. TABLE OF CONTENTS EBIP Evidence Review Worksheet pages 2-4 ( accessible here ) Directions: Use this worksheet to examine the evidence base for each of the evidence-based interventions and practices (EBIPs) under consideration. In each row, address the prompt or question presented as it relates to each empirical study of the EBIP. In seeking out this information, you may consult resources such as the What Works Clearinghouse (WWC), Evidence for ESSA, the National Center on Intensive Interventions, and other databases that rate and/or evaluate EBIPs or which provide access to the specific studies themselves. EBIP Hexagon Analysis Protocol – pages 5-9 ( accessible here ) Directions: Use this protocol to guide your research investigations and decision-making around the selection of specific evidence-based interventions and practices (EBIPs) that may address one or more needs identified by your division’s or school’s most recent comprehensive needs assessment (CNA). The protocol presents guiding questions based the six factors below that should be addressed via research and considered the during EBIP selection process. EBIP Discussion Guide – pages 10-14 ( accessible here ) Directions: Use the presented discussion questions—and their related probes—to lead conversations among division and/or school leaders and collaborating stakeholders related to past, current, and future intended application of evidence-based interventions and practices (EBIPs). By exploring these questions, divisions and schools can determine the degree to which they have already implemented EBIPs and inform planning for future implementation of new EBIPs. 1 2 3

Upload: others

Post on 05-Dec-2021

1 views

Category:

Documents


0 download

TRANSCRIPT

G t

© H a n o v e r R e s e a r c h , 2 0 2 1 1

RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )

K-12 Tools

O VER VI EW T h is R es e ar c h i ng an d S e l ec t in g E B I Ps Wo r kb oo k is de s ig ne d t o s up ple me n t the c on te n t o f t he R e s e ar c h ing a n d S el ec t in g E B IP s i nf o - b rie f . S pe ci f ica l ly , t he w o rk bo ok co n ta ins th re e s e p a ra te t ools to s u p po r t d iv is ion a n d s ch ool le a de rs i n V i r gin ia i n i de n ti fy i ng a n d c on du c tin g re s e a rc h in t o e v i de n ce - ba s e d i nte rv e nt ions a n d p ra ct i ce s ( EB I Ps ) tha t m a y p o te n ti a l ly a d d re s s the ne e ds a nd p r io ri t ie s d e te rmi ne d v ia t he com p re he ns iv e ne e ds a s s e s s me n t ( C NA ) p ro ce s s . T he s e to ols w il l a ls o i nf o rm s e le c t ion of re le v a n t E B IPs th a t b e s t ma t ch e s ta bl is he d ne e ds a n d tha t a re m os t fe a s i ble f or a g iv e n d iv is i on o r s cho ol to i mp le me nt . T he d i re c t io ns f or us in g e a ch tool a nd a co r re s pon di n g hy pe rl i nk a r e p re s e n te d be low .

TA B L E O F C O NTENTS

EBIP Evidence Review Worksheet – pa ge s 2 -4 ( a c c e s s ib l e h e re )

Di re c tio ns : Us e th is wo rk s he e t to e x a mi ne t he e v i de nce ba s e fo r e a ch o f the e v i de nce -b a s e d i nte rv e nt ions a n d p ra ct i ce s (E B IPs ) u n de r c ons ide ra t ion. I n e a ch r ow , a d dre s s t he p ro m pt o r q ue s ti on pr e s e n te d a s it re la te s t o e a c h e m pi r ica l s tu dy o f the E B I P . In s e e k i ng ou t t h is i nf o rma ti on , y ou ma y cons ul t r e s ou r ce s s u ch a s t he Wha t Wo r k s Cle a r in gh ous e (W W C) , Ev i de nce fo r ES S A , t he Na ti ona l C e n te r on In te ns iv e Int e rv e n tio ns , a n d ot he r da ta ba s e s t ha t r a te a n d /o r e v a l ua te EB I Ps o r wh ic h p rov i de a cce s s to the s pe c if ic s tu die s the ms e lv e s .

EBIP Hexagon Analysis Protocol – pa ge s 5 -9 ( ac c es si b l e h e r e )

Di re c tio ns : Us e t his p r o toc ol to gui de y ou r re s e a rch i nv e s t i ga t io ns a n d d e c is io n - ma k i n g a ro un d the s e le c tio n of s pe c i f ic e v i de n ce - ba s e d in te rv e n ti ons a n d p r a c ti ce s (E B IPs ) t ha t ma y a d d re s s o ne o r m o re ne e ds ide n tif ie d by y our div is io n ’s o r s ch ool ’s m os t re ce nt co mp re he ns iv e ne e ds a s s e s s me n t ( C NA ) . T he p r ot o col p re s e n ts gu id in g q ue s ti ons ba s e d the s ix f a c to rs be l ow t ha t s h oul d b e a d d re s s e d v ia re s e a rc h a n d c ons ide re d the du rin g EBI P s e le c tion p roce s s .

EBIP Discussion Guide – pa ge s 1 0-1 4 ( ac c e s s ib l e h e re )

Di re c tio ns : Us e t he p re s e n te d d is cus s i on q ue s ti ons — a n d the ir r e la te d p r o be s — to le a d c onv e rs a tio ns a mo ng d iv is ion a nd / o r s ch ool le a de rs a nd co l la bo ra t in g s ta k e ho lde rs re la t e d to p a s t , cu r re n t , a n d f utu re in te n de d a p pli ca ti on o f e v i de n ce - ba s e d in te rv e n tio ns a nd pra ct ice s ( E BI Ps ) . By e xp lo rin g the s e que s tio ns , d iv is i ons a nd s choo ls ca n de te rm ine the d e gre e to wh ich t he y ha v e a l re a dy i mp le me n t e d E B IPs a nd in fo r m p la nn in g f o r f utu re i mp le me n ta ti on o f ne w E B IPs .

1

2

3

G t

© H a n o v e r R e s e a r c h , 2 0 2 1 2

RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )

K-12 Tools

Di re c tio ns : Us e t his wo rk s he e t t o e xa m ine the e v i de nce b a s e fo r e a c h o f the e v i de n ce - ba s e d i nte rv e nt io ns a n d pr a c ti ce s ( EB I Ps ) u nde r c ons i de ra ti on . In e a ch r ow, a dd re s s the pr om p t o r que s tio n p re s e n te d a s i t r e la te s to e a ch e m pi ri ca l s tu dy o f the EB I P. I n s e e k ing ou t t his in fo r ma tio n, y ou ma y co ns ul t re s ou r ce s s u ch a s t he Wh a t Wo rk s Cle a rin gh ous e (W W C) , Ev id e n ce fo r ES S A , the N a tio na l Ce n te r on In te ns ive I n te rv e n ti ons , a n d o the r da ta ba s e s tha t ra te a n d /o r e v a lua te EB I Ps o r w hi ch prov ide a c ce s s to the s pe c i f ic s tu die s the ms e lv e s .

# Q u e s t i o n / P r o m p t S t u d y 1 S t u d y 2 S t u d y 3

1 . L i s t t h e s o u r c e o f t h e e v i d e n c e r e v i e w ( e . g . , W W C ) o r t h e a u t h o r ( s ) a n d y e a r o f t h e s t u d y

R e c o r d r e s p o n s e h e r e .

R e c o r d r e s p o n s e h e r e .

R e c o r d r e s p o n s e h e r e .

2 a . W a s t h i s s t u d y a w e l l - d e s i g n e d a n d i m p l e m e n t e d r a n d o m i z e d c o n t r o l l e d t r i a l ( R C T ) , a s d e f i n e d b y E S S A ?

• I f a n s w e r i n g “ Y e s , ” p r o c e e d t o q u e s t i o n 2 b .

• I f a n s w e r i n g “ N o ” o r “ N o t e n o u g h i n f o r m a t i o n , ” p r o c e e d t o q u e s t i o n 3 a .

Y e s

N o

N o t e n o u g h i n f o r m a t i o n

Y e s

N o

N o t e n o u g h i n f o r m a t i o n

Y e s

N o

N o t e n o u g h i n f o r m a t i o n

2 b . F o r t h i s R C T , i s t h e r e a s t a t i s t i c a l l y s i g n i f i c a n t f a v o r a b l e e f f e c t o f t h e E B I P o n r e l e v a n t o u t c o m e s ?

Y e s

N o

Y e s

N o

Y e s

N o

2 c . F o r t h i s R C T , i s t h e r e a s t a t i s t i c a l l y s i g n i f i c a n t a n d o v e r r i d i n g u n f a v o r a b l e e f f e c t o f t h e E B I P o n r e l e v a n t o u t c o m e s ?

Y e s

N o

Y e s

N o

Y e s

N o

2 d . D o e s t h i s R C T p r o v i d e s t r o n g e v i d e n c e t o s u p p o r t i m p l e m e n t a t i o n o f t h e E B I P ?

• I f y o u a n s w e r e d “ Y e s ” f o r 2 b a n d “ N o ” f o r 2 c , a n s w e r “ Y e s ” t o t h i s i t e m a n d p r o c e e d t o q u e s t i o n 6 .

• I f y o u a n s w e r e d “ N o ” f o r 2 b a n d “ Y e s ” f o r 2 c , a n s w e r “ N o ” t o t h i s i t e m a n d p r o c e e d t o q u e s t i o n 3 a .

Y e s

N o

Y e s

N o

Y e s

N o

3 a . W a s t h i s s t u d y a w e l l - d e s i g n e d a n d i m p l e m e n t e d q u a s i - e x p e r i m e n t a l d e s i g n ( Q E D ) , a s d e f i n e d b y E S S A ?

• I f a n s w e r i n g “ Y e s , ” p r o c e e d t o q u e s t i o n 3 b .

• I f a n s w e r i n g “ N o ” o r “ N o t e n o u g h i n f o r m a t i o n , ” p r o c e e d t o q u e s t i o n 4 a .

Y e s

N o

N o t e n o u g h i n f o r m a t i o n

Y e s

N o

N o t e n o u g h i n f o r m a t i o n

Y e s

N o

N o t e n o u g h i n f o r m a t i o n

3 b . F o r t h i s Q E D , i s t h e r e a s t a t i s t i c a l l y s i g n i f i c a n t f a v o r a b l e i m p a c t o f t h e E B I P o n r e l e v a n t o u t c o m e s ?

Y e s

N o

Y e s

N o

Y e s

N o

E B I P E v i d e n c e R e v i e w Wo r k s h e e t

G t

© H a n o v e r R e s e a r c h , 2 0 2 1 3

RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )

K-12 Tools

# Q u e s t i o n / P r o m p t S t u d y 1 S t u d y 2 S t u d y 3

3 c . F o r t h i s Q E D , i s t h e r e a s t a t i s t i c a l l y s i g n i f i c a n t a n d o v e r r i d i n g u n f a v o r a b l e i m p a c t o f t h e E B I P o n t h e r e l e v a n t o u t c o m e s ?

Y e s

N o

Y e s

N o

Y e s

N o

3 d . D o e s t h i s Q E D p r o v i d e m o d e r a t e e v i d e n c e t o s u p p o r t i m p l e m e n t a t i o n o f t h e E B I P ?

• I f y o u a n s w e r e d “ Y e s ” f o r 3 b a n d “ N o ” f o r 3 c , a n s w e r “ Y e s ” t o t h i s i t e m a n d p r o c e e d t o q u e s t i o n 6 .

• I f y o u a n s w e r e d “ N o ” f o r 3 b a n d “ Y e s ” f o r 3 c , a n s w e r “ N o ” t o t h i s i t e m a n d p r o c e e d t o q u e s t i o n 4 a .

Y e s

N o

Y e s

N o

Y e s

N o

4 a . W a s t h i s s t u d y a w e l l - d e s i g n e d a n d i m p l e m e n t e d c o r r e l a t i o n a l s t u d y , a s d e f i n e d b y E S S A ?

• I f a n s w e r i n g “ Y e s , ” p r o c e e d t o q u e s t i o n 4 b .

• I f a n s w e r i n g “ N o ” o r “ N o t e n o u g h i n f o r m a t i o n , ” p r o c e e d t o q u e s t i o n 5 .

Y e s

N o

N o t e n o u g h i n f o r m a t i o n

Y e s

N o

N o t e n o u g h i n f o r m a t i o n

Y e s

N o

N o t e n o u g h i n f o r m a t i o n

4 b . F o r t h i s c o r r e l a t i o n a l s t u d y , i s t h e r e a s t a t i s t i c a l l y s i g n i f i c a n t f a v o r a b l e i m p a c t o f t h e E B I P o n t h e r e l e v a n t o u t c o m e ( s ) ?

Y e s

N o

Y e s

N o

Y e s

N o

4 c . F o r t h i s c o r r e l a t i o n a l s t u d y , i s t h e r e a s t a t i s t i c a l l y s i g n i f i c a n t a n d o v e r r i d i n g u n f a v o r a b l e i m p a c t o f t h e E B I P o n t h e r e l e v a n t o u t c o m e ( s ) ?

Y e s

N o

Y e s

N o

Y e s

N o

4 d . D o e s t h i s c o r r e l a t i o n a l s t u d y p r o v i d e p r o m i s i n g e v i d e n c e t o s u p p o r t i m p l e m e n t a t i o n o f t h e E B I P ?

• I f y o u a n s w e r e d “ Y e s ” f o r 4 b a n d “ N o ” f o r 4 c , a n s w e r “ Y e s ” t o t h i s i t e m a n d p r o c e e d t o q u e s t i o n 6 .

• I f y o u a n s w e r e d “ N o ” f o r 4 b a n d “ Y e s ” f o r 4 c , a n s w e r “ N o ” t o t h i s i t e m a n d p r o c e e d t o q u e s t i o n 5 .

Y e s

N o

Y e s

N o

Y e s

N o

5 . D o e s t h i s s t u d y d e m o n s t r a t e a r a t i o n a l e f o r u s i n g t h e E B I P ? I n o t h e r w o r d s , d o e s t h i s s t u d y s u g g e s t t h a t t h e E B I P i s l i k e l y t o i m p r o v e a r e l e v a n t o u t c o m e ?

Y e s

N o

N o t e n o u g h i n f o r m a t i o n

Y e s

N o

N o t e n o u g h i n f o r m a t i o n

Y e s

N o

N o t e n o u g h i n f o r m a t i o n

6 . E x a m i n i n g t h e i n f o r m a t i o n f o r q u e s t i o n s 2 d , 3 d , 4 d , a n d 5 , w h a t i s t h e h i g h e s t l e v e l o f e v i d e n c e p r o v i d e d b y e a c h s t u d y f o r t h e E B I P ?

S t r o n g e v i d e n c e

M o d e r a t e e v i d e n c e

P r o m i s i n g e v i d e n c e

D e m o n s t r a t e s a r a t i o n a l e

S t r o n g e v i d e n c e

M o d e r a t e e v i d e n c e

P r o m i s i n g e v i d e n c e

D e m o n s t r a t e s a r a t i o n a l e

S t r o n g e v i d e n c e

M o d e r a t e e v i d e n c e

P r o m i s i n g e v i d e n c e

D e m o n s t r a t e s a r a t i o n a l e

G t

© H a n o v e r R e s e a r c h , 2 0 2 1 4

RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )

K-12 Tools

# Q u e s t i o n / P r o m p t S t u d y 1 S t u d y 2 S t u d y 3

7 . I n e a c h s t u d y , w a s t h e E B I P i m p l e m e n t e d i n a s e t t i n g s i m i l a r t o y o u r d i v i s i o n o r s c h o o l ( e . g . , r u r a l , u r b a n , g r a d e s p a n ) ?

V e r y m u c h

S o m e w h a t

A l i t t l e

N o t a t a l l

V e r y m u c h

S o m e w h a t

A l i t t l e

N o t a t a l l

V e r y m u c h

S o m e w h a t

A l i t t l e

N o t a t a l l

8 . I n e a c h s t u d y , w a s t h e E B I P i m p l e m e n t e d w i t h p o p u l a t i o n s s i m i l a r t o y o u r d i v i s i o n o r s c h o o l ( e . g . , r a c i a l / e t h n i c d e m o g r a p h i c s , s p e c i a l i z e d p r o g r a m e n r o l l m e n t ) ?

V e r y m u c h

S o m e w h a t

A l i t t l e

N o t a t a l l

V e r y m u c h

S o m e w h a t

A l i t t l e

N o t a t a l l

V e r y m u c h

S o m e w h a t

A l i t t l e

N o t a t a l l

9 . L o o k i n g a c r o s s t h e i n f o r m a t i o n f o r q u e s t i o n 6 o n l y , w h i c h o f t h e f o l l o w i n g d e s i g n a t i o n s b e s t d e s c r i b e s t h e c u m u l a t i v e e v i d e n c e f o r t h i s E B I P ?

S t r o n g e v i d e n c e

M o d e r a t e e v i d e n c e

P r o m i s i n g e v i d e n c e

D e m o n s t r a t e s a r a t i o n a l e

S t r o n g e v i d e n c e

M o d e r a t e e v i d e n c e

P r o m i s i n g e v i d e n c e

D e m o n s t r a t e s a r a t i o n a l e

S t r o n g e v i d e n c e

M o d e r a t e e v i d e n c e

P r o m i s i n g e v i d e n c e

D e m o n s t r a t e s a r a t i o n a l e

1 0 . L o o k i n g a c r o s s i n f o r m a t i o n f o r q u e s t i o n s 6 , 7 , a n d 8 , w h i c h o f t h e f o l l o w i n g d e s i g n a t i o n s b e s t d e s c r i b e s t h e c u m u l a t i v e e v i d e n c e f o r t h i s E B I P , s p e c i f i c a l l y f o r t h e s e t t i n g s a n d p o p u l a t i o n s t h a t a r e s i m i l a r t o y o u r d i v i s i o n o r s c h o o l ?

S t r o n g e v i d e n c e

M o d e r a t e e v i d e n c e

P r o m i s i n g e v i d e n c e

D e m o n s t r a t e s a r a t i o n a l e

S t r o n g e v i d e n c e

M o d e r a t e e v i d e n c e

P r o m i s i n g e v i d e n c e

D e m o n s t r a t e s a r a t i o n a l e

S t r o n g e v i d e n c e

M o d e r a t e e v i d e n c e

P r o m i s i n g e v i d e n c e

D e m o n s t r a t e s a r a t i o n a l e

E B I P E v i d e n c e R e v i e w W o r k s h e e t c o n t e n t s t a k e n v e r b a t i m , w i t h m i n o r a d a p t a t i o n s , f r o m : H a l e , S . , L . D u n n , N . F i l b y , J . R i c e , a n d L . V a n

H o u t e n . “ E v i d e n c e - B a s e d I m p r o v e m e n t : A G u i d e f o r S t a t e s t o S t r e n g t h e n T h e i r F r a m e w o r k s a n d S u p p o r t s A l i g n e d t o t h e E v i d e n c e R e q u i r e m e n t s o f E S S A . ” R e g i o n a l E d u c a t i o n a l L a b o r a t o r y W e s t , W e s t E d , 2 0 1 7 . p p . 6 1 - 7 3 h t t p s : / / w w w . w e s t e d . o r g / w p -c o n t e n t / u p l o a d s / 2 0 1 6 / 1 2 / E v i d e n c e - B a s e d - I m p r o v e m e n t - G u i d e - F I N A L - 1 2 2 1 1 6 . p d f

G t

© H a n o v e r R e s e a r c h , 2 0 2 1 5

RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )

K-12 Tools

Di re c tio ns : U s e this p r o toc ol to g ui de y ou r re s e a r ch inv e s ti ga t io ns a nd d e c is io n - ma k i n g a ro un d t he s e le c tio n of s pe c i f ic e v i de n ce - ba s e d in te rv e n ti ons a n d p r a c ti ce s (E B IPs ) t ha t ma y a d d re s s one o r m o re ne e ds i de nt i f ie d by y ou r d iv is i on ’s o r s cho ol ’s mos t re ce n t co m pre he ns iv e ne e d s a s s e s s me n t ( C NA ) . T he p r o toc ol p re s e n ts g ui di ng q ue s tions b a s e d the s i x fa c to rs be low tha t s ho ul d b e a d d re s s e d v i a re s e a rc h a n d cons ide re d t he d ur in g EB IP s e le c tio n p ro ce s s .

- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- -

RELEVANCE B a s e d on ou r mos t re ce n t C NA , wha t a re the m os t p re s s i ng ne e ds fa ce d by o ur d iv is ion or s c hoo l? W ha t d a ta do we ha v e to s upp o r t t he e xis te n ce o f the s e ne e ds ?

R e c o r d r e s p o n s e h e r e .

E B I P H e x a g o n A n a l y s i s P r o t o c o l

F i t R e s o u r c e s

C a p a c i t y E v i d e n c e

R e l e v a n c e

R e p l i c a b i l i t y

R e l e v a n c e r e p r e s e n t s h o w w e l l t h e E B I P m e e t s t h e i d e n t i f i e d n e e d s o f t h e t a r g e t s t u d e n t p o p u l a t i o n .

R e s o u r c e s r e f e r s t o t h e a b i l i t y t o p r o v i d e a d e q u a t e t r a i n i n g , s t a f f i n g , t e c h n o l o g y , m a t e r i a l s , a n d f u n d i n g t o i m p l e m e n t a n E B I P w i t h f i d e l i t y .

F i t r e f e r s t o h o w w e l l t h e E B I P c o r r e s p o n d s w i t h t h e c l i m a t e a n d c u l t u r e o f t h e d i v i s i o n o r s c h o o l a n d t h e v a l u e s a n d p r i o r i t i e s o f i t s s t a k e h o l d e r s .

C a p a c i t y r e f e r s t o h o w l i k e l y i t i s t h a t a d i v i s i o n o r s c h o o l w i l l i m p l e m e n t t h e E B I P a s i n t e n d e d a n d s u s t a i n a n d i m p r o v e i m p l e m e n t a t i o n o v e r t i m e .

E v i d e n c e r e f e r s t o t h e s t r e n g t h o f r e s e a r c h f i n d i n g s i n d i c a t i n g t h e o u t c o m e s t h a t m i g h t b e e x p e c t e d i f t h e E B I P i s i m p l e m e n t e d w i t h f i d e l i t y .

R e p l i c a b i l i t y r e p r e s e n t s t h e d e g r e e w i t h w h i c h t h e E B I P c a n b e r e i t e r a t e d i n t h e c o n s i d e r i n g d i v i s i o n o r s c h o o l .

G t

© H a n o v e r R e s e a r c h , 2 0 2 1 6

RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )

K-12 Tools

B a s e d on ou r re v ie w of e xis ti ng EB I P da ta ba s e s (e . g . , Wha t Wo rk s C le a ri n ghous e ) a n d cons ul ta tio ns wi th o the r di v is i ons , s ch ools , a n d /o r e xpe r ts , wha t s t ra te gie s a n d s olu ti ons ma y he l p ou r div is io n or s c hoo l a d d re s s the a bov e ne e ds ? Th es e i te ms w i l l b e r ef er en ced a s “ EB I Ps u nde r con si der a tio n ” m ov ing f or w ar d in t h is p r o to col .

R e c o r d r e s p o n s e h e r e .

RESOURCES W ha t re s ou r ce s (e . g . , r e v e nue , ma te ri a ls , s ta ff ) w il l be re q uir e d t o imp le me n t the EB IPs u nde r c ons i de ra tio n wi th f i de l ity ?

R e c o r d r e s p o n s e h e r e .

Doe s ou r div is io n o r s c hoo l c ur re n tly ha v e t he re qui re d re s ou r ce s (e .g . , re v e n ue , ma te ria ls , s t a ff ) t o i mp le me nt t he E B IPs u nde r c ons i de ra ti on wi th f i de l i ty ? If no t , ca n we a c quir e t he m w it h i n a re a s o na ble t i me f ra me a n d w i tho ut s i gni f ica nt ly i mp a c tin g re s ou r ce a l loc a t ions to o t he r o ng oin g i nit ia tiv e s ?

R e c o r d r e s p o n s e h e r e .

G t

© H a n o v e r R e s e a r c h , 2 0 2 1 7

RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )

K-12 Tools

CAPACITY H ow e f fi cie n tly a n d e f fe c tiv e ly wi l l o ur d i v is ion or s c hoo l be a ble to tr a i n , s up po r t , a n d coa ch i mp le me nt in g s ta f f in t he e xe cut io n o f t he EB I Ps un de r cons id e ra tio n? W ha t re s ou r ce s , too ls , a n d t e c hni ca l a s s is ta nce e x is t t ha t ca n s u p po r t ou r e f fo r ts in th is a re a ?

R e c o r d r e s p o n s e h e r e .

H ow l ik e ly a re im ple me n ti n g s ta ff a nd o the r s ta k e hol de rs to b uy -i n to the EB I Ps u n de r c ons i de r a ti on ? W ha t is the pr o ba bil it y tha t the y w il l e ng a g e in a s us ta i ne d co mm i tme n t to i mp le me nti ng a n d i mpr ov i n g i mp le me nta ti on o f the E B IPs ?

R e c o r d r e s p o n s e h e r e .

REPLICABILITY U nde r wh a t co nd i tio ns ( e .g . , s c hool s e tt in g , im ple me n ta t io n t i me l ine ) ha v e t he EB I Ps und e r cons ide r a tio n b e e n i m ple me n te d p re v i ous ly ? T o w ha t de g re e do the con di t ions of o ur d iv is i on or s ch ool c o rre s po n d w it h t he s e c on dit io ns ?

R e c o r d r e s p o n s e h e r e .

G t

© H a n o v e r R e s e a r c h , 2 0 2 1 8

RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )

K-12 Tools

W ha t a re t he cha ra ct e ris ti cs (e . g . , r a ce , la n g ua ge s ta tus ) of the s t u de n ts a n d o the r s ta k e h ol de rs s u cce s s fu l ly ta r ge te d b y the EB IPs un de r co ns i de ra tion in t he pa s t? T o wha t d e g re e doe s t he i nte n de d t a r ge t po pu la tio n a t ou r div is ion o r s c ho o l co r re s pon d w it h t he s e c ha ra c te ris t i cs ?

R e c o r d r e s p o n s e h e r e .

EVIDENCE W ha t da ta a re a v a i la ble i nd ica t ing t ha t the EB I Ps un de r c ons i de ra tio n ha v e a hi gh p ro ba bil ity o f s u cce s s ? A re the me a s u re d e f fe c t s ize s o f the s e EB I Ps la r ge e noug h to ma k e t he i r im ple me n ta tio n w or t hwh ile ? A re t he re a ny da ta i nd ica t in g tha t the s e E B IPs ma y n ot be s u cce s s fu l?

R e c o r d r e s p o n s e h e r e .

W ha t da ta w il l ou r div is ion or s cho ol be a ble t o col le c t a n d mon it o r t o e ns u re f i de l i ty o f im ple me n ta t io n f o r the E BIPs un de r c ons ide ra t ion? Wha t da ta ca n ou r div is ion o r s ch ool co l le ct t o t ra ck pr o g re s s re la te d t o a n t ici pa t e d o r ta r ge t ou t come s ?

R e c o r d r e s p o n s e h e r e .

G t

© H a n o v e r R e s e a r c h , 2 0 2 1 9

RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )

K-12 Tools

FIT H ow we l l do the EB I Ps un de r cons i de ra ti on co r re s pon d w it h ou r div is ion ’s o r s c hoo l ’s la rg e r mis s i on a n d v is ion a nd o ur cu r re n t s tr a te g ic pr io r it ie s ?

R e c o r d r e s p o n s e h e r e .

H ow we ll do the E BI Ps un de r co ns i de ra ti on co r re s pon d w it h ou r d iv is ion ’s o r s c hoo l ’s c l im a te a nd cu lt u re a n d o u r s ta k e h ol de r ’s e xpe c ta tions fo r a n d b e l ie fs re ga r din g h i gh - q ua l i ty K -1 2 e d uca tio n?

R e c o r d r e s p o n s e h e r e .

E B I P H e x a g o n A n a l y s i s P r o t o c o l a d a p t e d f r o m : B l a s e , K . , L . K i s e r , a n d M . V a n D y k e . “ T h e H e x a g o n T o o l : E x p l o r i n g C o n t e x t . ” N a t i o n a l

I m p l e m e n t a t i o n R e s e a r c h N e t w o r k , U n i v e r s i t y o f N o r t h C a r o l i n a C h a p e l H i l l , 2 0 1 3 . p p . 2 - 4 . h t t p s : / / w w w . c d e . s t a t e . c o . u s / e a r l y / e a r l y / p y r a m i d m o d e l i m p l e m e n t a t i o n t o o l k i t - 9

G t

© H a n o v e r R e s e a r c h , 2 0 2 1 10

RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )

K-12 Tools

Di re c tio ns : Us e t he pr e s e n te d dis cus s i on que s ti ons — a n d the i r re la te d p ro be s — t o le a d c onv e rs a tio ns a mon g div is i on a n d /o r s c hoo l le a d e rs a n d col la bo r a tin g s ta k e ho l de r s re la te d to pa s t , cu r re n t , a n d fut u re i nte n de d a p p lic a t ion o f e v i de nce - ba s e d in te r v e n ti ons a n d p ra ct ice s (E B IPs ) . By e x plo ri n g t he s e q ue s ti ons , d iv is ions a n d s ch ools c a n de te rmi ne the de gr e e to whi ch t he y ha v e a l re a dy i mp le me n t e d E B IPs a n d in fo r m p la n nin g for f u tu re imp le me n ta tio n o f ne w EB I Ps .

- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- --- -- -- -- -- -- - W ha t EB I Ps ha s ou r d iv is ion o r s ch ool us e d in t he p a s t to a dd r e s s o u r i d e n ti f ie d a r e a s o f ne e d a n d e s ta bl is he d s tr a te g ic pr io r it ie s ? W ha t we re t he re s ul ts o f us in g t he s e E B IPs ?

• P r ob e : A s k p a rt ic ipa n ts to na me the s pe c if ic E B IPs a n d t o a r tic ula t e t he s ho rt - a nd lon g - te r m g oa ls a s s o cia te d w it h t he m .

• P r ob e : A s k pa r ti ci pa nt s t o e x pla i n how the E BI P wa s i mp le me nte d . P ro mp t t he m to de s c r ibe h ow i mp le me nt in g s ta f f we r e tr a ine d a n d coa che d o n t he E B IP a n d how re s o ur ce s we r e a l loc a te d t o s u p po rt i mp le me nta ti on .

• P r ob e : A s k p a rt ic ipa n ts to s ha re da ta a n d /o r a r ti fa cts ind i ca tiv e o f r e s ul t s .

R e c o r d d i s c u s s i o n n o t e s h e r e .

E B I P D i s c u s s i o n G u i d e

G t

© H a n o v e r R e s e a r c h , 2 0 2 1 11

RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )

K-12 Tools

W ha t E BI Ps is ou r div is ion o r s c hoo l co ns i de ri ng us in g to a d dre s s ou r i de n ti f ie d a re a s o f ne e d a n d e s ta bl is he d s t ra te g ic pr io r it ie s ? W hy do we b e l ie v e t he s e EB IPs wil l be e f fe ct iv e i n a c hie v i ng t he de s i re d r e s ul ts ?

• P r ob e : A s k p a rt ic ipa n ts t o de s c ri be how E B IPs un de r cons i de ra ti on d i f fe r f rom t hos e tr ie d i n the pa s t .

• P r ob e : A s k p a r ti ci pa n ts t o s um ma ri ze the e v i de nce a n d s up p or t in g re s e a rc h gu id in g the i r d e te r mi na ti on o f the EB I Ps ’ p ote nt ia l e f fe ct iv e ne s s .

• P r ob e : A s k p a r ti ci pa nt s t o e xp la i n how the E BI Ps un de r co ns i de r a tio n ha v e be e n imp le me n te d i n d iv is ions or s ch ool s im ila r to y ou r o wn (e . g. , s i ze , de mo g ra phi cs ) .

R e c o r d d i s c u s s i o n n o t e s h e r e .

G t

© H a n o v e r R e s e a r c h , 2 0 2 1 12

RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )

K-12 Tools

W ha t s te ps d oe s ou r div is io n o r s c hoo l a n ti ci pa te c om ple ti n g t o ini t i a te a n d s us ta in i mp le me n ta tio n f o r t he EB I Ps u nde r co ns i de ra ti on? H ow wi l l we e ns u re s u f fi cie n t re s o ur ce a l loc a t ions , s ta f f ca p a ci ty , a n d c om mun i ty b uy -i n ?

• P r ob e : A s k p a rt ic ipa n ts t o c ons i de r the role s o f div is ion o r s cho ol le a de rs a nd ot he r s ta k e h ol d e rs in t his p ro ce s s .

• P r ob e : A s k p a rt ic ipa n ts to b ra i ns t o rm po te nt ia l p ro fe s s i ona l de v e lo pme n t , t ra i nin g , a n d/ o r coa c hing s t ra te g ie s to s u p po r t im ple me n tin g s ta f f .

• P r ob e : A s k p a rt ic ipa n ts to re fle c t o n e x is tin g r e s ou r ce s to s up po r t im ple me n ta t io n o f the E B I Ps un de r c ons i de ra tio n a s co mpa re d t he le v e l o f re s ou r ce s re qu ir e d t o s us ta i n im ple me n ta ti on .

• P r ob e : A s k p a rt ic ipa n ts to s ha re p o te n tia l s t r a te g ie s to bu i l d com mu ni ty s u p po r t a n d b uy - in fo r t he E B IPs u n de r co ns i de ra t io n .

R e c o r d d i s c u s s i o n n o t e s h e r e .

G t

© H a n o v e r R e s e a r c h , 2 0 2 1 13

RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )

K-12 Tools

H ow d oe s o ur d iv is i on o r s c hoo l e xpe c t to m oni t or out c ome s re s u lt in g f ro m p o te n ti a l im ple me n ta t io n o f t he E B IPs un de r c ons id e ra tio n? H ow w il l we tr a ck pr og r e s s t owa r d g oa ls ?

• P rob e : As k p a rt ic ipa n ts to s ta te an ti ci pa te d o r de s i re d o ut co me s the y w oul d e xpe c t t o ob s e rv e as a r e s ul t o f i mp le me n tin g t he E B IPs u nde r cons i de ra ti on .

• P r ob e : A s k p a rt ic ipa n ts to re v ie w a n d e x pla i n p o te n tia l da ta , me t r ics , a n d k e y p e r f or ma n ce i nd ica t ors t ha t c oul d b e us e d t o s u p po r t p ro g re s s m oni to r in g .

R e c o r d d i s c u s s i o n n o t e s h e r e .

G t

© H a n o v e r R e s e a r c h , 2 0 2 1 14

RESEARCHING AND SELECTING EBIPS WORKBOOK P r e p a r e d f o r V i r g i n i a D e p a r t m e n t o f E d u c a t i o n ( V D O E )

K-12 Tools

W ha t a c t ions i s ou r div is ion or s c hoo l p re pa re d to ta k e s h oul d the E B IPs und e r co ns i de ra tio n no t ha v e t he i r i n te nd e d im pa cts a f te r s uf fi cie n t t i me a n d re s o urce s ha v e be e n de v o te d t o the i r i mp le me n ta tio n?

• P rob e : As k p a rt ic ipa n ts t o b rains t o rm a cco un ta bi l i ty pr o ce d u re s f o r e xa mini ng an d com mu nic at in g a bo ut re s u lt s .

• P r ob e : A s k p a rt ic ipa n ts to cons ide r a c ce pt a b le t i me li ne s fo r e v a lua t in g p r og r e s s t owa r d g oa ls a nd m a k in g de cis ions a b out w he the r to co n tinue a n E B IP ’s im ple me n ta t io n , ma k e c ha n ge s to t he EB I P , or t e rmi na te it s us a ge .

R e c o r d d i s c u s s i o n n o t e s h e r e .

E B I P D i s c u s s i o n G u i d e a d a p t e d f r o m : “ E v i d e n c e f o r S c h o o l I m p r o v e m e n t . ” T h e E d u c a t i o n T r u s t . p p . 1 - 3 . h t t p s : / / e d t r u s t . o r g / w p -

c o n t e n t / u p l o a d s / 2 0 1 4 / 0 9 / E S S A _ F a c t S h e e t _ _ E v i d e n c e - f o r - S c h o o l - I m p r o v e m e n t _ H y p e r l i n k s . p d f