internal message testing

Internal Message Testing

Prepared for GSA UX Summit

January 28, 2014

2

Background

• Frequent, on-going need to communicate clear messages to diverse audiences

• Often no time or resources for formal testing

• Risk Communication Advisory Committee strongly supports pretesting messages, however informally, before they are released

3

Internal Network

• Informal testing conducted with FDA employees to uncover basic flaws and “red flags”

• Working within PRA restrictions to get timely feedback on draft communications

• Makes it easier for FDA to tap its own resources

4

High school or GED (6)

Highest Education

Some college (47)

4-year degree (139)

Advanced degree (379)

Drugs (154)

FDA Center/Office

Regulatory Affairs (102)

Devices (99)

Office of Commissioner (61)

Foods (59)

Biologics (47)

Toxicology (27)

Veterinary Medicine (18)

Tobacco (11)

Less than 1 year (81)

Years at FDA

1 to less than 4 years (167)

4 to less than 16 years (205)

16 years or more (123)

Physical Science (104)

Specific Training

Communications (86)

Social Science (70)

Engineering (51)

Physician (47)

PA, NA, Nurse (40)

Pharmacist (34)

Nutrition Science (34)

Human Factors (17)

Veterinarian (13)

1 child (111)

Caretakers of People

Multiple children (126)

Elderly or disabled (42)

Dogs (209)

Caretakers of Animals

Cats (146)

Livestock (5)

Horses (4)

Women (404)

Gender

Men (174)

29 or younger (44)

Age

30 to 39 (130)

40 to 49 (172)

50 to 59 (165)

60 or older (50)

White (380)

Race/Ethnicity

Black (83)

Asian (75)

Hispanic (27)

AIAN (9)

NHPI (3)

ESL (62)

Language

Spanish (46)

Mandarin Chinese (19)

Other (81)

Over 500 Employee Volunteers

5

Establishing the Network

• Conducted pilot tests in 2009 to demonstrate value and gain Center Directors’ support

• Identified Center/Office liaisons and provided them with User’s Guide

• Created electronic sign-up sheet, email account, and intranet page

• Kicked off recruitment in 2010 with FDA-wide announcement by Principal Deputy Commissioner

6

Using the Network

• FDA communicators contact coordinator to explain testing need and request assistance

• Network volunteers screened and scheduled to participate at their convenience

• Primarily semi-structured, face-to-face individual interviews; Data analyzed qualitatively

7

Example: Tested Graphics

8

Example: Final Graphic

http://www.fda.gov/ForConsumers/ConsumerUpdates/ucm381429.htm

9

Brian LappinRisk Communication Staff

Office of Planning, OC

Brian.Lappin@fda.hhs.gov

(301)796-9126

Contact Information