sa discover text webinar

Unlock the Power of Text: New Analysis Options via DiscoverTextA presentation byDr. Stu ShulmanTexifter, LLC

and

Esther LaVielle from Survey Analytics

What We’ll Cover

ABOUT The Presenters Hot Trend: DIY Text Analysis 5 Steps: Getting

Started with Text Analysis DiscoverText –

Simple Tools To Uncovering The Power of Words

Example Included Q&A / Conclusion

About Survey Analytics

• Started back in 2002 in Seattle, WA • #172 out of 500 fastest growing private

companies • 6,000 + clients & growing

• SurveyAnalytics, QuestionPro, IdeaScale, MicroPoll, SurveySwipe, SurveyPocket, BadgeFarm

• Esther LaVielle: Chief Education Director

Stuart Shulman is: – Assistant professor of political science at

the University of Massachusetts Amherst– Founder & CEO, Texifter, LLC– Founder & Director, QDAP-UMass– Editor-in-Chief, Journal of Information

Technology & Politics.Fun fact: Stu is garlic growing enthusiast with a popular YouTube channel on growing garlic!

About Dr. Stu Shulman

• Texifter products help index, search, filter and classify large amounts of text.

–Market research, eDiscovery & extraction of key insights

–Large & diverse enterprise data sets

–Social media search and archival services

–Peer group and crowd sourced collaboration

–Credential-based, cross-organizational work groups

DiscoverText: http://discovertext.com

About Texifter, LLC.

HOT TRENDS: DIY TEXT

ANALYTICS

Hot Trends: DIY Text Analysis

http://blogs.forrester.com/leslie_owens/10-12-20-text_analytics_a_key_trend_to_watch_over_the_next_three_years

Forrester Research named text analytic technologies one of top 15 trends to watch the next 3 years!

Used to:• Mine, interpret & structure information to reveal hidden patterns &

relationships.• Reveal the voice of customers, conduct competitive intelligence, make

operations improvements, & achieve better compliance or law enforcement.

Techniques:• Analytics and search: Analytics tools surface and visualize patterns• Analytics and information retrieval: Content professionals use text analytic

tools to identify duplicate, near-duplicate, similar or irrelevant content• Social network analysis: focused on identifying and forecasting connections,

relationships, and influence among individuals and groups.

• Identify & categorize high-frequency

words, themes or concepts• Review recurring phrases & associations

of words (build topic models)

• Present open-ended text findings via

charts or tag clouds

Hot Trend: DIY Text Analysis

Code & analyze unstructured text data from:

- Surveys- Social network sites or Twitter- Blogs- Anywhere really!

Pros:-Cut down the costs of coding-Control your dataCons:Which one to choose?What is the learning curve?

1) Clean and organize the data (format, edit, spelling, etc.) 2) Translate survey data to uniform language (if needed) 3) Segment it by metadata properties and categories 4) Label & bookmark interesting items

5) Look for obvious patterns, for example frequency counts, tag clouds, repetition, idiosyncratic ideas, punctuation or grammar used for emphases.

5 Steps: Getting Started with Text Analysis

Unify Your Data

Email

Files Web

Import & archive data from multiple sources into a single, searchable, unified repository

SurveyAnalytics & DiscoverText

SurveyAnalytics is compatible with DiscoverText softwareExport an XML report & Login to http://discovertext.com/ to get started!

Login to DiscoverText

The DiscoverText Dashboard

From the DiscoverText dashboard, create a new project or work on an existing one

Select the “Import Data” option from the Manage Project screen or Archives Screen

Your DiscoverText Project

Select the “Survey Analytics Export” file type

Select Your File Type

Select your data file and click “Upload”

Upload Your XML Export Data

View Archive Details

Browse and Search to Create Buckets

Import Other Data Via Live Feeds

Import Facebook Page Content

Schedule Day-Forward Imports

Generate Tag Clouds from Keywords

Cluster Documents

Duplicate & near duplicate

detection

Dynamic user-seeded tag clouds

Adaptable, intuitive and

reusable topic models &

shared memos

Sentiment detection,

redaction & seamless

adjudication

Find and Add PeersSecurely segment your peers into project groups by

agency, firm, department, location, or affiliation,while controlling their access via credentials

Code Datasets

Annotation enhances your analysis by applying human interpretation to machine results

Explore Crowdsourcing

- MIT professor Eric von Hippel, specialist in innovation management“This is really the biggest paradigm shift in innovation since the Industrial Revolution”

Add Bookmarks

Generate Reports

• Q1, 2011– Sentiment Analysis

• Computer-assisted labeling of positive and negative sentiments in comments

– Topic Clustering• Computer-assisted tagging and labeling of topics for

comments and clustering

• Q2, 2011– Active Learning

• Our algorithms learn from your input! Over time, our natural language processing tools (such as sentiment and topic analysis) will get better with accumulated user feedback

Coming Soon!

Q & A Session and Conclusion

Esther LaVielleEsther.rmah@surveyanalytics.comhttp://www.surveyanalytics.comblog.surveyanalytics.com

Dr. Stuart W. ShulmanFounder & CEOTexifter, LLChttp://discovertext.comstu@texifter.com