TENNESSEE LONGITUDINAL DATA SYSTEM (TLDS)

26th Annual MIS ConferenceFebruary 14, 2013

APRIL 22, 2023

ANSWERS WE DIDN’T HAVE UNTIL NOW

2

GLYNN LIGON, PH.D.

ESP SOLUTIONS GROUP

2

APRIL 22, 2023

3

Overview Data Domains What can we do with TLDS?

Governance Committee Representation Data Access and

Management Policy User Roles and Data

Visibility Project Delivery

Timeline Phased/Multi-Agency Project Phased Deployment

AGENDA Infrastructure and Security

Modularized Environment Pre-Production Activities Security Controls Performance Analysis

Data and Matching Data Sources Database Framework Unique Identifier (MPI)

Web Portal and Dashboards Web Portal Overview Data Visualization

Capabilities Closing Comments and

Questions3

APRIL 22, 2023

4

OVERVIEW

• Data Model• Extract/

Transform• Audit/

Validation• Unique

Identifier

• Research Datasets• Query/Analysis• Dashbaords• Feedback/Monitor

• Project Structure

• Data Sharing• Procedures

• Environment• Security Protocol and

Controls• Identity Mgt.• Performance

Architecture &

SecurityGovernan

ce

Data Warehous

e

Portal & Reporting

4

DATA DOMAINS

Student

Course

Assess-

ment

Work-

forceScho

ol

Staff

2011/2012

Beyond

Census

Bureau

Correc- tions

Human

Services

Child Servic

es

APRIL 22, 20235

Make informed decisions based on data Assess Effectiveness of Policies and Programs

Identify impact/outcomes of services Example: Unemployment or wage by education attained (i.e., Degree,

Program) Example: Determine success of program participants Understand and align programs to workforce demand Example: Adult education programs to develop computer skills when

unemployed or incarcerated Evaluate College and Career Readiness

Curriculum evaluation and reform Example: Graduates require remediation in math despite taking

Algebra II Develop College and Career Indicators

Identify individual remediation needs and action plan Example: Student declares desire to study engineering yet has only a

basic proficiency in math Improve Efficiency of Agency Operations

Cross agency information sharing Example: Provide view of information for federal compliance reporting

WHAT CAN WE DO WITH TLDS?

APRIL 22, 20236

APRIL 22, 2023

7

TAMMY LEMON

UNIVERSITY OF TENNESSEE GOVERNANCE

7

APRIL 22, 2023

8

COMMITTEE REPRESENTATION

 

 

Data Contributors:TN Higher Education CommissionLabor and Workforce DevelopmentEducation

Advisors:Human ServicesChildren ServicesGovernor’s Office

UT-CBERTN Board of RegentsUT-SystemTN Independent Colleges and Universities

P20 TLDS Steering Committee

Work Group Committee: IT Data System Experts Data Knowledge Experts

Project Management: UT-CBER ESP Solutions Group

Steering Committee: Data contributors, potential contributors, and project leaders Establish project governance structure and objectives Define access policy, who can see data and define procedures

Work Group Committee: Technical and data experts Establish process for data export Define business rules for transformation Resolve data anomalies Validate transformed data

8

APRIL 22, 2023

9

Types of Data Sourced Relevant State and Federal Regulations Responsibilities of the Agencies and CBER User Roles for Access Levels of Data Visibility Approvals Required for Access Security Measures to Protect the Data Additional Procedures:

Annual Policy Review User Management and Monitoring Researcher Request for Data

DATA ACCESS & MANAGEMENT POLICY

9

APRIL 22, 2023

10

Aggregate Data Public Consumer Partner Agency Consumer

Masked Individual Records Agent of Partner Agency Researcher External Researcher

Identifiable Individual Records Partner Agency Researcher Partner Agency Administrator System/Data Administrator

USER ROLES & DATA VISIBILITY

10

APRIL 22, 2023

11

TOM JENKINS

UNIVERSITY OF TENNESSEE PROJECT DELIVERY

11

12

APRIL 22, 2023

TIMELINE

Apr-11 Jul-13

Jul-11 Oct-11 Jan-12 Apr-12 Jul-12 Oct-12 Jan-13 Apr-13 Jul-13

Dec-11 - Jun-12Data Discovery

Aug-12 - Jul-13User Training Sessions

Apr-13Web Portal &

Reports Deployed

Aug-11Select Vendor

May-11Issue RFP

Nov-11InfrastructureDefined

Jun-12Match Data

(Student Focused)

Dec-12Data Warehouse

& PortalPhase 3

Mar-13Match Data

(Full Algorithm)

Apr-12Data Warehouse

& PortalPhase 1 Jul-12

Data Warehouse& PortalPhase 2

Feb-12 - Dec-12Import & Analyze Data

Feb-13Data Warehouse

Phase 4

12

APRIL 22, 2023

13

Multi-Phased Deployment Portal Content Lags Warehouse by 1 Phase

Three Agencies Labor and Workforce Development Department of Education Higher Education Commission

PHASED/MULTI-AGENCY PROJECT

13

APRIL 22, 2023

PHASED DEPLOYMENT14

5/31/2013

5/1/2012 6/1/2012 7/1/2012 8/1/2012 9/1/2012 10/1/2012 11/1/2012 12/1/2012 1/1/2013 2/1/2013 3/1/2013 4/1/2013 5/1/20134/30

Phase 1Release

9/30Phase 2Release

1/15Phase 3Release

4/30P20 TLDS

Final Release

Portal

Look &  Feel

Portal

Secured Portalü Data Query and 

Extractü ETL and Match Statsü Feedback Reports

THEC: ACT/SATTHEC: FAFSA / TSAC

THEC: National ClearinghouseTHEC: TERC

TDOE: Staff / TeacherTDOE: Course/Schedule

TDOE: Student AttendanceTDOE: Grades

TDLWD: Adult Education

Data Warehouse

Portal

Secured Portalü Graduate Progressionü Freshman Success Design

ü Student Progression Cube Design

ü Teacher Progression Cube Design

Portal

Public Portalü Perspectives Dashboards

ü Expand Data Definitions

Secured Portalü User Management

TDOE: Career & Technical Education

TDOE: AssessmentTDOE: Value Add Assessment

TDOE: Discipline

TDLWD: Unemployment ClaimsTDLWD: GED Data

Data Warehouse

THEC: InstitutionsTHEC: Student Demographics

THEC: Student EnrollmentTHEC: Academic Record

TDOE: Student Demographics TDOE: Student Enrollment

TDOE: Graduation

TDLWD: UI Wage Data

Data Warehouse

2/28Phase 4Release

Portal

Secured Portalü Data Visualization Experience Design

ü Data Definitions

Research Portalü Research Requestü Data Definitions

THEC: AP Assessment

TDOE: ACT AssessmentTDOE: Special Education

TDOE: Early Intervention /Disabilities

TDOE: School Report CardTDOE: Finance

TDLWD: WIA DataTDLWD: Job Services

TDLWD: TAA DataTDLWD: LMI Data

Data Warehouse

14

APRIL 22, 2023

15

J IM RIFE

ESP SOLUTIONS GROUP INFRASTRUCTURE and

SECURITY

15

APRIL 22, 2023

16

MODULARIZED ENVIRONMENT

16

APRIL 22, 2023

17

Warehouse Source Analysis (4 Phases) Discard Analysis Data Validation

Portal Development Data Cubes/Analysis Services Data Visualization Reporting Capabilities

Security Performance Analysis

PRE-PRODUCTION ACTIVITIES

17

APRIL 22, 2023

18

Data Access Controls Specified by the Data Governance Committee

Undergoing Security Control Assessment Based on NIST-FIPS 180-53 Goal to achieve Mid-Moderate Baseline

Leveraging University of Tennessee OIT’s Data Center

Physical Security Contingency Management Network Infrastructure

SECURITY CONTROLS

18

APRIL 22, 2023

19

PERFORMANCE ANALYSIS

19

APRIL 22, 2023

20

SYSTEM RESPONSE (250 USERS)

20

APRIL 22, 2023

21

PROCESSOR LOAD

21

APRIL 22, 2023

22

TOM JENKINS

UNIVERSITY OF TENNESSEE DATA and MATCHING

22

APRIL 22, 2023

23

DATA SOURCES

DOE THEC TDLWD

Demographics Staff/Teacher DemographicsUnemployment

Claims

Enrollment Teacher Value-AddAdmission Criteria

(ACT) Wages

Graduation/CohortLicensing/

Certifications Enrollment Adult Ed/GED

Course/Grades FacilitiesNational

ClearinghouseWorkforce Investment

Attendance Finance Financial Aid Job ServicesAssessment (TN &

ACT) Teacher Report Card TradeCareer & Tech Ed InstitutionsSpecial Education

Discipline23

APRIL 22, 2023

24

IMART DATA MANAGEMENT FRAMEWORK

Data Imported ‘As-Is’

Transformed to iMart Data Model

Assign Unique Identifier

Publish to Reporting Warehouse

Create Cubes for Analysis

24

APRIL 22, 2023

UNIQUE IDENTIFIER (MPI) OVERVIEW

25

Identify individuals across multiple data domains using matching algorithms

Mask sensitive data to protect identity of individual

Assigns identifiers to uniquely identified individuals Common elements: SSN, Name, and Birth Date Not consistently available in all data sources Can assign multiple identifiers Flexible when new elements available for matching

25

APRIL 22, 2023

26

MPI PROCESS

Create Unique ID2Source

Data

Apply Unique ID3

Identify New1

1. Identifies a new combination of data elements to enter matching process2. Steps through series of algorithms to determine if combination is unique

and creates Unique ID3. Applies Unique ID to all individual records and suppresses identifiable data

(Name, SSN/Fed EIN, and Street Address) in the reporting warehouse 26

APRIL 22, 2023

27

TAMMY LEMON

UNIVERSITY OF TENNESSEE WEB PORTAL and

DASHBOARDS

27

APRIL 22, 2023

28

Public Portal Dashboards Online Training

Secured Portal Confidential Reports Collaboration Tools Data Analysis and Export

Research Request Applicant Registration View Data Domains Request Data Provide Data/Access

WEB PORTAL OVERVIEW

28

APRIL 22, 2023

29

Interactive Dashboards Role Base Navigation

I am A: Parent, Student, Employer, Job Seeker Perspective Based

Starting School Starting Work Attending College Second Careers

PUBLIC PORTAL PERSPECTIVES

29

APRIL 22, 2023

30

Data Domains Linked (K12, Post-Secondary, Staff, Workforce)

FERPA Compliant Integrated and Sophisticated Design Deep-dive, Drill-through Exploration of Metrics Comparison and Trend Analysis Technology:

Microsoft BI Stack SQL Server 2008 R2 with SSRS and SSAS SharePoint 2010 with Performance Point and Power Pivot

Assessing SQL Server 2012/SharePoint 2013 vs. Tableau

DATA VISUALIZATION CAPABILITIES

30

APRIL 22, 2023

31

CLOSING COMMENTS/QUESTIONS

31