video sentiment analysis - michigan state university › 2016-08 › schedules › all... · video...

18
From Students… …to Professionals The Capstone Experience Project Plan Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle Seippel Corey Wisser Department of Computer Science and Engineering Michigan State University Fall 2016

Upload: others

Post on 03-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

From Students…

…to Professionals

The Capstone Experience

Project PlanVideo Sentiment Analysis

Team TechSmithTony CapriglioneDong-Yoon Choi

Alex LambertKyle Seippel

Corey Wisser

Department of Computer Science and EngineeringMichigan State University

Fall 2016

Page 2: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

Functional Specifications

• Creates a way for a video author to see and analyze a viewer’s response without viewer action

• Customizable list of viewers for each video

The Capstone Experience Team TechSmith Project Plan 2

Page 3: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

Functional Specifications

• Allows users to see emotional responses at various points of a video

• Supports rewinding, fast-forwarding, and stopping by the user.

The Capstone Experience Team TechSmith Project Plan 3

Page 4: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

Design Specifications

• Videos are uploaded and assigned to specified viewers through the web application by the video author.

• Viewers will open the desktop app which serves as a custom video player to view videos that are assigned to them.

The Capstone Experience Team TechSmith Project Plan 4

Page 5: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

Design Specifications

• The uploaded video and the webcam recording of the viewer are shown side-by-side with the original video.

• Results from the emotional analysis are displayed below the webcam recording.

The Capstone Experience Team TechSmith Project Plan 5

Page 6: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

Screen Mockup: Custom Video Player

The Capstone Experience Team TechSmith Project Plan 6

John Smith

Video 1 Video 2 Video 3

Video 4 Video 5 Video 6

Video Player – Home

Page 7: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

Screen Mockup: Custom Video Player

The Capstone Experience Team TechSmith Project Plan 7

Home

John SmithVideo Player

Page 8: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

Screen Mockup: Website

The Capstone Experience Team TechSmith Project Plan 8

http://techsmith00.azurewebsites.net/home

Upload Your Video for

Sentimental Analysis

Invite Your Viewers

Email:

Upload

Results Log Off

Page 9: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

Screen Mockup: Website

The Capstone Experience Team TechSmith Project Plan 9

http://techsmith00.azurewebsites.net/results

Home Log Off

Happy: 75%Sad: 5%Angry: 5%Neutral: 15%

Page 10: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

Technical Specifications

• Databases

Videos stored in Azure BLOB

Users and Emotions stored in Azure SQL database

• Authentication

Windows Authentication

The Capstone Experience Team TechSmith Project Plan 10

Page 11: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

Technical Specifications

• The Viewer Client

Universal Windows Program

Designed with C#/XAML

• Video Uploader Client

ASP.NET

Designed with Bootstrap

The Capstone Experience Team TechSmith Project Plan 11

Page 12: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

System Architecture

The Capstone Experience Team TechSmith Project Plan 12

Page 13: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

System Architecture

The Capstone Experience Team TechSmith Project Plan 13

Page 14: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

System Components

• Hardware Platforms

iMacs running Windows 10 in VMware

Windows computers

Built in webcams

The Capstone Experience Team TechSmith Project Plan 14

Page 15: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

System Components

• Software Platforms / Technologies

ASP.NET MVC with an Azure cloud server

C# Universal Windows App

CSS/HTML/JavaScript/Bootstrap

Azure SQL database

Azure BLOB storage

Visual Studio 2015

Microsoft Cognitive Services

The Capstone Experience Team TechSmith Project Plan 15

Page 16: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

Testing

• Unit Test App (Universal Windows)

• Visual Studio Test Suite for .NET

• Database testing using XML

• Functional and iterative testing for all around bug fixing

The Capstone Experience Team TechSmith Project Plan 16

Page 17: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

Risks

• Risk 1 Extracting emotions for a webcam video with

limited API calls

Process webcam footage after video has concluded and make API calls in the C# Desktop App.

• Risk 2 Connect the uploaded video on the web server to

the viewer client

Invite people based on Microsoft Email and have user authenticate in the C# Desktop App.

The Capstone Experience Team TechSmith Project Plan 17

Page 18: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle

Risks

• Risk 3

Dealing with webcam video after pausing and rewinding

Store the entire footage and modify playback of the original video to fit the tempo of the webcam

The Capstone Experience Team TechSmith Project Plan 18