ubiquitous and mobile computing cs 528: safe drive...

8
Ubiquitous and Mobile Computing CS 528: Safe Drive App Mei Yang, Hongmei Zong, Qian Lu Computer Science Dept. Worcester Polytechnic Institute (WPI)

Upload: buidiep

Post on 02-Apr-2018

218 views

Category:

Documents


4 download

TRANSCRIPT

Page 1: Ubiquitous and Mobile Computing CS 528: Safe Drive Appweb.cs.wpi.edu/~emmanuel/courses/cs528/S16/projects/final_project/... · Ubiquitous and Mobile Computing CS 528: Safe Drive App

Ubiquitous and Mobile Computing CS 528: Safe Drive App

Mei Yang, Hongmei Zong, Qian Lu

Computer Science Dept.Worcester Polytechnic Institute (WPI)

Page 2: Ubiquitous and Mobile Computing CS 528: Safe Drive Appweb.cs.wpi.edu/~emmanuel/courses/cs528/S16/projects/final_project/... · Ubiquitous and Mobile Computing CS 528: Safe Drive App

Introduction to Safe Drive AppSafe Drive factors

● Over a quarter of car crashes in America are caused by cell phone use.● For each year, 100,000 police-reported car crashes are direct result of driver

fatigue.Safe Drive App

● Automatic reply a SMS for incoming phone calls● Using front camera to monitor driver’s drowsiness● Voice interaction with driver regularly● Alarm driver

Page 3: Ubiquitous and Mobile Computing CS 528: Safe Drive Appweb.cs.wpi.edu/~emmanuel/courses/cs528/S16/projects/final_project/... · Ubiquitous and Mobile Computing CS 528: Safe Drive App

Related Works: Anti‐sleep Alarm

● Apps developed● Antisleep Alarm● Drive safe

Page 4: Ubiquitous and Mobile Computing CS 528: Safe Drive Appweb.cs.wpi.edu/~emmanuel/courses/cs528/S16/projects/final_project/... · Ubiquitous and Mobile Computing CS 528: Safe Drive App

Methodology

Safe Drive App● Main Activity

● Survey, Face monitor, Quit● Survey Activity

● Tired level, Road type● Face tracker Activity

● Detect sleepy eyes in real time● Trigger alarm if sleepy eye detected

Page 5: Ubiquitous and Mobile Computing CS 528: Safe Drive Appweb.cs.wpi.edu/~emmanuel/courses/cs528/S16/projects/final_project/... · Ubiquitous and Mobile Computing CS 528: Safe Drive App

Implementation

● Mobile Vision API from Google● Face tracker

● Voice Actions layer ● Handle driver's voice interactions with the app● Voice Interactions API

● Speech Recognition● Speech‐to‐Text

● Telephony layer● Handle incoming phone calls● SmsManager class enables SMS operations

Page 6: Ubiquitous and Mobile Computing CS 528: Safe Drive Appweb.cs.wpi.edu/~emmanuel/courses/cs528/S16/projects/final_project/... · Ubiquitous and Mobile Computing CS 528: Safe Drive App

App demonstration:● User Interface:

● User Survey:● Set interaction frequency with user;

● Monitor: ● Monitor user face;● Send alert based on survey;● Block the incoming phone call and reply SMS automatically

● Quit app:

Page 7: Ubiquitous and Mobile Computing CS 528: Safe Drive Appweb.cs.wpi.edu/~emmanuel/courses/cs528/S16/projects/final_project/... · Ubiquitous and Mobile Computing CS 528: Safe Drive App

App demonstration:

Page 8: Ubiquitous and Mobile Computing CS 528: Safe Drive Appweb.cs.wpi.edu/~emmanuel/courses/cs528/S16/projects/final_project/... · Ubiquitous and Mobile Computing CS 528: Safe Drive App

Discussion/ Future work

● Allow user to define the alarm sound(song, etc)

● Add launch screen instruction and Help menu