November 16, 2015 Sam Siewert

CS415 Human Computer Interaction

Lecture 13 – Advanced HCI UAV HCI

Assignments Assignment #6 – Proof-of-Concept or Evaluation with Final Report Final Oral Exam – Presentation of Project Access to the Controls Lab (Jetsons) – Myself, Jim Weber, Dr. Davis, Dr. Bruder – Emily and Adam Molson – Controls Lab Monitors

9-5 on Sat, 12 noon – 9pm Sun

Sam Siewert 2

Learning Objectives Beyond CLI & WIMP

Problem Definition (Report, Presentation) Collaboration and Teamwork Literature Review on Topic of Interest (Make Citations in Your Report)

– Virtual Reality, Augmented Reality, HUD – Natural Language Processing (Speech to Text, Text to Speech) – Stylus, Gesture, Swipe, Glove, … Interaction (No Keyboard/Mouse) – Universal Design – Ubiquitous Computing – Teleoperation, Shared Control, Autonomous Systems – Killer Application – Self-Driving Cars (Intelligent Transportation), UAV AR/VR/FPV, Mobile

AR/VR, Telesurgery, … Cognitive Models Incorporated (Chapter 12) – Task and Goal (GOMS) – Linguistic – Physical – Integrated

Prototyping and Proofs-of-Concept HCI Evaluation – Experiment Design (Chapter 9) Presentation of Results (Report and Final Oral Exam)

Sam Siewert 3

Drone HCIs Sense and Avoid – MIT CSAIL -

http://www.csail.mit.edu/drone_flies_through_forest_at_30_mph – Intel Real-Sense on AscTek Drone -

https://www.youtube.com/watch?v=Gj-5RNdUz3I

Military – NOVA Documentary on Rise of the Drones -

https://www.youtube.com/watch?v=qOcv6aMk7bs – Predator – Reaper – Globalhawk

Sam Siewert 4

UAV HCI Tele-operated, Line of Sight and/or First Person Viewing Shared Control Autonomous

Sam Siewert 5

ERAU EE/CE/SE UAV Research ICARUS Group – UAV Flight Dynamics – Instrumentation

Remote Sensing (Cameras) GN&C SLAM Sense and Avoid

Sam Siewert 6

Missions Mapping and Surveys – Agriculture – Natural Resources

Search and Rescue Operations Package Delivery Military Security

Sam Siewert 7

HUD and AR Displays Help With Situational Awareness FPV Video Latency? Accuracy of UAV Model? Telemetry Latency?

http://www.sys.virginia.edu/sieds07/papers/SIEDS07_0050_FI.pdf

Telemetry and FPV Video Latency FPV is Critical to Shared Control Applications Along with Instrumentation Data (Overlay), Geo-reference

Sam Siewert 8 http://www.researchgate.net/publication/259344376_Verification_of_Video_Frame_Latency_Telemetry_for_UAV_Systems_Using_a_Secondary_Optical_Method

Capture & Encode Latency

Buffer & Decode Latency

UAV HUD Telemetry and FPV Integrated Packet Stream of KLV Telemetry with Video

Sam Siewert 9

How Latent is HUD/AR Display? Compare Integrated Digital TLM/Video HUD/AR to Analog Line of Sight (Continuous Transmission)

Sam Siewert 10

UAV HCI Sense and Avoid (Fly Away UAV Hazard to Aviation) First Person Viewing Autonomous UAVs (Mapping, Surveillance) Shared Control Video and Graphics (e.g. STK) Minute Paper – Time Constrained Decision Support (Shared Control) – Key

Features? – Biggest Negative and Issue(s) to Overcome with UAVs – Biggest Value for New Applications – Who (FAA, DOT, Other?) Should Regulate and How?

Week 14 – Quiz, Review for Exam #2, A#6 Help Week 15 – Exam #2 Final Oral Exam

Sam Siewert 11