playbook for uas: ux of goal-oriented planning & execution · playbook for uas: ux of...

25
Playbook for UAS: UX of Goal-Oriented Planning & Execution UAS: Unmanned Aircraft System UTM: UAV Trac Management UAV: Unmanned Aerial Vehicle Playbook for UAS: UX of Goal-Oriented Planning & Execution https://ntrs.nasa.gov/search.jsp?R=20180007536 2020-07-18T06:13:22+00:00Z

Upload: others

Post on 29-Jun-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

UAS: Unmanned Aircraft System UTM: UAV Traffic Management UAV: Unmanned Aerial Vehicle

Playbook for UAS: UX of Goal-Oriented Planning & Execution

https://ntrs.nasa.gov/search.jsp?R=20180007536 2020-07-18T06:13:22+00:00Z

Page 2: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

What is Playbook? Our mission

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Our Team

Page 3: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Our interest in UAS Geospatial integration Future use cases for Playbook

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Playbook

Page 4: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Teams involved Timeline and flight demonstration Goals and innovation

GCS PaaS Playbook Auto Resolver 3 Aircraft

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Architecture

Page 5: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Architecture

Page 6: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Architecture

Autonomous Systems

Page 7: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Architecture

Autonomous Systems

Human Interface

Page 8: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Interface Walkthrough

Our interface Timeline, Geospatial, Stream View

Page 9: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of
Page 10: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of
Page 11: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of
Page 12: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of
Page 13: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Research

Methodology Participants (DART) Human Centered Design

Define

Ideate

Prototype

Research

Test

Ames Disaster Area Response Team California Urban Search and Rescue Task Force 3

Page 14: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Research

Human Centered Design Exploratory testing Rapid prototyping

Page 15: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Research

Human Centered Design Exploratory testing Rapid prototyping

Page 16: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Insights

Insights Recommendations User feedback

Page 17: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Insights

First responders can use goal-oriented planning to minimize the impact of additional ATC roles. Users only need be concerned with high level objectives like:

How long will the goal take to complete? How many UAS are required to complete the goal? Which goal has the highest priority?

Page 18: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Insights

Situational awareness is essential when evaluating a disaster area. Users first need an overall scene assessment, then more low level details at key moments within the mission.

“Scene assessment is the first step, start out high, then focus in”

Page 19: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Insights

Guiding many UAVs at once increases the amount of information the user has to hold in their head. Clear labels on zones, trajectories, and flight plan options reduce cognitive loads on the user when guiding multiple UAVs.

“I want notifications at critical points”

Page 20: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Insights

Users need agency, and allowing them to control waypoints and make real-time decisions on the ground provides freedom to an otherwise fully autonomous system.

“Pilots don’t like being told what to do”

Page 21: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Recommendations

Interface recommendations Future steps & discussion

Page 22: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Recommendations

Users hesitate before sending instructions to the swarm. Go - NoGo indicators could reduce hesitation when sending alternate trajectories or waypoints to GCS.

“It’s a military thing, double check everything”

Page 23: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Recommendations

First responders in some cases need to create their own trajectories and requested the ability to drag waypoints. This is preferred when negotiating temporary flight restriction (TFR) volumes as the areas can change from moment to moment.

Page 24: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Conclusion

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Playbook for UAS

Goal

Package Delivery/ Transportation

Search/ Monitor

Build

Organize

Task Action

Set Up

Take Off

Land

Move Forward

Move Left

Move Right

Move Back

Move Up

Move Down

Turn Clockwise

Turn CounterClockwise

Stop

LED’s

Video

Pick Up

Drop Off

Communicate

Build Flight Path

Fly to Location

Pick Up Package

Retrieve Package Data

Drop Off Package

Take Photo

Take Video

Report Back

Return/ End Goal

Page 25: Playbook for UAS: UX of Goal-Oriented Planning & Execution · Playbook for UAS: UX of Goal-Oriented Planning & Execution Insights Guiding many UAVs at once increases the amount of

Thank you

Playbook for UAS: UX of Goal-Oriented Planning & Execution

Playbook for UAS