Teleoperation In Mixed Initiative Systems

What is teleoperation? Remote operation of robots by humans Can be very difficult for human operator Possible Applications:

Surgery Space Military

Can machine learning techniques help? Interleave AI at appropriate times Provides relief for the human operator

Objectives A system which assumes some control while

still allowing the human operator to make high level decisions

Describe low level actions in an abstract way such that the representation is grounded in control The controller is used as a descriptive and

interpretative mechanism

Related Questions

Can teleoperation assist in training and the formation of control policies?

Can the manipulation constraints of objects be learned through incremental interaction?

How do we integrate human and automated control to take advantage of their respective strengths?

The Plan

View the environment with robot head and two cameras

Use data glove and position orientation sensor to track hand motion and finger flexion

Perform object manipulation tasks from which the robot can learn the main points of the action.

Progress

Ported old data glove code to new linux kernel.

Created a new C++ interface for robot head as well as the orientation system.

Coded a program to log information from the data glove and orientation system.

Started working on adding control to simulated 3D robot environments.