30 31 cognitive navigation and object detection system for blind people

COGNITIVE NAVIGATION AND

OBJECT DETECTION SYSTEM

FOR BLIND PEOPLE

Larisa Dunai

Guillermo Peris-Fajarnes

Teresa Magal-Royo

Beatriz Defez

AEGIS 2nd International

Conference 2011

Motivation AEGIS International

Conference 2011

Introduction

Communication localization

AEGIS International

Conference 2011

Introduction

¿From

where?

AEGIS International

Conference 2011

Objective

Design an Electronic Travel Aid system

(ETA) for object detection and navigation for

blind people

inform the blind user about near and far static

and dynamic objects through acoustical

signals

Stereovision

AEGIS International

Conference 2011

Objective AEGIS International

Conference 2011

State of the art

Detectores de obstáculos Sensores del entorno Navegación

Ultrasonidos Láser y ultrasonidos Identificador de posición

-Lindsay Russell Pathsounder

-Mowat sensor

-Light Probes

-Nottinham Obstacle Detector

-Sonic Torch

-Sonic guide

-KASPA

-Bat K Sonar

-Miniguide

-Trisensor

-Ultracane

-Talking Signs

-Taling Lights

-Sonic Orientation Navigation Aid

-Marco

-Verbal Landmark

-Easy Walker

-Pilot Light

Láser Localización del usuario

-Laser Cane

-Ultracane

-Sonic Pathfinder

-Polaron

-Walk Mate

Video

- SWAN

-The vOICe

-Navigation Assistance for Visually Impaired

-Tyflos device

-EPEL

-System for wearable Audio Navigation

GPS

- Trekker

-Geotact

-Tormes

-GPS Braylle Note

-Personal Guidance System

-Talk & Wayfinder

AEGIS International

Conference 2011

System design

INPUTS OUTPUT

environment

AEGIS International

Conference 2011

Real-Time Assistance Prototype AEGIS International

Conference 2011

Real-Time Assistance Prototype

Fig.2. Real-Time Assistance Prototype block diagram

Processing Unit

PPM

images

Acoustic

sounds

Stereo

cameras

Headphones

Object detection and Free

space detection

Segmentation algorithm

Depth Map Estimation

Bounding Box Algorithm

Acoustical Module

Object distance

Object speed

Object direction

Object height

Free Space coordinates

Stereo Camera calibration

AEGIS International

Conference 2011

Acoustical system

Object

Distance

Direction

Height

Speed

complexity

AEGIS International

Conference 2011

Object segmentation using depth

maps, sparse dots and bounding box

AEGIS International

Conference 2011

Experimental scenario 15 m

10 m

5 m

12 m

AEGIS International

Conference 2011

Experimental trial

video

AEGIS International

Conference 2011