on multi-agv systems for factory logistics: the pan-robots...

54
On multi-AGV systems for factory logistics: the PAN-Robots project Lorenzo Sabattini University of Modena and Reggio Emilia, Italy

Upload: others

Post on 27-Sep-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

On multi-AGV systems for factory

logistics: the PAN-Robots project Lorenzo Sabattini

University of Modena and Reggio Emilia, Italy

Page 2: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

PAN-Robots project

• Name: Plug And Navigate ROBOTS for smart factories (PAN-ROBOTS)

• Included in Seventh Framework Programme (ICT)

• Duration: 36 months

• Start date: 1st November 2012

• End date: 31th October 2015

• Grant Agreement no: 314193

www.pan-robots.eu

Page 3: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Partners

Page 4: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Partners

1. Sick AG – Germany

Page 5: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Partners

1. Sick AG – Germany

2. Elettric 80 – Italy

Page 6: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Partners

1. Sick AG – Germany

2. Elettric 80 – Italy

3. University of Modena e Reggio Emilia – Italy

Page 7: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Partners

1. Sick AG – Germany

2. Elettric 80 – Italy

3. University of Modena e Reggio Emilia – Italy

4. Teknologian Tutkimuskeskus VTT – Finland

Page 8: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Partners

1. Sick AG – Germany

2. Elettric 80 – Italy

3. University of Modena e Reggio Emilia – Italy

4. Teknologian Tutkimuskeskus VTT – Finland

5. Technical University of Cluj-Napoca – Romania

Page 9: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Partners

1. Sick AG – Germany

2. Elettric 80 – Italy

3. University of Modena e Reggio Emilia – Italy

4. Teknologian Tutkimuskeskus VTT – Finland

5. Technical University of Cluj-Napoca – Romania

6. Coca-Cola Iberia Partners – Spain

Page 10: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Motivation

AGVs for factory logistics

Page 11: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Main characteristics

Already working warehouses

Page 12: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Main characteristics

Already working warehouses

Interaction with humans

(operators, manual forklifts, …)

Page 13: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Safety

Interaction with humans

Page 14: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Safety

Interaction with humans

SAFETY

Page 15: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Safety

Interaction with humans

SAFETY

DECREASED EFFICIENCY

Page 16: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Speed reduction

Speed reduction at intersections

Page 17: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Queues

Page 18: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Queues

An AGV stops due to an obstacle

Page 19: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Queues

Queue of AGVs

Page 20: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Centralized traffic management

Complex optimization

problem

Page 21: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Improvements

• Enhanced perception

• Cooperation and sharing of information

• Advanced coordination

Page 22: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Enhanced perception technologies

• Laser scanners

• Vision sensors 2D 3D

Page 23: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Enhanced perception technologies

• Autonomous and precise mapping

• Object recognition and classification

– Semantic perception/action

Page 24: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Enhanced perception technologies

• Autonomous and precise mapping

• Object recognition and classification

– Semantic perception/action

Page 25: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Enhanced perception technologies

• Autonomous and precise mapping

• Object recognition and classification

– Semantic perception/action

Page 26: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Enhanced perception technologies

• Autonomous and precise mapping

• Object recognition and classification

– Semantic perception/action

STOP!

Page 27: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Enhanced perception technologies

• Autonomous and precise mapping

• Object recognition and classification

– Semantic perception/action

Page 28: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Enhanced perception technologies

• Autonomous and precise mapping

• Object recognition and classification

– Semantic perception/action

BOX

Page 29: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Enhanced perception technologies

• Autonomous and precise mapping

• Object recognition and classification

– Semantic perception/action

BOX

Page 30: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Cooperative sensing

• Infrastructure sensors

• Onboard sensors

Page 31: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Cooperative sensing

• Infrastructure sensors

• Onboard sensors

• Blind spot monitoring

• Observation of moving objects

Page 32: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Coordination and traffic

management

Current solution:

1. Manual roadmap design

2. Static path planning

3. Manual traffic rules for coordination

Page 33: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Coordination and traffic

management

Current solution:

1. Manual roadmap design

2. Static path planning

3. Manual traffic rules for coordination

PAN-Robots solution:

Automatic roadmap generation and dynamic path planning based on a hierarchical architecture

Page 34: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Hierarchical architecture

• Higher layer:

– Plant divided in sectors

– Dynamic planning based on centralized information:

• Global state of the fleet

• Task assignment

Start

Goal

Goal

Start

Page 35: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Hierarchical architecture

• Higher layer:

– Plant divided in sectors

– Dynamic planning based on centralized information:

• Global state of the fleet

• Task assignment

Start

Goal

Goal

Start

• Lower layer:

– Decentralized local coordination

– Local avoidance of deadlocks

– Local conflict resolution

?

Page 36: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Simulation

Digani et al., ICRA 2014

Page 37: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Automatic roadmap creation

Automatic roadmap creation

Objective:

• Coverage of the free space

• Redundancy

• Strongly connected

Page 38: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Given an industrial plant…

Page 39: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Automatic roadmap creation

Method:

1. Find corridors and intersections in the free space

2. Fill the corridors

3. Build the intersections

4. Assign Directions

5. Smooth the roadmap

Page 40: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Find corridors and intersections

Medial Axis Transformation (MAT)

Page 41: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Find corridors and intersections

Dal MAT

Regione con 1 Segmento => Corridoio

Regione con più di un segmento => Intersezione

Page 42: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Automatic roadmap creation

Method:

1. Find corridors and intersections in the free space

2. Fill the corridors

3. Build the intersections

4. Assign Directions

5. Smooth the roadmap

Page 43: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Fill the corridors

Page 44: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Automatic roadmap creation

Method:

1. Find corridors and intersections in the free space

2. Fill the corridors

3. Build the intersections

4. Assign Directions

5. Smooth the roadmap

Page 45: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Build the intersections

Page 46: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Automatic roadmap creation

Method:

1. Find corridors and intersections in the free space

2. Fill the corridors

3. Build the intersections

4. Assign Directions

5. Smooth the roadmap

Page 47: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Assign Directions

Page 48: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Assign Directions

Best direction for mono-directional corridors?

Page 49: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Assign Directions

Topological graph T:

• Strongly connected

• Maximize algebraic connectivity

Page 50: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Automatic roadmap creation

Method:

1. Find corridors and intersections in the free space

2. Fill the corridors

3. Build the intersections

4. Assign Directions

5. Smooth the roadmap

Page 51: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Smooth the roadmap

Straight lines + Bezier curves

Page 52: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

5 0 1 0 0 1 5 0 2 0 0 2 5 0 3 0 0 3 5 0 4 0 0 4 5 0 5 0 0 5 5 0

1 0 0

2 0 0

3 0 0

4 0 0

5 0 0

6 0 0

7 0 0

8 0 0

2 0 0 4 0 0 6 0 0 8 0 0 1 0 0 0 1 2 0 0

1 0 0

2 0 0

3 0 0

4 0 0

5 0 0

6 0 0

7 0 0

1 0 0 2 0 0 3 0 0 4 0 0 5 0 0 6 0 0 7 0 0 8 0 0 9 0 0

1 0 0

2 0 0

3 0 0

4 0 0

5 0 0

6 0 0

7 0 0

8 0 0

Page 53: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Advertisement

Workshop on

Advanced Robotics for Industrial Logistics @ European Robotics Forum 2014

March 14th, 2014 (tomorrow), from 14.00 to 16.00

http://www.arscontrol.unimore.it/erf14

Page 54: On multi-AGV systems for factory logistics: the PAN-Robots ...130.243.105.49/Research/Learning/misc/ERF14_PAN_ROBOTS_SPLIT.pdf · Interaction with humans (operators, manual forklifts,

Project Coordinator:

KAY FUERSTENBERG

SICK AG

Merkurring 20

22143 Hamburg, Germany

[email protected]

Project Dissemination Manager:

CESARE FANTUZZI

UNIVERSITY OF MODENA AND

REGGIO EMILIA

via Amendola 2, (pad. Morselli)

42122 Reggio Emilia, Italy

[email protected]

PAN-Robots is funded by the European Commission, under the 7th Framework Programme Grant Agreement n. 314193.

Presentation author:

LORENZO SABATTINI

UNIVERSITY OF MODENA AND REGGIO EMILIA

via Amendola 2, (pad. Morselli)

42122 Reggio Emilia, Italy

[email protected]