bari, november 11, 2015egi community forum 20151 virtual environment for a superior neuro-psichiatry...

Bari, November 11, 2015 EGI Community Forum 2015 1

Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry

PO FESR2007-2013 Line 4.1.1.1Project #1468

Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry

The VESPA Virtual Research Environment: a final report about the project at the

beginning of clinical operations

Marco PappalardoProject Coordinator

[email protected]

mailto:[email protected]


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryOutline

Swing:It and the Project partners. VESPA overview. Goals. The VESPA Virtual Room. The Cloud Infrastructure. The Rehabilitation Tasks and results.


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

rySoftware Engineering Italia

SME founded in 2010,

Supporting Enterprises and Scientific Communities in Space and Satellites Earth Sciences and Earth Observation Telecomms Virtual and Augmented RealityHQ: Catania, OA: Rome.Partners


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry

4

The Consortium3 SMEs

2 Research Organizations


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry

5

What is VESPA?VESPA: Virtual Environment for a Superior neuro-PsichiAtryKO: Oct 2013 Project end: Dec 2015VESPA System modules: Fully Immersive Virtual Reality Service

supporting Neuropsichiatry in diagnosis, evaluation and rehabilitation of cognitive-motorial functions for individuals suffering for cognitive deficit.

Exploiting new technologies for diagnosis and rehabilitation through a Cloud infrastructure.

Evaluation Tests and Rehabilitation Tasks in as Virtual Reality Games.

Video-conferencing system for tele-support and supervision. Multi-user portal to access services. Rehabilitation Protocols Daily update service.


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry

6

Scenarios and beneficiaries

In Italy:◦ 1,3% minors are affected by mental retardation (QI < 70)

much more minors suffer for cognitive disease ◦ 600.000 elders suffering for Alzheimer Disease (AD), due to

neuro-degenerative processes induced by environmental and endogenous causes. 70.000 new cases every year.

To limit effects, individuals affected by mental retard attend◦ normal school courses, in a socially-integrated environment. ◦ “cognitive rehabilitation” protocols, to stimulate neuro-plasticity

Carrying out simple cognitive tasks to stimulate attention, perception, mnestic, thinking processes on spatial and verbal information.

The VESPA system will enable numbers of children and elderly to carry out their daily rehabilitation motor-cognitive tasks at schools, homes, and rest-homes assuring continuity into education and assistance, in a time-saving manner.


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryVirtual Reality for an improved

research and clinical practiceConventional «paper and pencil» tests

Limits in terms of reliability and validity:

- Manual rating scores

- Different procedures of administration

- Abstract assessment of cognitive functions.

Limits in terms of accessibility to specialized psychologists

Virtual Reality (VR)

Simulation of daily living environments;

On-line adaptation of task difficulty;

Automatic, fast, and precise scoring;

Quantitative analysis of performance kinematics (timing, trajectories, etc.).


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryVirtual Reality: fields of application

Psychotherapy, surgical training, post-stroke intervention, muscle-skeletal recovery

Cognitive assessment and rehabilitation for AD, MCI, MR and other developmental disorders like SLD.


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryVESPA Goals

The VESPA project aims to provide a Cloud-Enabled Virtual Environment for qualitative and quantitative evaluation, and rehabilitation of motor and cognitive diseases such as mental or linguistic retardation, and Alzheimer’s Disease.

The VESPA system is:◦ built on top of a fully immersive Virtual Reality system, and is ◦ remotely supervised.◦ designed to be easily deployed in: rehabilitation centers,

hospitals, schools, and rest-homes. The VESPA project will exploit the power, scalability, and

flexibility of Clouds and Grids to feed a theorically unlimited number of installations sites through a centralized repository of evaluation and rehabilitation scenarios.

Health system will take advantage by VESPA specialists who are enabled by the integrated videoconferencing system to support, monitor and train patients and local support technicians to exploit the power of the VESPA system.


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryThe Virtual Room

● Angular Theatre◦ 2 high definition 3D-projector;◦ Active 3D Glasses;◦ Aution System Dolby Surround 5.1;

● ART Tracking System;● IP Webcams System;● Control Room:

◦ Master PC;◦ Render PC.


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryVirtual Room in Action


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryThe VR Software Table

AD MR SLD

Evaluation Tools

ADAS-Cog Alzheimer’s Disease Assessment Scale – parte cognitiva

PEP 3 Psicoeducational Profile Third

Edition

TROG-2Test on Grammatic

comprehension Second Edition

MMSE Mini-Mental State Examination

Corsi Test Test per la valutazione dell’articolazione fonetica (test

di Fanzago)Digit Span

Rehabiliation Tools

VESPA Cognitive Tasks

VESPA MR Rehabilitation Tools VESPA SLD Rehabilitation Tools

VESPA AD Rehabilitation Tools


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryVESPA Software Figures

● Total Number of complex applications developed: 11● Total Number of scenes/tools developed: +300● Typologies

◦ Questionnaires Single and Multiple choice Verbal answers/voice-driven tools

◦ Interactive Gaming Scenarios

● Audio and Video recording Word Recognition Native and Dynamic Adaptability


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

rySoftware Architecture


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryComplementary Hw

● Daily Needs in Rehabilitation◦ (As Naturally As Possible) Interact with virtual

object. Grab; Move; Rotate; Performing an action by pressing e.g. a button

(squeeze, press, etc);Several input devices integrated

◦ user action traced, captured and converted into actions in the 3D space.

Requirements on usability.


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryDevices


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryThe Light Glove

● Arduino based Swing:It product.● Traces fingers, rotations, moves and basic gestures with

extremely high precision. From data acquired, the LGlo driver can easily recognize gestures.

● Pro. Natural HM interaction.● Cons. Batteries to recharge. Someday within an year. To wash

from time to time (depends on owner habits ).


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryVESPA and the CSGF

VE

SPA

Science

Gatew

ay.......App.

1App.

2 MyCloud

Embedded Services AdministratorScientistCloud tenant

Users belonging to Identity

Federations

Grid/Cloud Engine (based on SAGA)

CLEVER

Orchestrator (based on OCCI)

Cloud #2 Cloud #n

Cloud #1

Single logical domain

HPCCluster

s


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryAuthN/AuthZ Schema

VESPA cloud infrastructure

Federation

1. Try to login

3. Identity attributes

2. Forwarded to the IdP

4. Check

authoris

atio

ns

Sync user roles

Retrieve e-Infrastructure credentials Science Gateway


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryVESPA federated cloud architecture


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryVespa measurements finalized

(assessment and rehabilitation)Usability

0 5 10

8.5

Clarity of instructions

8

0 5 10

Successfully finalized100/120

Successfully finalized

27/40

AD patients

RM patients

DSL patients

Successfully finalized105/120

8

0 5 10

0 5 10

9.5

0 5 10

8

0 5 10

9


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryAuthors

BARBERA, Roberto (University of Catania)SALEMI, Diana (University of Catania)TORRISI, Mario (University of Catania)ARRIVA, Simona (Software Engineering Italia srl)BARATTA, Daniele (Software Engineering Italia srl)CAVALLARO, Alfio (Software Engineering Italia)GURAN, Gianluca (Software Engineering Italia srl)TOMASELLI, Bruno (Software Engineering Italia srl)TROVATO, Leonardo (Software Engineering Italia srl)ZAPPALA', Aldo (Software Engineering Italia srl)

https://indico.egi.eu/indico/contribAuthorDisplay.py?contribId=88&sessionId=41&authorId=2&confId=2544

















Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ry


Virt

ual E

nvir

onm

ent

fo

r a

Supe

rior

Neu

ro-

Psic

hiAt

ryThank You

Questions?

bari, november 11, 2015egi community forum 20151 virtual environment for a superior neuro-psichiatry...

Documents