an advanced web 3d mobile e-learning system to manage virtual courses and multimedia flavio fontana,...

An Advanced Web 3D Mobile e-Learning An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and System to Manage Virtual Courses and

MultimediaMultimedia

Flavio Fontana, Flavio Fontana, ENEA Usability Lab, Department of Computer ENEA Usability Lab, Department of Computer Science, University of Rome, ItalyScience, University of Rome, Italy

[email protected]@enea.it

Summer School, ENEA

15 September 2013, Rome, italy

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and MultimediaAn Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity

Usability & Media Laboratory: Ulab

The ENEA Usability Lab is an experienced experts and developers group in web applications, multimedia database designand distributed systems for the fruition ofe-learning contents by means of Internet.

The Usability Lab organizes usability testing sessions since 1992.

The Usability Lab issue is to improve the effectiveness, the efficiency and the users systems satisfaction by advanced methodsof usability testing and design.


First dimension: distance teachingFirst dimension: distance teaching

We started by postulating that the universe of instruction consistedWe started by postulating that the universe of instruction consisted of two families of teaching behaviors, which we referredof two families of teaching behaviors, which we referred

to as “to as “contiguous teachingcontiguous teaching” and “” and “distance teachingdistance teaching”.”.

Second dimension: Second dimension: learner autonomylearner autonomy and and independent studyindependent study

Michael G. Moore University of WisconsinMichael G. Moore University of Wisconsin

Main concept


4

Virtual World 3D

Abstract: In this paper an innovative 3D interactive e-learning objects management for multimedia databases in virtual scenes is discussed. In the last years has been improved an innovative structured platform to integrate e-learning information and 3D scenes.

The Web 3D mobile e-learning system has been studied in terms of: functionality, performances and accessibility to determine the effectiveness and satisfaction of the educational proposal.

The Virtual World 3D (VW-3D) next generation is a new integration approach of data with the visual representation.

VW-3D is finalized both to manage e-learning activities and the online study.

The system, VRML, XML and Java Technology based, has been developed in the ENEA Usability Lab, Casaccia Research Centre, in collaboration with the University of Rome "La Sapienza".


The system allows the web end-user to access to virtual courses and multimedia web pages.

It provides also advanced communication between docent/student for web lessons and seminars.

VW-3D visualizes multimedia data exclusively by predefined Meta e-learning objects information and creates dynamically interactive e-learning objects with specific functionality and interactivity from the available learning contents.

The new VW-3D provides a new virtual space to query multimedia database and visualize the results in the 3D scenario using the 3D objects. The system is integrated with the ENEA Matrix e-learning platform to give a new portability at the project with no limitation in a mobile scenario.

Virtual World 3D


VW 3D: System Overview

The system developed at ENEA Usability Lab is based on the Java and VRML/X3D languages and a deep integration between an innovative web site and its related multimedia and distributed databases. New experimentations on: WebGL, Html5, XML 3D, Flash 3D, etc.

The main modules of Virtual World-3D are:

Core System (CS), it manages the virtual world structure and its related web pages and databases;

Video Conference Module (VCM), this module manages the users communication by means of a flash open source video streaming conference server;

3D Learning Object Module (3D-LOM), this module manages the 3D learning objects, it manages the 3D objects with a metadata descriptor that defines how the system has to use it in the 3D scenario;

Visual Interface Multimedia Manager (VIMM), this module manages, by means of a visual representation, the visualization of the e-learning data by functional interactive e-learning objects and the data retrieved from the VCM module;

Avatar Management Module (AMM), this module guarantees the possibility to configure an avatar for each registered user.


7

VW 3D: General Architecture


8

VW 3D: Functional Schema


VW 3DVIMM Internal Architecture

AVI Mobile Interface Web 3D Interface


My Space

Personal DB

Central DB

Advanced Visual Interface - AVI

Courses

MATRIX

CORESYS

Object Videos

NETLESSON

Object

VW 3D3D Personal Object Management


VW 3D 3D Personal ObjectManagement and Mobile Interaction

Personal DB

Central DB

Advanced Visual Interface - AVI

Courses

MATRIX

CORESYS

Object Videos

NETLESSON

Object

My Virtual Space

My Real Space

My Mobile Virtual Space

NetLesson System (VMS –VCMS)Synchronous Lesson Realtime

NetLesson System (VMS –VCMS)

Asynchronous Lesson

WiFi Area


VW 3D:Management and Mobile Interaction

Internet network

Multimedia Class Room

Multmedia RepositoryStreaming Server

End User (Home, Office, etc.),Expert

Remote access via modem 56 kps

Global Multimedia Specifications

Synchronous/Asynchronous Classrom Systems

Internet network

Multimedia Class Room

150-450 kps / 1-100 Mbs / 1 Gbs 1 -10 kps

Java MM Java MM andand

VW – 3DVW – 3DMobile

Video Camera


VW 3D:Classroom and Mobile Interaction

ExternalTeaching

OtherTeachers

MobileDidactical

Organisation

MobileInteraction

ande-learning

Otherstudents


VW3D: 3D Object Personal Management and Mobile Interaction


Virtual World 3D Search Engine (VW-3DSE)

The new feature designed in VW-3D is the 3D search engine environment. The users by entering the library room display a new 3D space where queries can be visualized and interact with the results displayed by 3D objects.

The communication between the external e-learning platforms is managed by a SOAP protocol with dedicated web services. The main query processes are headed to the MMP system, designed by the Usability Lab (ULAB) in ENEA (E-LEARN2007), to make information retrieved from different databases a homogeneous data standard resource. Hence the search engine queries are not specifically implemented for all the different e-learning systems but only for a single standard. In the ULAB we are also working to embed queries from external search engine forms by the Meta Engine objects System (MES).


Virtual World 3D Search Engine (VW-3DSE)

Virtual space the 3D visualization of the query results.

The VW-3DS E has a very friendly and easy query interface to find e-learning contents. The user search field is a key word and options as thematic, the docent name, file type can be activated. A little visualization menu can be used by the user to define the visualization options as 3D, 2D, and the order as the 3D have to bed ordered.

Interesting studies have been done in the display of the 3D objects for query results. The new application SpaceTime www.spacetime.com), designed by SpaceTime, had the same approach of the VW-3DSE. The information of generic queries are visualized inside 3D objects and the user can walk virtually between the results. Obviously ULAB aim is to obtain a more specific approach for e-learning purpose.


Virtual World 3D Search Engine & 3D Visualisation

3D Carousel Visualization of the Video Lesson.

The result display of the Video Lesson in a 3Drepresentation have been preferred by the users (Usability Testing Phase #2).

It was considered a valid solution for a mobile scenario.

Other 3D applications are: Cube, 3D Icons, Virtual Screen, Virtual Smath-phone.


Application scenario

In the last years new environments, based on 3D technologies, In the last years new environments, based on 3D technologies, were developed to manage educational activities and promote were developed to manage educational activities and promote virtual meetings. virtual meetings. In particular, the more significant existing systems are:In particular, the more significant existing systems are:

• Convenos Meeting Center (SmartMeeting.com);Convenos Meeting Center (SmartMeeting.com);• AAlten Project (Norway 2004) ;AAlten Project (Norway 2004) ;• Seconf Life by Linden Labs;Seconf Life by Linden Labs;• WonderLand;WonderLand;• Other.Other.

Technologies and Standards: X3D/VMRL, WebGL, Html 5, Technologies and Standards: X3D/VMRL, WebGL, Html 5, XML 3D, Java, Flash 3D, CSS 3D, etc.XML 3D, Java, Flash 3D, CSS 3D, etc.


User Classification Criteria and Identification

USER CLASSES:USER CLASSES:

• Generic user (randomly access to the system);Generic user (randomly access to the system);• Professional user (frequently access to course, Professional user (frequently access to course, information and information and services, generally students/teachers and services, generally students/teachers and tutors).tutors).• Avatar characteristics, parameters, actions, personal Avatar characteristics, parameters, actions, personal functionality,functionality, personal area, other. personal area, other.

USER CLASSIFICATION CRITERIA:USER CLASSIFICATION CRITERIA:

• Frequency of useFrequency of use• Computer familiarityComputer familiarity• Computer software expertiseComputer software expertise• User mental abilitiesUser mental abilities• User physical abilities and skillUser physical abilities and skill

USERAVATAR


User Requirements

• General requirements (access to the General requirements (access to the system system through the Web, use of through the Web, use of the Net to study, easy the Net to study, easy to use, to use, efficiency, effectiveness , robustness, efficiency, effectiveness , robustness, modularity, portability, etc.);modularity, portability, etc.);

• Functional requirements (use of Functional requirements (use of mouse, access mouse, access to enquiry to enquiry functions, real-time and functions, real-time and asynchronous communications, etc.);asynchronous communications, etc.);

• Technical requirements (active Technical requirements (active environment, environment, networks, multi-language, networks, multi-language, integration with integration with distributed distributed multimedia database,);multimedia database,);

• Hardware: 3D Vision graphics card 512 Hardware: 3D Vision graphics card 512 MB min,MB min, resolutions up to 2560x1600..


Mobile Scenario

Equipments:Equipments:LapTop, Ipad, Smart-Phones (iPhone, HTC, Nokia, LapTop, Ipad, Smart-Phones (iPhone, HTC, Nokia,

etc.etc.

VirtualClassroom

RealClassroom

ExternalArea

OtherSite

Mobile Advanced communication


Mobile Scenario

Real – Time Virtual Real – Time Virtual TeachingTeaching

3D Virtual ObjectReal Scena

Web Cam / HD Video Camera


VW 3D Modules

VW 3D II GenerationVW 3D II Generation

VW 3DOne

ULABVW 3D Module

VW 3D Module

New VW 3D

Rome University2011

VW 3DMobile2010

ULABVW 3D

One2004-2009

ULABVW 3D Module

VW 3D Module


VW 3D Design



VW 3D Designfor simulation



VW 3D Designfor simulation

VW 3D Second LifeVW 3D Second Life


VW 3D DesignAVATAR



The Web Site

To login in the VW-3D platform it’s necessary to visit the VW-3D site. It’s possible to view:

• The project;• The VW-3D Applet;• Files to download;• Generic informations;• Links.


3D Spaces


Virtual Virtual classroomclassroom

Campus HallCampus Hall

Meeting-pointMeeting-point

Private RoomsPrivate Rooms

LibraryLibrary

The VW 3D Methodologies has defined the virtual space (External / Internal), the objects, the multimedia and users. The main internal space (ROOMS) are:

3D Spaces


33

The virtual classroom in Virtual World 3D is a space for synchronous and The virtual classroom in Virtual World 3D is a space for synchronous and asynchronous lectures. In this space the user is represented in terms of avatar to asynchronous lectures. In this space the user is represented in terms of avatar to visualise its position and actions during the lecture (teacher, student). In the visualise its position and actions during the lecture (teacher, student). In the classroom other 3D objects like books, documents, video and whiteboards are classroom other 3D objects like books, documents, video and whiteboards are represented to improve the functionality of the systemrepresented to improve the functionality of the system..

The Virtual Classroom


The Hall and the Meeting-Point are spaces dedicated to the virtual The Hall and the Meeting-Point are spaces dedicated to the virtual meeting between the users of the world. They can be see the avatar meeting between the users of the world. They can be see the avatar connected, in real time, to the system after their access to the VW3D connected, in real time, to the system after their access to the VW3D environment.environment.In this virtual area have been designed some free virtual objects (video, In this virtual area have been designed some free virtual objects (video, book, etc.) to introduce the multimedia contents of the Campus. Near book, etc.) to introduce the multimedia contents of the Campus. Near the hall there are other videos to present the real-time streaming about the hall there are other videos to present the real-time streaming about the courses and the lesson.the courses and the lesson.Il Meeting Point is a Il Meeting Point is a relax space to meet relax space to meet the other users the other users before and after the before and after the lectures.lectures.

The Hall and Meeting Point


The virtual World 3D contains in every scene interactive functionality realted to the object to stimulate toward the user a simulation of the real world to obtain: Information, data, multimedia and documentation.The most important objects implemented during this experimenation are the following:

- Digital screen;- Whiteboard;- Calendar;- Book;- Personal Computer;- Other.

The 3D Objects


VW-3D / Matrix VW-3D / Matrix layerlayer

The 3D Objects

The schema shows the internal mechanism use by VW3D to manage the book object.The book is a simple or parametric query to the Matrix Database with the book_data and the user_data.In this case the metaphor is a query to the database.

FADVIGEN FADVIGEN DATABASEDATABASE


37

The books represents the documents that the end-user saves inside his own repository. The end-user, in the 3D scene, is capable to compose a new document with the Si.A. tool or save paper passed by another user. By this, the end-user will have a new BOOK represented in his library or on his desk.This funtion is abled to call the procedure of the e-learning platform to read and write new documents. The Matrix platform has an internal authoring tool (Si.A) to script HTML pages with multimedia contents.Create new document adds a new virtual book in the 3d space.

Si.A. Authoring toolSi.A. Authoring tool

The 3D Objects: the Book


38

The digital screen is situated in: virtual classroom, meeting-point, meeting The digital screen is situated in: virtual classroom, meeting-point, meeting room and in the private rooms (docent, student) to visualise the didactical room and in the private rooms (docent, student) to visualise the didactical contents (multimedia, PPT presentatiom, calendard, etc.).contents (multimedia, PPT presentatiom, calendard, etc.).The screen is a result display of a query to the multimedia database.The screen is a result display of a query to the multimedia database.

FADVIGEN FADVIGEN DATABASEDATABASE

Vw-3D/Matrix Vw-3D/Matrix layerlayer

The 3D Objects: the Digital Screen


39

The 3D Objects:the Whiteboard

The WhiteBoard module is a experimental prototype of shared blackboard that allows to design and to write images. Already experimented in MES project, the WhiteBoard has been integrated in the 3D scene. The WhiteBoard shares the drawings of users that are present in the same room, like the classrooms.


40

The user can read the offline and the The user can read the offline and the online lessons’ information like time, online lessons’ information like time, arguments, teachers and which arguments, teachers and which classrooms will take place the lessons. classrooms will take place the lessons.

The information is retrieved from the The information is retrieved from the database and it is ASP and JavaScript database and it is ASP and JavaScript filefile

The 3D Objects: the Calendar


VW-3D has been integrated Matrix IV Generation of ENEA Platform (2005 ENEA E-LEARN, http://odl.casaccia.enea.it).

VW-3D has been used with a set of existent courses and multimedia databases. Specific experimentations have been carry-on by students and docents (e-learning system design group by ENEA and University of Rome “Sapienza”, Computer Science Dept.) to test VW-3D in terms of functionality. In the same time it has been completed an entire usability testing process in the ULAB laboratory in the research centre ENEA of Rome. The testing phases have been planned following the basic principles of cognitive and educational of a user’s properties like students and teachers.

The result obtained, in relation to the measure usability degree of the system, according to MUSiC performance measurement method (Macleod et al., 1997) and ENEA Usability Methodology (ULAB, 2002), has been excellent.

The tests measured a high perception of the virtual space of VW-3D in the user’s mind making it easier to memorize. About 100 users with 200 h of experimentation.

Experimental results

7 7,5 8 8,5 9 9,5

Ext. SpacesRooms

ObjectsSlides

MultimediaLibrary

DocumentsWeb Site

Usability Test Result


The system has confirmed that an advanced visual representation is really easier to use for large end-user groups. As future features it is planned to provide a completely modular architecture (to add functions easily), to migrate all modules in a Java environment.

The next step is to manage a similar Second Life platform that can generate contemporarily more virtual worlds with personalized configurations. New virtual objects and new mobile applications.

Conclusions and future works

The VW-3D experience will be extended towards other application domains to provide cooperative works and advanced simulation environments, the compatibility with standards as SCORM data structures has to be completed. The globalization of this architecture is fundamental to make more usable and users accepted.

The aim is to make more information available in a 3D structure to test the fruition velocity and efficiency of this alternative interface by generic users.


Thank you for your attention!

Flavio Fontana

[email protected]

Virtual World 3D