nimo nordic interaction and mobility research platform professor timo ojala university of oulu...
TRANSCRIPT
NIMONordic Interaction and Mobility Research Platform
Professor Timo OjalaUniversity of Oulu
Department of Computer Science and EngineeringMediaTeam Oulu research group
Finland
Sep 19, 2012
NIMO (Nordic Interaction and Mobility Research Platform)
• http://www.nimoproject.org• Timespan: 6/2011 – 5/2014 (36 months)• Consortium
• Luleå University of Technology, Sweden (LTU) (coordinator)• University of Oulu, Finland (UO)• University of Lapland, Finland (UL)
• Total budget: 1.45 MEUR• Main public financier: Interreg IV A Nord program• UO budget: 285 kEUR
• Co-funders: BusinessOulu, OBP Research Ltd.
UO objectives
• Open 3D virtual model of Oulu city centre (”Oulu3D”)
• Pervasive city game for youth
NIMO: Advisory group• Kari Autio, UO / CIE• Tommi Hollström, Adminotech• Jussi Kangasoja, OUAS• Jarmo Laitinen, City of Oulu / Center of Youth Affairs• Uki Lahtinen, City of Oulu / Technical Centre• Tony Manninen, Ludocraft• Ville Mickelsson, Cyberlightning• Juhani Miettunen, Nokia• Pekka Nisula, OUAS• Timo Ojala, UO• Ilpo Okkonen, Oulu3D• Jyrki Okkonen, Nokia• Johannes Peltola, VTT• Harri Pesola, Codemate• Jani Pirkola, Cyberlightning / realXtend Foundation• Toni Piirainen, Codemate• Janne Salmi, CubiCasa• Mika Sorvisto, CENTRIA• Christian Sundell, Business Oulu• Eero Tervo, Evocons
NIMO: UO WP3 objective #3-1: Oulu3D
• Joint initiative to build open interactive 3D virtual model of downtown Oulu atop the realXtend platform• Outdoor modeling of selected blocks• Indoor modeling of selected key buildings• Hosting of the model in public Internet
• Phasing of the model• Phase #1: ”9” (available in 2012)• Phase #2: ”50” (available in 2013 if additional funding is obtained)• Phase #3: ”City” (available in ?)
• Division of activities• Data collection (photographs, blueprints, laser scanning)• realXtend modeling• Hosting of the model• IPR and O&M of the model• Utilization of the model
realXtend - Open source platform for the 3D Internet• http://www.realxtend.org• Client-server architecture• Tundra SDK, Naali viewer• Extensible scene architecture
Alatalo T (2011) An entity-component model for extensible virtual worlds. IEEE Internet Computing 15(5):30-37.
Example shared presentation
Oulu3D: Phase #1 area (”9” blocks)
Oulu3D: Phase #2 area (”50” blocks) (tentative)
Oulu3D: Modeling process
DATA
3D MODELING
TEXTURING
MOVE MODELTO REALXTEND
HOSTING OFREX MODEL
EVOCONS & CUBICASA
ADMINOTECH
NIMOCENTRIA
Oulu3D: Photographing of building facades
Pakkahuoneenkatu 14 facade south
Oulu3D: Photographing of blueprints
Pakkahuoneenkatu 14 facade south
Oulu3D: Photographing of blueprints (2)
Pakkahuoneenkatu 14 floorplan
Oulu3D: Laser scanning
3D visualization of Puistola block from laser data
Video
(30 seconds, disk)
Laser scanning equipment
Oulu3D: Laser scanning example (1)
Oulu market: Scan #1
Oulu3D: Laser scanning example (2)
Oulu market: Scan #2
Oulu3D: Laser scanning example (3)
Oulu market: Scan #3
Oulu3D: Laser scanning example (4)Oulu market: Scans #1-#3 merged
Oulu3D: Laser scanning phase #1 (fall 2011)
50 scanning points
Oulu3D: realXtend modeling example
Which part is realXtend model and which part is photo?
Differences between realXtend model (low polygon) andCAD models (high polygon) have to be understood
Oulu3D: Current ”9” block realXtend model
Oulu3D: realXtend indoor modeling of buildings
Byström’s houseselected as pilot forindoor modeling
Oulu3D: HostingNIMO purchases hosting from Adminotech (uses Amazon cloud)
REX Contributions
Server Instance(s) (hosting operator)
CorpX Scene
www.corp_x.fi/3DCorpX
Server Instance(s) (hosting operator)
CorpX Scene
www.corp_x.fi/3DCorpX
Server Instance(s) (hosting operator)
CorpX Scene
www.corp_x.fi/3DCorpX
Oulu3D: IPR and O&M model
Oulu3Dlive.net (Univ. of Oulu)
NIMO City of OuluMCT Organisation A
Company B Company C ...
realXtend Server (hosting operator)
Administration (administrative operator)
Root Model (Creative Commons)
Server Instance (hosting operator)
City of Oulu Scene(s)
www.ouka.fi/3D
Server Instance(s) (hosting operator)
NIMO Scene(s)
streetartgangs.net
Server Instance(s) (hosting operator)
MCT Scene(s)
MCT3D.net
Commercial services Nonprofit services
Server Instance(s) (hosting operator)
CompX Scene(s)
www.compX.com/3DCompX
Root Scene
3D In
tern
et O
rgan
izati
ons
Model Elements
Cases
Oulu3D: Example of utilization in researchUO/CIE: ServiceFusion
Real-world online services are ”fused” into the Oulu3D virtual model
Oulu3D: Example of utilization in researchUO/CIE: Reality vs virtual reality in mobile AR UI
• Comparison of camera-basedaugmented reality UI and3D virtual model based UI
• Wizard-of-Oz testing atdowntown Oulu withsimulated location-basedmobile services
Oulu3D: Example of utilization in public serviceCity of Oulu: Urban planning (1)
Oulu3D: Example of utilization in public serviceCity of Oulu: Urban planning (2)
Oulu3D: Example of utilization in businessCyberlightning Ltd.: CyberSlide
Oulu3D model as a virtual 3D presentation environment
NIMO: UO WP3 objective #3-2: Pervasive city game
• Pervasive gaming ~ seamless integration and interaction of real world and game world
• Design and implementation of incremental prototypes of pervasive games for youth utilizing the 3D virtual model
• Evaluation via game play by significant number of real players in authentic urban setting
• Close collaboration with the upcoming MESSI project of City of Oulu’s Centre of Youth Affairs
First pervasive city game ”Street Art Gangs”
• Teams of players try to create virtual graffitis around downtown Oulu, at the same time stopping other teams from creating graffitis
29
Street Art Gangs: Conceptual architecture
Street Art Gangs: Mobile client screenshots
Real (physical) game world at downtown Oulu• Game is played with a mobile client• Game objective is to create virtual graffitis around downtown
Street Art Gangs: PC client screenshots
Virtual game world in Oulu3D model• Game is played in the Oulu3D model on a PC• Players guide their teammates at downtown via instant messaging
Street Art Gangs: Snapshots from 3D world
Future work
• UO WP3 objective #3-1: Oulu3D• Operationalize O&M• Add first services • Release model to general public (Dec 2012 ?)• Obtain additional funding to build phase #2 (”50” blocks)
• UP WP3 objective #3-2: Pervasive city game• Finalize implementation of Street Art Gangs ver. 1• Conduct field trial with Street Art Gangs ver. 1
Oulu3D has brought the players together!
Objectives• Open• Community-based• Comprehensive• Realistic Utilization
• Business• Public service• R&D
Visible landmark for• Oulu’s 3D Internet competence
• realXtend platform