78

24th Workshop on Interactive Systems and Software (WISS 2016)

: AquaCAVE

(VR)

VR

VR VR

VR 3

VR

We propose an immersive virtual reality environment configured in a swimming pool. This environment re-

alizes various forms of underwater entertainments and enhanced swimming training environment. However,

we have to overcome some technical challenges caused by water and surround-screen. In this research, we

focused on investigations on issues related to infrared (IR) radiation absorption and reflection on the walls

of the swimming pool and proposed the solutions. The difficulty on position tracking is that existing motion

capture systems using IR or blue lights are not feasible for an underwater immersive projection environ-

ment. The reason is IR is absorbed, and visible lights are unstable in complex backgrounds. Therefore, we

propose a circular-polarization-based technique for position tracking using visible-light LED markers. In

addition, we also took investigations on an optical distortion in the water, and reflections causing a decline

of immersion.

1

An Underwater Immersive Virtual Reality Environ-

ment for Enhancing the Swimming Experience: The

Design and Implimentation of AquaCAVE

Shogo Yamashita, Takashi Miyaki, Sunichi Suwa, Jun

Rekimoto, , Graduate school of

interdisciplinary information studies, the University

of Tokyo.

Sunichi Suwa, Jun Rekimoto,

, Sony Computer Science Laboratories.

, Vol.29, No.1(2012), pp.7884.

[ ] 2017 1 10 .

[8]

(CAVE)

ShogoYamashitaPre-print / Post-print version

Vol. 29 No. 1 Feb. 2012 79

1 AquaCAVE:

1 [5] VR

3D

VR AquaCAVE

AquaCAVE VR

VR

3

AquaCAVE

VR

LED

VR

2

2. 1

AquaCAVE VR

VR 3D

[3] [16]

AquaCAVE

VR

[20] Jain

VR [7]

2. 2

[25] [26]

HMD [1] [6]

Morales

AR [12]

HMD

AquaCAVE

3D

VR

80

HMD

CAVE

[18]

Dungeons swimmers [11]

AquaCAVE 3D

3 VR

VR

VR

VR

3. 1

3. 1. 1

OptiTrack [13]

3

[4]

3. 1. 2

Oqus Underwater [15]

CAVE

LED

CAVE

[19].

3. 1. 3

[14] VR

3. 2

( )

Vol. 29 No. 1 Feb. 2012 81

[29]

CAVE

VR

3. 3

(

) (

)

3

[22]

[27] 3

VR

VR

3. 4

[24]

3

[28]

VR

4 VR

4. 1

VR (AquaCAVE)

1 .

[ ]3m [ ]2m [ ]1.5m( 1m)

3cm

3D

LED

3

3

3

3

CAVE

3

4. 2 LED

LED 2

82

(A) ()

(B) ()

2

LED

2

LED

( 2)

2 A

LED 2

B A

4. 3

(B) (A)

3

[17]

3

[2]

3 (A)

3 (B)

TELESIN T03 Dome Port

(GoPro Hero 4)

3 (A)

3 (A)

3 (B)

[10]

3 (A)

Vol. 29 No. 1 Feb. 2012 83

Zhang

[21] GoPro

GoProStudio1

5

5. 1

CAVE

CAVE

CG

5. 2

( )

( )

3D

3D

3D

2

3D

1 GoProStudio:https://gopro.com/help/GoPro-Studio)

6

6. 1

3D 1/4

1/4

1/4 45

45

3D

3D

[23]

( 4)

6. 2

1/4 3D

5(A)

3D 5(B)

3D

3D (G15-DLP)

( ) 1/4

45

3D

84

7

7. 1

6 AquaCAVE

CAVE 3D

6 (RICOH PJ WX4141)

3D

MacPro

7. 2

2

LED

3

3

3

LED

3D 1/4

3D

CMOS

4

(A) 3D

(B) 1/43D

5

GoPro2

8

LED

3

VR

LED

2 DomePort

Vol. 29 No. 1 Feb. 2012 85

3D( 1/4)

LED LED

3D

Eye Position

x 6 display cables

3D ()

MacPro

()

()

6

8. 1

LED

LED

AquaCAVE

33

LED

1

BlobDetection

Processing 4

3 1: ( 10:20-0:40) 2:

( 1 8:50-9:10) 3:

( 2 5:00-5:10)

1 Tittle: Beauti-

ful Undersea World - Coral Reefs, Clownfish And

Colorful Underwater Animals, Creater: Serey V,

License: CC. 2 Tittle: Underwater - Jour-

ney to the Red Sea Coral Reef, Creater:Roberto

Lope Carrozza, License: CC.

4 BlobDetection library:

7 A LED

1 20

7

7 A B C

(C)

(C)

3

( 2) 3

3

LED

http://www.v3ga.net/processing/BlobDetection/

86

(B) 1 (0:070:09)

(C) 1 (0:130:20)

[] 1 2 30:00 0:01 0:02 0:03 0:04 0:05 0:06 0:07 0:08 0:09 0:10 0:11 0:12 0:13 0:14 0:15 0:16 0:17 0:18 0:19 0:20

[] 1 2 30:00 0:01 0:02 0:03 0:04 0:05 0:06 0:07 0:08 0:09 0:10 0:11 0:12 0:13 0:14 0:15 0:16 0:17 0:18 0:19 0:20

(B)

(C)

(A)

7

(A) (B)

8

8. 2

8

8 A)

B

GoPro Hero 6 5

TELESIN GP-DMP-T03-YL

25cm A4

8 B

3

5 GoPro hero 5Linear FOV

9

9. 1 3

LED

3

3

1 3

3

[9]

LED

3

OpenTrack 6.OpenTrack 3 (

)

3 Freetrack

3

UDP7 VR

(CAVE)

3

VR CAVE

3

CAVE VR

3

6 opentrack:https://github.com/opentrack/opentrack

7 FreeTrack:http://www.free-track.net/

Vol. 29 No. 1 Feb. 2012 87

3

CAVE

3

VR

9. 2

4

CAVE

9(A)

B

3D

( )

OpenGL

3D

(A) (B) CAVE

9

Libgls 8

10cm

( )

2

CAVE

CAVE

8 Libgls:http://libgls.sourceforge.net/

OpenGL:

http://libgls.sourceforge.net/

88

9. 3 VR

AquaCAVE

VR

10

VR (AquaCAVE)

VR

AquaCAVE

VR

LED

VR

VR

3

JST ACT-I

[ 1 ] Blum, L., Broll, W., and Muller, S.: Augmentedreality under water, SIGGRAPH09: Posters,ACM, 2009, pp. 97.

[ 2 ] Bruno, F., Bianco, G., Muzzupappa, M.,Barone, S., and Razionale, A.: Experimentation ofstructured light and stereo vision for underwater 3Dreconstruction, ISPRS Journal of Photogrammetryand Remote Sensing, Vol. 66, No. 4(2011), pp. 508518.

[ 3 ] Cheng, L.-P., Luhne, P., Lopes, P., Sterz, C.,and Baudisch, P.: Haptic turk: a motion platformbased on people, Proceedings of the 32nd annualACM conference on Human factors in computingsystems, ACM, 2014, pp. 34633472.

[ 4 ] Coker, D., Reimers, J., and Watts, R.: Theinfrared absorption spectrum of water, AustralianJournal of Physics, Vol. 35, No. 5(1982), pp. 623638.

[ 5 ] Cruz-Neira, C., Sandin, D. J., and DeFanti,T. A.: Surround-screen projection-based virtual re-ality: the design and implementation of the CAVE,Proceedings of the 20th annual conference on Com-puter graphics and interactive techniques, ACM,1993, pp. 135142.

[ 6 ] Gallagher, D. G.: Development of minia-ture, head-mounted, virtual image displays fornavy divers, OCEANS99 MTS/IEEE. Riding theCrest into the 21st Century, Vol. 3, IEEE, 1999,pp. 10981104.

[ 7 ] Jain, D., Sra, M., Guo, J., Marques, R., Wu, R.,Chiu, J., and Schmandt, C.: Immersive Scuba Div-ing Simulator Using Virtual Reality, Proceedings ofthe 29th Annual Symposium on User Interface Soft-ware and Technology, ACM, 2016, pp. 729739.

[ 8 ] Kirschenbaum, D. S., Ordman, A. M., Tomarken,A. J., and Holtzbauer, R.: Effects of differentialself-monitoring and level of mastery on sports per-formance: Brain power bowling, Cognitive therapyand Research, Vol. 6, No. 3(1982), pp. 335341.

[ 9 ] Lavest, J.-M., Rives, G., and Lapreste, J.-T.:Underwater camera calibration, European Confer-ence on Computer Vision, Springer, 2000, pp. 654668.

[10] Lavest, J.-M., Rives, G., and Lapreste, J.-T.:Dry camera calibration for underwater applica-tions, Machine Vision and Applications, Vol. 13,No. 5(2003), pp. 245253.

[11] Lee, H., Moon, M., Park, T., Hwang, I., Lee, U.,and Song, J.: Dungeons & swimmers: designing aninteractive exergame for swimming, Proceedings ofthe 2013 ACM conference on Pervasive and Ubiq-uitous Computing adjunct publication, ACM, 2013,pp. 287290.

[12] Morales, R., Keitler, P., Maier, P., and Klinker,G.: An underwater augmented reality systemfor commercial diving operations, OCEANS 2009,MTS/IEEE Biloxi-Marine Technology for Our Fu-

Vol. 29 No. 1 Feb. 2012 89

ture: Global and Local Challenges, IEEE, 2009,pp. 18.

[13] OptiTrack: OptiTrack Motion Capture, http://optitrack.com/.

[14] Pibyl, B., Chalmers, A., and Zemk, P.: Featurepoint detection under extreme lighting conditions,Proceedings of the 28th Spring Conference on Com-puter Graphics, ACM, 2012, pp. 143150.

[15] Qualisys: Qualisys underwater motion capture,http://www.qualisys.com/.

[16] Rheiner, M.: Birdly an attempt to fly, ACMSIGGRAPH 2014 Emerging Technologies, ACM,2014, pp. 3.

[17] Treibitz, T., Schechner, Y., Kunz, C., and Singh,H.: Flat refractive geometry, IEEE transactions onpattern analysis and machine intelligence, Vol. 34,No. 1(2012), pp. 5165.

[18] Ukai, Y. and Rekimoto, J.: Swimoid: a swimsupport system using an underwater buddy robot,Proceedings of the 4th Augmented Human Interna-tional Conference, ACM, 2013, pp. 170177.

[19] Yamashita, S., Zhang, X., Miyaki, T., and Reki-moto, J.: AquaCAVE: an underwater immersiveprojection system for enhancing the swimming ex-perience, ICAT-EGVE, (2016).

[20] Yamashita, S., Zhang, X., and Rekimoto, J.:AquaCAVE: Augmented Swimming Environmentwith Immersive Surround-Screen Virtual Reality,Proceedings of the 29th Annual Symposium on UserInterface Software and Technology, ACM, 2016,pp. 183184.

[21] Zhang, Z.: A flexible new technique for cameracalibration, IEEE Transactions on pattern analy-sis and machine intelligence, Vol. 22, No. 11(2000),pp. 13301334.

[22] , , :, , Vol. 42,

No. 4(2004), pp. 300306.[23] , , :

,(CVIM), Vol. 1, No. 1(2008), pp. 6472.

[24] : ,, Vol. 19, No. 3(1980), pp. 348356.

[25] :: ,

(2015).[26] : ME ,

BME, Vol. 2, No. 4(1988), pp. 252256.[27] , , , , ,

, , :3 ,

D, Vol. 83, No. 1(2000), pp. 396403.[28] , , , :

,B, Vol. 64, No. 2(2008), pp. 99114.

[29] , , : , ,

Vol. 9, No. 2(1999), pp. 243250.

2016

2014

28

28

( )

2008

2017

2002

2016

2017

1986

1994

. 1999

2007

(

) JST (2017-)

ShogoYamashita Notice for the use of this material: The copyright of this material is retained by theJapan Society for Software Science and Technology (JSSST). This material is publishedon this web site with the agreement of the JSSST. Please be complied with CopyrightLaw of Japan if any users wish to reproduce, make derivative work, distribute or makeavailable to the public any part or whole thereof.