Download - Tele immersion
![Page 1: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/1.jpg)
Tele-immersion
Presented by:Himanshu Sharma1207185
![Page 2: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/2.jpg)
ContentsIntroductionHistoryTele-conferencing vs. Tele-
immersion WorkingApplicationsChallenges
![Page 3: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/3.jpg)
IntroductionTele-immersion is an emerging
technology that will enable users at geographically distributed sites to collaborate in real time in a shared, simulated environment as if they are in the same physical room.
This is achieved through realistic
reconstruction of the scenes in virtual space.
![Page 4: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/4.jpg)
![Page 5: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/5.jpg)
HistoryThe idea of Tele-immersion was proposed by Jaron
Lanier , the head of Advanced Networks and Services in 1997. National Tele-Immersion Initiative (NTII) was formed to implement this.
In May 2000, researchers at University of North Carolina (UNC), the University of Pennsylvania and Advanced Networks and Services developed this technology.
A user sitting in office at UNC was able to see lifelike 3D images of his colleagues hundreds of mile away.
![Page 6: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/6.jpg)
Artistic expression as proposed by Jaron in 1997
![Page 7: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/7.jpg)
Tele-conference vs. Tele-immersion
Tele-immersion differs significantly from conventional video Tele-conferencing in that the user’s view of the remote environment changes dynamically as he moves his head.
Tele-conferencing Tele-immersion
![Page 8: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/8.jpg)
WORKING
![Page 9: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/9.jpg)
Immersive Virtual Environment
Audio Synthesizer
Audio Localizer
SpeechRecognizer
DisplayElectronics
Head/Eye/HandTrackingElectronics
Haptic/Tactilekinaestheticssystem
commands
graphics
eye position
head position
hand position
VirtualEnvironmentGenerator
UserEnvironment
head-mounteddisplay orprojectiondisplaysystem
![Page 10: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/10.jpg)
2D to 3D…
![Page 11: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/11.jpg)
Image Acquisition• Bank of digital cameras capture participants from a variety of angels.•There are about 7-15 cameras clusters each contain 4 cameras out of which 3 are black and white and one is color.•B&W cameras are for stereo construction .•The color camera is for extracting the appearance.
A camera cluster of 3 BW and 1 color cameras
![Page 12: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/12.jpg)
Camera clusters
![Page 13: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/13.jpg)
Each camera is synchronized to other camera.
Each camera is connected to workstation.
![Page 14: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/14.jpg)
3D Construction
3D sceneInteractive 3D display
at remote location
Internet 2
computation
![Page 15: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/15.jpg)
This reconstruction uses Trinocular Stereo Algorithm.
After constructing the disparity map, apply median filtering to remove a few outliers in the disparity map.
Then the median filtered disparity map is combined with a registered color texture to reconstruct a 3D point cloud.
![Page 16: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/16.jpg)
3D Video Transmission 3D data is transmitted in compressed form
using Modern Driven compression algorithm.
System which generates 640x480 pixel depth color maps from 10 camera clusters in a rate of 15 frames per second (fps), requires 220 mbps bandwidth.
Around 1.2 gbps is necessary for high quality effect.
![Page 17: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/17.jpg)
ApplicationsRemote medical training and diagnosis.
![Page 18: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/18.jpg)
Automobile engineering.
![Page 19: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/19.jpg)
Remote and distributed education.
Virtual travel and tourism.Art and Entertainment.
![Page 20: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/20.jpg)
ChallengesQuality of transmitting multimedia and Tele-
immersion data streams over the internet is affected by high packets loss rates.
ExpensiveHigh bandwidth requirement.
![Page 21: Tele immersion](https://reader033.vdocuments.us/reader033/viewer/2022052506/5576f42ed8b42ab22b8b51ed/html5/thumbnails/21.jpg)
Thank you
Queries??