Synthetic Environment

Synthetic EnvironmentSeminarNiraj Kumar JhaUllas GuptaNitish AnandPanchali Chakraborty1SMVIT Dept of CSE 2014What is synthetic environment ?A synthetic environment is a computer simulation that represents activities at a high level of realism.SE allows visualization of and immersion into the environment being simulated.A synthetic environment can be divided into the following:Synthetic natural environment - Representation of climate, weather, terrain, oceans, space, etc.Synthetic human-made environment - Representation of human-made structures like buildings, bridges, and roadsSynthetic psychological environment - Representation of psychological influences on individuals and/or groups based on demography and other cultural factors.SMVIT Dept of CSE 20142 Reality ?Physical Reality - This is the state of things as they actually exist, rather than as they may appear or might be imagined.

Virtual Reality - Is a computer-simulated environment that can simulate physical presence in places in the real world or imagined worlds.

Augmented Reality - Is a live, copy, view of a physical, real-world environment whose elements are augmented (or supplemented) by computer- generated sensory input?SMVIT Dept of CSE 20143

How to generate Synthetic Environment ?SMVIT Dept of CSE 20144Post Processing !!!Chroma Key Composting.Real Time Processing !!!

Immersion.4SMVIT Dept of CSE 2014Chroma key composting?Chroma key compositing, or chroma keying, is a special effects / post-production technique for compositing (layering) two images or video streams together based on color hues.

The technique has been used heavily in many fields to remove a background from the subject of a photo or video particularly the news casting, motion picture and videogame industries.SMVIT Dept of CSE 20145

Immersion !Immersive technology refers to technology that blurs the line between the physical world and digital or simulated world, thereby creating a sense of immersion.

Immersive virtual reality is a hypothetical future technology that exists today as virtual reality art projects, for the most part. It consists of immersion in an artificial environment where the user feels just as immersed as they usually feel in consensus reality.SMVIT Dept of CSE 20146Virtual Reality Concept.Augmented Reality Concept.Realization methods !!There are a number of methods by which virtual reality (VR) can be realized.Simulation-based VRAvatar image-based VRProjector-based VRDesktop-based VRTrue Immersive Virtual Reality

SMVIT Dept of CSE 20147

Realizing

Virtual realityMany devices are available today that are able to give a Good VR experience using the current generation technologies.SMVIT Dept of CSE 20148

Kinect Corner CaveProject MorpheusWow kinect !!!Microsoft Xbox 360 Kinect has revolutionized gaming In that you are able to use your entire body as the controller.The Kinect Sensor picks Up on natural body movements as inputs for the game. Three major components :Movement trackingSpeech recognitionMotorized SensorsSoftware TechnologyThe Kinect was first announced on June 1, 2009 at E3 (Electronic Entertainment Expo) as Project Natal, the name stems from one of the key project leaders hometown named Natal in Brazil.

SMVIT Dept of CSE 20149

A company based In Israel known as PrimeSense developed the 3D sensing technology. Microsoft purchased the rights to use the technology for their gaming system.Behind the scene of PrimeSense's 3D sensing technology there are three main parts that make it work. Infrared laser projector. Infrared camera.RGB colored camera.The software that makes Kinect function was by and large developed by Rare, a Microsoft subsidiary.Major components !SMVIT Dept of CSE 201410

How it works ??The depth projector simply floods the room with IR laser beams creating a depth field that can be seen only by the IR camera.Due to infrareds insensitivity to ambient light, the Kinect can be played in any lighting conditions.The face recognition system is dependent on the RGB camera along with the depth sensor, light is needed for the Kinect to recognize a calibrated player accurately.

SMVIT Dept of CSE 201411

SMVIT Dept of CSE 201412Specification !!20 joints of Skeleton.Tracking distance: 0.5-6 M.Currently supports two Active players But can recognize Six individual players.640x480-pixel Resolution.57 Horizontal and 43 Vertical Angular field of View.+27 to -27 Motorized Pivot tilting.Runs at 30 FPS (Frames per second).

SMVIT Dept of CSE 201413

Infrared Beams in the RoomSMVIT Dept of CSE 201414Although the hardware is the basis for creating an image that the processor can interpret, the software behind the Kinect is what makes everything possible. Using statistics, probability, and hours of testing different natural human movements the programmers developed software to track the movements of 20 main joints on a human body. This software is how the Kinect can differentiate a player from say a dog that happens to run in front of the IR projector or different players that are playing a game together. The Kinect has the capabilities of tracking up to six different players at a time, but as of now the software can only track up to two active players.

The corner caveA Computer Assisted Virtual Environment (better known by the acronym CAVE) is an immersive virtual reality environment where projectors are directed to three, four, five or six of the walls of a room-sized cube.A CAVE is typically a video theater sited within a larger room.The walls of a CAVE are typically made up of rear-projection screens.The user wears 3D glasses inside the CAVE to see 3D graphics generated by the CAVE.SMVIT Dept of CSE 2014

15How it works ???A lifelike visual display is created by projectors positioned outside the CAVE and controlled by physical movements from a user inside the CAVE.A motion capture system records the real time position of the user. Stereoscopic LCD shutter glasses convey a 3D image. The glasses are synchronized with the projectors so that each eye only sees the correct image.The computers rapidly generate a pair of images, one for each of the user's eyes, based on the motion capture data.Clusters of desktop PCs are popular to run CAVEs, because they cost less and run faster.SMVIT Dept of CSE 201416

Tech specs !SMVIT Dept of CSE 201417

Enough with the hardware !!!Software and libraries designed specifically for CAVE applications are available.Mechdyne's Conduit is a commercial software package that makes any existing 3D OpenGL application (like CATIA, Pro/E, Unigraphics...) work directly in a CAVE.VR Juggler is a suite of APIs designed to simplify the VR application development process. CaveUT is an open source mutator for Unreal Tournament 2004. Developed by PublicVR, CaveUT leverages existing gaming technologies to create a CAVE environment.Vizard (software) is a multi-purpose virtual reality development platform by WorldViz for building, rendering, and deploying 3D visualization & simulation applications in stereoscopic multi-display environments such as the CAVE.SMVIT Dept of CSE 201418The augmented world !A realistic Virtual Reality experience has always been the dream of the developers. the technology present today is still not enough to create a Census Virtual reality experience.Due to the above limitations many developers have turned their focus to AUGMENTED REALITY applications.AR is similar to VR in a sense as it uses Synthetic Objects. The difference between them is that AR uses a live view of the world while VR creates its own world.

SMVIT Dept of CSE 201419A Glimpse of theAugmented world !SMVIT Dept of CSE 201420

Layar APP

The Augment AppThe Augment App projects a 3D model over a surface or any directed area pointed by the smartphones camera.The model is generated on a specific surface which is considered as a marker.

YES !CAN I MAKE AR APPS ????...PC/LaptopsARToolkit .JSARToolkit.SLARToolkit.FLARToolkit.

SMVIT Dept of CSE 201421Platform's ??SmartPhonesLayarWikitudeQualcomm APIARToolkitPlusGoogle Glass NyARToolkit.How it works ??SMVIT Dept of CSE 201422

SMVIT Dept of CSE 201423

How we did it ?Platform used Desktop/Laptop.Tools Windows based PC.Adobe Flash CS3.Flartoolkit.PaperVision 3D.Google chrome web browser.Programming language ActionScript 3.0Custom Marker created using tarotaro.com

SMVIT Dept of CSE 201424Generating Full scale synthetic worlds !SMVIT Dept of CSE 201425AR tools can be modified to develop full scale synthetic worlds using MULTIPLE MARKER technique.Each part of the world can be made to be generated on a different pattern.These patterns when grouped together can form a whole new enviroment.

A Mixture Of Worlds !!The Future SMVIT Dept of CSE 201426The walls between the REAL and SYTHENTIC simulated world is diminishing.Both VR and AR can be combined with other techniques like Motion Detection, Object Recognition etc.The Synthetic World generated can be made fully interactive and the level of realism achieved can be really close to the conscious reality.With the advancement in technology soon every device will support quality Virtual Reality without the expense of large resources.

Limitation is Our Imagination !!!....Refrenceshttp://saqoo.sh/a/en/flartoolkit/start-up-guidehttp://www.wikitude.com/http://www.xbox.com/en-IN/Kinecthttp://blog.us.playstation.com/2014/03/18/introducing-project-morpheus/http://www.worldviz.com/systems/cornercavehttp://en.wikipedia.org/wiki/Cave_automatic_virtual_environmenthttp://www.oculusvr.com/

SMVIT Dept of CSE 201427You Can also Access this Presentation from Slideshare.net Soon !!!SMVIT Dept of CSE 201428Thank you !