presentation #: cl05 · 3d visualization on the overview display wall • 3d rendering on...
TRANSCRIPT
1
Presentation #: CL05
Bill Jacobs The Jacobs Group Wesley Cobb, PhD BRS Labs Peter Bussens Barco Dan O’Neill TSG Solutions March 27, 2012
The Control Center of the Future
2
Presented By
3
SPONSORS
4
CL05: The Control Center of the Future
Bill Jacobs The Jacobs Group
5
Traditional of Control Centers SOC (Security Op’s Center)
THE TACTICAL RESPONSE
EOC (Emergency Op’s Center) THE STRATEGIC RESPONSE
CENTER
Responds to daily incidents affecting the business, including Emergency Response and Police, Fire and Operational response.
Responds to incidents affecting mission critical business operations globally. Crisis Management and e-Staff converge to initiate BC plans.
6
Business Objectives
} Support the business of Risk Management
} Provide customer response and assistance to on-site events ◦ Information center and sometimes a 911 relay point
} Monitor factors affecting Business Continuity ◦ Site physical security solutions ◦ Network monitoring ◦ BMS monitoring
} Dispatch tactical events ◦ ERT teams ◦ Security Officers ◦ Patrol services
7
Information is Key
} Control Centers need to be able to source information, as they need it.
} Control Centers need to be able to filter information, respond to events, and disseminate reports in real time.
} Tactical Centers (SOC) need to work seamlessly with Strategic (EOC) Centers
8
9
Ideal Solutions
} IP closes the geographic gaps
} Be able to select any information source
} Create your own business rules via drag & drop/object oriented programming ◦ Provide on-line situational analytics and modeling
} Choose where to display information in HD; on video walls, PC’s, tablets, cell phones
10
Alternative Solutions
} Cloud based – Remote Managed Services ◦ Offer real solutions to clients who can’t afford a dedicated
Command Center ◦ Offer business continuity solutions ñ Back-up monitoring and dispatch ñ Data warehousing ñ Remote video storage
11
Conclusion • TECHNOLOGY WILL ENHANCE THE TOOLS WITH
WHICH WE MONITOR AND MANAGE DATA THAT’S RELEVANT TO PROTECTING SHAREHOLDER VALUE, AS DEFINED BY PEOPLE, PROPERTY AND ASSETS.
• RULES ENGINES WILL PROVIDE FOR GREATER AUTOMATED DECISION MAKING AND FASTER RESPONSE.
• HD VIDEO WILL ENRICH THE OPERATIONS EXPERIENCE
12
CL05: The Control Center of the Future
Wesley Cobb, PhD BRS Labs
13
The Past: Video Analytics • VA sometimes an element of control room systems
– Not universal; much skepticism about usefulness
• Primary Purpose is scalability – Reduce human requirements for monitoring many cameras – Improve reliability of response to critical situations
• Installation / Maintenance / Usability Challenges – You had to set up the scene for the VA system – You had to define the rules for the VA system – You had to set the tripwires for the VA system – Even when everything worked, you struggled to find the signal amid the noise You told the VA system precisely what to alert on and therefore…
• You can never get anything that you hadn’t anticipated in advance
14
The Present: Behavior Recognition • BR is a game-changing technology
– destined to become a key feature of control room systems in the future
• Primary Purpose still scalability – reduce human requirements for monitoring many cameras – improve reliability of response to critical situations
• Installation / Maintenance / Usability Improvements – BR systems learn about the scene on their own – BR systems teach themselves to recognize normal behavior in the scene – BR systems alert you when they see something that isn’t usual – alerting “noise” is simply not a problem for BR systems BR systems tell you about unusual things that they see at your site…
• even if you yourself had never thought of them before!
15
“Even if you yourself had never thought of them before”? Really?… Really!
16
Engineering March 2012
Some of the things that can be done right now…
17
Engineering March 2012
Temporal Activities/Motions
Spatial Activities/Motions
Heat Maps & Trajectories
Behavior Learning
Temporal Activities/Motions
Some of the things that can be done right now…
Alert Details
Relevant Memories
18
Sometime/Somewhere 2012
19
Imagineering April 2012
Alert Details
Relevant Memories
Temporal Activities/Motions
Spatial Activities/Motions
Heat Maps & Trajectories
Behavior Learning
Temporal Activities/Motions
20
The Future… • BR not limited to video
– It’s a very flexible technology – It will be adapted to other sensor technologies
• E.g. RFID, Chemical / Biological / Nuclear, Thermal, Radar, Electrical, HVAC
• BR can evolve into an integrating technology for control rooms!
– System could learn what the overall data patterns normally are – System could recognize when that pattern is not being followed – System could alert on “system level” problems
• Goal is NOT to replace humans
– Goal is to remove need for constant mind-numbing attention to detail – Free up human attention for real problem solving when needed
21
CL05: The Control Center of the Future
Peter Bussens Barco
• 3D visualization: how do we perceive depth?
• How is 3D being used in professional applications today?
• How can the security control room benefit from 3D technologies?
Agenda
• Depth perception is the visual ability to perceive the world in three dimensions • Depth perception arises from a variety of depth cues
- Monocular cues that require the input from just one eye - Binocular cues that require input from both eyes
• Creating the illusion of depth on a display requires representation of these
depth cues
How do we perceive depth?
Monocular cues 3D rendering on a 2D display:
Converting 3D models into 2D images with 3D photorealistic effects
Binocular cues Requires stereoscopic display:
Providing a different image to the left and the right eye
Monocular depth cues Linear perspective
Parallel lines converge with increasing distance
As objects become more distant they appear
smaller
Aerial perspective
Due to the scattering of blue light in the
atmosphere, distant objects appear more blue
Relative size
Relative size cues provide information about the relative depth of two
objects
Occlusion
Blocking the sight of objects by others provides
information about relative distance
Monocular depth cues
Lighting and shading
Highlights and shadows provide information about
an object’s dimensions and depth
Texture gradient
Textures appear denser as they are farther away
Depth blur
Defocus blur contributes to the depth perception, because of the limited
depth of focus of the eye
Motion parallax
– When an observer moves, objects at different distances move at a
different relative velocity
Binocular depth cues
Providing additional information about – Size – Shape – Orientation
by presenting a slightly different image for each eye ð stereopsis
Is this spiral going up or down?
Essentially exploitation of parallax = apparent displacement or difference in the apparent position of an object viewed
along two different lines of sight
3D displays
• 3D-display = stereoscopic display = display providing binocular depth clues • New? not really…
Underwood & Underwood 1908 View-Master 1939 3D cinema 1952 Anaglyph, Rollmann 1853
Stereoscopic visualization in professional applications today
Edutainment
• 3D Cinema • Museums & expos • Visitors’ attractions
Universities and Scientific Research
• Medical/bio research • Fluid and aero dynamics
simulation • Space/aerospace/climate research • Mechanical engineering • Urban planning
Design Engineering
• Automotive, consumer goods, architectural design
• Engineering & manufacturing • Design studies • Virtual prototyping • Ergonomic studies
Medical
• Computer tomography (CT) • Magnetic resonant (MR) • Cardio-vascular • Surgical displays
Oil and Gas
• Subsurface exploration • Seismic research • Drilling • Collaboration
Immersive visualization solutions
Flat shape Cube shape Curved shape
“Immersiveness”
Immersive visualization solutions
Complex optical-mechanical systems
3D visualization in the security control center?
• Improving Situational Awareness
• 3D rendering on the desktop is emerging – As graphical UI for Physical Security Information
Management (PSIM) software – 3D mapping of GIS information – CCTV camera coverage and blind spot
visualization – Easier tracking of subjects
Entelec SkyWalker Feeling Software Omnipresence 3D Intergraph GeoMedia 3D
VCORE fourDscape
3D visualization on the overview display wall
• 3D rendering on mega-pixel, multi-channel display walls still a challenge – Resolution limitations in Operating Systems – Requires high computational power and accelerated graphics – Facilitated by high-end GPU’s becoming available (gaming industry)
Mapping CCTV video in the 3D environment
ðPosition video images in the 3D map where they are captured
• Many cameras • Video is displayed
inside their own canvas – keyholes
Fusion of CCTV in the 3D environment • Overlay video on top of the 3D map • Synthetic scene visualization by adding metadata as graphical
elements to the video
Stereoscopic visualization in the control center
• Benefits – Improved situational awareness – Faster decision-making in complex, dynamic environments
• Requirements
– Displays should be capable of 24/7 operation – Limited floor space – Robust, should not require frequent re-calibration – Low noise level
• Available today – Liquid-cooled LED illumination for low TCO and long lifetime – Automatic color calibration – Time-multiplexed at 120Hz with IR emitter and active shutter
glasses
Stereoscopic projection cubes
Challenges
• Eye-fatigue with long-term use – Vergence-focus mismatch – Crosstalk
• Interference of the glasses with – Workspace lighting – Other displays in the operator environment
Right Eye Left Eye
Right-eye Image Left-eye Image
Ghost image
Conclusions and a forward look…
• 3D visualization technologies will become omnipresent in the control center
– 3D rendering on 2D displays • Stereoscopic displays start to appear in the control center
– On the desktop – For the overview display wall
• 3D stereoscopic surveillance cameras may fuel the demand for stereoscopic displays
• Future multi-view auto-stereoscopic displays that require no eyeware will greatly improve usability and will be instrumental for general acceptance
39
CL05: The Control Center of the Future
Dan O’Neill TSG Solutions
40
Experience
41
Video – Minority Report
Coordination of More Disciplines • Basis of Design
DESIGN DISCIPLINES
Arch Civil Structural Electrical Mechanical Plumbing Fire
Protection Telecomm
/IT Electronic Security
DES
IGN
CR
ITER
IA S
ECTI
ON
NU
MB
ER
2.1 Site & Landscape � � � � � � � � � 2.2 Architecture/ Interior � � � � � � � � �
2.3 Mission Critical Areas � � � � � � � � �
2.4 Structural � � � � � � � � �
2.5 Building Envelope � � � � � � � � �
2.6 Utility Systems � � � � � � � � �
2.7 Mechanical Systems � � � � � � � � � 2.8 Plumbing and Gas � � � � � � � � �
2.9 Electrical Systems � � � � � � � � � 2.10 Tele-communication Systems � � � � � � � � � 2.11 Electronic Security Systems � � � � � � � � �
2.12 Life Safety Systems � � � � � � � � � 2.14 Mass Notification System � � � � � � � � �
More Intuitive & Predictive
• Physical Security Information Management (PSIM)
• Video Analytics – Behavioral Analytics • Smoke, heat, occupancy, movement
• Building Systems, Local Incidents, Global Alerts
• Trending Data
Less Space – Fewer People
• Visualization Software – Fly Through • Portable – Desktop, Tablet, Smart Phone
Smarter input devices
• Mega Mega Pixel Cameras • No card readers • Facial recognition • Long range biometrics