presentation #: cl05 · 3d visualization on the overview display wall • 3d rendering on...

1

Presentation #: CL05

Bill Jacobs The Jacobs Group Wesley Cobb, PhD BRS Labs Peter Bussens Barco Dan O’Neill TSG Solutions March 27, 2012

The Control Center of the Future

2

Presented By

3

SPONSORS

4

CL05: The Control Center of the Future

Bill Jacobs The Jacobs Group

5

Traditional of Control Centers SOC (Security Op’s Center)

THE TACTICAL RESPONSE

EOC (Emergency Op’s Center) THE STRATEGIC RESPONSE

CENTER

Responds to daily incidents affecting the business, including Emergency Response and Police, Fire and Operational response.

Responds to incidents affecting mission critical business operations globally. Crisis Management and e-Staff converge to initiate BC plans.

6

Business Objectives

} Support the business of Risk Management

} Provide customer response and assistance to on-site events ◦ Information center and sometimes a 911 relay point

} Monitor factors affecting Business Continuity ◦ Site physical security solutions ◦ Network monitoring ◦ BMS monitoring

} Dispatch tactical events ◦ ERT teams ◦ Security Officers ◦ Patrol services

7

Information is Key

} Control Centers need to be able to source information, as they need it.

} Control Centers need to be able to filter information, respond to events, and disseminate reports in real time.

} Tactical Centers (SOC) need to work seamlessly with Strategic (EOC) Centers

8

9

Ideal Solutions

} IP closes the geographic gaps

} Be able to select any information source

} Create your own business rules via drag & drop/object oriented programming ◦ Provide on-line situational analytics and modeling

} Choose where to display information in HD; on video walls, PC’s, tablets, cell phones

10

Alternative Solutions

} Cloud based – Remote Managed Services ◦ Offer real solutions to clients who can’t afford a dedicated

Command Center ◦ Offer business continuity solutions ñ Back-up monitoring and dispatch ñ Data warehousing ñ Remote video storage

11

Conclusion • TECHNOLOGY WILL ENHANCE THE TOOLS WITH

WHICH WE MONITOR AND MANAGE DATA THAT’S RELEVANT TO PROTECTING SHAREHOLDER VALUE, AS DEFINED BY PEOPLE, PROPERTY AND ASSETS.

• RULES ENGINES WILL PROVIDE FOR GREATER AUTOMATED DECISION MAKING AND FASTER RESPONSE.

• HD VIDEO WILL ENRICH THE OPERATIONS EXPERIENCE

12

CL05: The Control Center of the Future

Wesley Cobb, PhD BRS Labs

13

The Past: Video Analytics • VA sometimes an element of control room systems

– Not universal; much skepticism about usefulness

• Primary Purpose is scalability – Reduce human requirements for monitoring many cameras – Improve reliability of response to critical situations

• Installation / Maintenance / Usability Challenges – You had to set up the scene for the VA system – You had to define the rules for the VA system – You had to set the tripwires for the VA system – Even when everything worked, you struggled to find the signal amid the noise You told the VA system precisely what to alert on and therefore…

• You can never get anything that you hadn’t anticipated in advance

14

The Present: Behavior Recognition • BR is a game-changing technology

– destined to become a key feature of control room systems in the future

• Primary Purpose still scalability – reduce human requirements for monitoring many cameras – improve reliability of response to critical situations

• Installation / Maintenance / Usability Improvements – BR systems learn about the scene on their own – BR systems teach themselves to recognize normal behavior in the scene – BR systems alert you when they see something that isn’t usual – alerting “noise” is simply not a problem for BR systems BR systems tell you about unusual things that they see at your site…

• even if you yourself had never thought of them before!

15

“Even if you yourself had never thought of them before”? Really?… Really!

16

Engineering March 2012

Some of the things that can be done right now…

17

Engineering March 2012

Temporal Activities/Motions

Spatial Activities/Motions

Heat Maps & Trajectories

Behavior Learning

Temporal Activities/Motions

Some of the things that can be done right now…

Alert Details

Relevant Memories

18

Sometime/Somewhere 2012

19

Imagineering April 2012

Alert Details

Relevant Memories

Temporal Activities/Motions

Spatial Activities/Motions

Heat Maps & Trajectories

Behavior Learning

Temporal Activities/Motions

20

The Future… • BR not limited to video

– It’s a very flexible technology – It will be adapted to other sensor technologies

• E.g. RFID, Chemical / Biological / Nuclear, Thermal, Radar, Electrical, HVAC

• BR can evolve into an integrating technology for control rooms!

– System could learn what the overall data patterns normally are – System could recognize when that pattern is not being followed – System could alert on “system level” problems

• Goal is NOT to replace humans

– Goal is to remove need for constant mind-numbing attention to detail – Free up human attention for real problem solving when needed

21

CL05: The Control Center of the Future

Peter Bussens Barco

• 3D visualization: how do we perceive depth?

• How is 3D being used in professional applications today?

• How can the security control room benefit from 3D technologies?

Agenda

• Depth perception is the visual ability to perceive the world in three dimensions • Depth perception arises from a variety of depth cues

- Monocular cues that require the input from just one eye - Binocular cues that require input from both eyes

• Creating the illusion of depth on a display requires representation of these

depth cues

How do we perceive depth?

Monocular cues 3D rendering on a 2D display:

Converting 3D models into 2D images with 3D photorealistic effects

Binocular cues Requires stereoscopic display:

Providing a different image to the left and the right eye

Monocular depth cues Linear perspective

Parallel lines converge with increasing distance

As objects become more distant they appear

smaller

Aerial perspective

Due to the scattering of blue light in the

atmosphere, distant objects appear more blue

Relative size

Relative size cues provide information about the relative depth of two

objects

Occlusion

Blocking the sight of objects by others provides

information about relative distance

Monocular depth cues

Lighting and shading

Highlights and shadows provide information about

an object’s dimensions and depth

Texture gradient

Textures appear denser as they are farther away

Depth blur

Defocus blur contributes to the depth perception, because of the limited

depth of focus of the eye

Motion parallax

– When an observer moves, objects at different distances move at a

different relative velocity

Binocular depth cues

Providing additional information about – Size – Shape – Orientation

by presenting a slightly different image for each eye ð stereopsis

Is this spiral going up or down?

Essentially exploitation of parallax = apparent displacement or difference in the apparent position of an object viewed

along two different lines of sight

3D displays

• 3D-display = stereoscopic display = display providing binocular depth clues • New? not really…

Underwood & Underwood 1908 View-Master 1939 3D cinema 1952 Anaglyph, Rollmann 1853

Stereoscopic visualization in professional applications today

Edutainment

• 3D Cinema • Museums & expos • Visitors’ attractions

Universities and Scientific Research

• Medical/bio research • Fluid and aero dynamics

simulation • Space/aerospace/climate research • Mechanical engineering • Urban planning

Design Engineering

• Automotive, consumer goods, architectural design

• Engineering & manufacturing • Design studies • Virtual prototyping • Ergonomic studies

Medical

• Computer tomography (CT) • Magnetic resonant (MR) • Cardio-vascular • Surgical displays

Oil and Gas

• Subsurface exploration • Seismic research • Drilling • Collaboration

Immersive visualization solutions

Flat shape Cube shape Curved shape

“Immersiveness”

Immersive visualization solutions

Complex optical-mechanical systems

3D visualization in the security control center?

• Improving Situational Awareness

• 3D rendering on the desktop is emerging – As graphical UI for Physical Security Information

Management (PSIM) software – 3D mapping of GIS information – CCTV camera coverage and blind spot

visualization – Easier tracking of subjects

Entelec SkyWalker Feeling Software Omnipresence 3D Intergraph GeoMedia 3D

VCORE fourDscape

3D visualization on the overview display wall

• 3D rendering on mega-pixel, multi-channel display walls still a challenge – Resolution limitations in Operating Systems – Requires high computational power and accelerated graphics – Facilitated by high-end GPU’s becoming available (gaming industry)

Mapping CCTV video in the 3D environment

ðPosition video images in the 3D map where they are captured

• Many cameras • Video is displayed

inside their own canvas – keyholes

Fusion of CCTV in the 3D environment • Overlay video on top of the 3D map • Synthetic scene visualization by adding metadata as graphical

elements to the video

Stereoscopic visualization in the control center

• Benefits – Improved situational awareness – Faster decision-making in complex, dynamic environments

• Requirements

– Displays should be capable of 24/7 operation – Limited floor space – Robust, should not require frequent re-calibration – Low noise level

• Available today – Liquid-cooled LED illumination for low TCO and long lifetime – Automatic color calibration – Time-multiplexed at 120Hz with IR emitter and active shutter

glasses

Stereoscopic projection cubes

Challenges

• Eye-fatigue with long-term use – Vergence-focus mismatch – Crosstalk

• Interference of the glasses with – Workspace lighting – Other displays in the operator environment

Right Eye Left Eye

Right-eye Image Left-eye Image

Ghost image

Conclusions and a forward look…

• 3D visualization technologies will become omnipresent in the control center

– 3D rendering on 2D displays • Stereoscopic displays start to appear in the control center

– On the desktop – For the overview display wall

• 3D stereoscopic surveillance cameras may fuel the demand for stereoscopic displays

• Future multi-view auto-stereoscopic displays that require no eyeware will greatly improve usability and will be instrumental for general acceptance

39

CL05: The Control Center of the Future

Dan O’Neill TSG Solutions

40

Experience

41

Video – Minority Report

Coordination of More Disciplines • Basis of Design

DESIGN DISCIPLINES

Arch Civil Structural Electrical Mechanical Plumbing Fire

Protection Telecomm

/IT Electronic Security

DES

IGN

CR

ITER

IA S

ECTI

ON

NU

MB

ER

2.1 Site & Landscape � � � � � � � � � 2.2 Architecture/ Interior � � � � � � � � �

2.3 Mission Critical Areas � � � � � � � � �

2.4 Structural � � � � � � � � �

2.5 Building Envelope � � � � � � � � �

2.6 Utility Systems � � � � � � � � �

2.7 Mechanical Systems � � � � � � � � � 2.8 Plumbing and Gas � � � � � � � � �

2.9 Electrical Systems � � � � � � � � � 2.10 Tele-communication Systems � � � � � � � � � 2.11 Electronic Security Systems � � � � � � � � �

2.12 Life Safety Systems � � � � � � � � � 2.14 Mass Notification System � � � � � � � � �

More Intuitive & Predictive

• Physical Security Information Management (PSIM)

• Video Analytics – Behavioral Analytics • Smoke, heat, occupancy, movement

• Building Systems, Local Incidents, Global Alerts

• Trending Data

Less Space – Fewer People

• Visualization Software – Fly Through • Portable – Desktop, Tablet, Smart Phone

Smarter input devices

• Mega Mega Pixel Cameras • No card readers • Facial recognition • Long range biometrics