addressing challenges in federal facilities from cyber risk ......cybersecurity dodi 8510 risk mgt...

Post on 01-Oct-2020

2 Views

Category:

Documents

0 Downloads

Preview:

Click to see full reader

TRANSCRIPT

copy Copyright 2017 OSIsoft LLCINTELLIGENCE AND NATIONAL SECURITY FORUM

Presented by

Addressing Challenges

in Federal Facilities from

Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Public Law 93-383 Sect 809

Develop and maintain performance criteria for maintenance of life safety health and public welfare for the built environmentEvaluate and prequalify building technology and productsConduct related and needed investigationsAssemble store and disseminate technical data and related information

Congress directed the Institute to ldquoexercise its functions and responsibilities in four general areashelliphelliphelliprdquo

Advance Science and Technology

High-Performance building means a building that

integrates and optimizes on a life-cycle basis all

major high-performance attributes including

energy [and water] conservation environment

safety security durability accessibility cost-

benefit productivity sustainability functionality

and operational considerations-Energy Independence and Security Act of 2007 sect401 (PL 110-140)

High-Performance Buildings Defined

Secure

Accessible

Productive

Aesthetics

Sustainable

BuildingSupplies

Manufacturing

Finance

Transportation

Workforce

Buildings are a Key Aspect of the Economy

Utilities

Materials

Historic Preservation

Safe

Resilient

Cost Effective

Integrate

Optimize

Life-Cycle

Identifying and Meeting Performance Goals

Army Net Zero Initiative

Common Definition for ZEBbull Zero Energy Building (ZEB)

ndash An energy-efficient building where on a source energy basis the actual annual delivered energy is less than or equal to the on-site renewable exported energy

bull The designation Zero Energy Building (ZEB) should be used only for buildings that have demonstrated through actual annual measurements that the delivered energy is less than or equal to the on-site renewable exported energy

bull Also similar definitions for campus community portfolio

httpenergygoveerebuildingsdownloadscommon-definition-zero-energy-buildings

Achieving Energy Performance Goals

bull Establishing targets based on Actual Measured Results

ndash Performance Standards

ndash Outcome-Based Codes

ndash ESPCsUSPCs

ndash Performance-Based Contracting

ndash Design-Build-Operate-MaintainP3

IIIIIIIIIII

I

I

I

IIIIIIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

Mind the Gap

Design amp Construction

Operations

$$$$$$$$$$$$

$$

$$

$ $$$$$$$$$$$$$$$$

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

COBieIntegrative Design

Performance-Focused GSA P100

GSA Federal Center South

Governor Deukmejian Courthouse Long Beach

bull Public-Private PartnershipDBFOM

bull The performance-based contract allowed the courthouse to be constructed without any public funding and provides for the ongoing maintenance and performance of the facility

bull Judicial Council can deduct a specific amount from the availability payment if components of the building do not work

bull For example there is a $5000 deduct for every two hours that certain elevators are inoperable

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Public Law 93-383 Sect 809

Develop and maintain performance criteria for maintenance of life safety health and public welfare for the built environmentEvaluate and prequalify building technology and productsConduct related and needed investigationsAssemble store and disseminate technical data and related information

Congress directed the Institute to ldquoexercise its functions and responsibilities in four general areashelliphelliphelliprdquo

Advance Science and Technology

High-Performance building means a building that

integrates and optimizes on a life-cycle basis all

major high-performance attributes including

energy [and water] conservation environment

safety security durability accessibility cost-

benefit productivity sustainability functionality

and operational considerations-Energy Independence and Security Act of 2007 sect401 (PL 110-140)

High-Performance Buildings Defined

Secure

Accessible

Productive

Aesthetics

Sustainable

BuildingSupplies

Manufacturing

Finance

Transportation

Workforce

Buildings are a Key Aspect of the Economy

Utilities

Materials

Historic Preservation

Safe

Resilient

Cost Effective

Integrate

Optimize

Life-Cycle

Identifying and Meeting Performance Goals

Army Net Zero Initiative

Common Definition for ZEBbull Zero Energy Building (ZEB)

ndash An energy-efficient building where on a source energy basis the actual annual delivered energy is less than or equal to the on-site renewable exported energy

bull The designation Zero Energy Building (ZEB) should be used only for buildings that have demonstrated through actual annual measurements that the delivered energy is less than or equal to the on-site renewable exported energy

bull Also similar definitions for campus community portfolio

httpenergygoveerebuildingsdownloadscommon-definition-zero-energy-buildings

Achieving Energy Performance Goals

bull Establishing targets based on Actual Measured Results

ndash Performance Standards

ndash Outcome-Based Codes

ndash ESPCsUSPCs

ndash Performance-Based Contracting

ndash Design-Build-Operate-MaintainP3

IIIIIIIIIII

I

I

I

IIIIIIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

Mind the Gap

Design amp Construction

Operations

$$$$$$$$$$$$

$$

$$

$ $$$$$$$$$$$$$$$$

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

COBieIntegrative Design

Performance-Focused GSA P100

GSA Federal Center South

Governor Deukmejian Courthouse Long Beach

bull Public-Private PartnershipDBFOM

bull The performance-based contract allowed the courthouse to be constructed without any public funding and provides for the ongoing maintenance and performance of the facility

bull Judicial Council can deduct a specific amount from the availability payment if components of the building do not work

bull For example there is a $5000 deduct for every two hours that certain elevators are inoperable

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Public Law 93-383 Sect 809

Develop and maintain performance criteria for maintenance of life safety health and public welfare for the built environmentEvaluate and prequalify building technology and productsConduct related and needed investigationsAssemble store and disseminate technical data and related information

Congress directed the Institute to ldquoexercise its functions and responsibilities in four general areashelliphelliphelliprdquo

Advance Science and Technology

High-Performance building means a building that

integrates and optimizes on a life-cycle basis all

major high-performance attributes including

energy [and water] conservation environment

safety security durability accessibility cost-

benefit productivity sustainability functionality

and operational considerations-Energy Independence and Security Act of 2007 sect401 (PL 110-140)

High-Performance Buildings Defined

Secure

Accessible

Productive

Aesthetics

Sustainable

BuildingSupplies

Manufacturing

Finance

Transportation

Workforce

Buildings are a Key Aspect of the Economy

Utilities

Materials

Historic Preservation

Safe

Resilient

Cost Effective

Integrate

Optimize

Life-Cycle

Identifying and Meeting Performance Goals

Army Net Zero Initiative

Common Definition for ZEBbull Zero Energy Building (ZEB)

ndash An energy-efficient building where on a source energy basis the actual annual delivered energy is less than or equal to the on-site renewable exported energy

bull The designation Zero Energy Building (ZEB) should be used only for buildings that have demonstrated through actual annual measurements that the delivered energy is less than or equal to the on-site renewable exported energy

bull Also similar definitions for campus community portfolio

httpenergygoveerebuildingsdownloadscommon-definition-zero-energy-buildings

Achieving Energy Performance Goals

bull Establishing targets based on Actual Measured Results

ndash Performance Standards

ndash Outcome-Based Codes

ndash ESPCsUSPCs

ndash Performance-Based Contracting

ndash Design-Build-Operate-MaintainP3

IIIIIIIIIII

I

I

I

IIIIIIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

Mind the Gap

Design amp Construction

Operations

$$$$$$$$$$$$

$$

$$

$ $$$$$$$$$$$$$$$$

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

COBieIntegrative Design

Performance-Focused GSA P100

GSA Federal Center South

Governor Deukmejian Courthouse Long Beach

bull Public-Private PartnershipDBFOM

bull The performance-based contract allowed the courthouse to be constructed without any public funding and provides for the ongoing maintenance and performance of the facility

bull Judicial Council can deduct a specific amount from the availability payment if components of the building do not work

bull For example there is a $5000 deduct for every two hours that certain elevators are inoperable

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Advance Science and Technology

High-Performance building means a building that

integrates and optimizes on a life-cycle basis all

major high-performance attributes including

energy [and water] conservation environment

safety security durability accessibility cost-

benefit productivity sustainability functionality

and operational considerations-Energy Independence and Security Act of 2007 sect401 (PL 110-140)

High-Performance Buildings Defined

Secure

Accessible

Productive

Aesthetics

Sustainable

BuildingSupplies

Manufacturing

Finance

Transportation

Workforce

Buildings are a Key Aspect of the Economy

Utilities

Materials

Historic Preservation

Safe

Resilient

Cost Effective

Integrate

Optimize

Life-Cycle

Identifying and Meeting Performance Goals

Army Net Zero Initiative

Common Definition for ZEBbull Zero Energy Building (ZEB)

ndash An energy-efficient building where on a source energy basis the actual annual delivered energy is less than or equal to the on-site renewable exported energy

bull The designation Zero Energy Building (ZEB) should be used only for buildings that have demonstrated through actual annual measurements that the delivered energy is less than or equal to the on-site renewable exported energy

bull Also similar definitions for campus community portfolio

httpenergygoveerebuildingsdownloadscommon-definition-zero-energy-buildings

Achieving Energy Performance Goals

bull Establishing targets based on Actual Measured Results

ndash Performance Standards

ndash Outcome-Based Codes

ndash ESPCsUSPCs

ndash Performance-Based Contracting

ndash Design-Build-Operate-MaintainP3

IIIIIIIIIII

I

I

I

IIIIIIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

Mind the Gap

Design amp Construction

Operations

$$$$$$$$$$$$

$$

$$

$ $$$$$$$$$$$$$$$$

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

COBieIntegrative Design

Performance-Focused GSA P100

GSA Federal Center South

Governor Deukmejian Courthouse Long Beach

bull Public-Private PartnershipDBFOM

bull The performance-based contract allowed the courthouse to be constructed without any public funding and provides for the ongoing maintenance and performance of the facility

bull Judicial Council can deduct a specific amount from the availability payment if components of the building do not work

bull For example there is a $5000 deduct for every two hours that certain elevators are inoperable

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

High-Performance building means a building that

integrates and optimizes on a life-cycle basis all

major high-performance attributes including

energy [and water] conservation environment

safety security durability accessibility cost-

benefit productivity sustainability functionality

and operational considerations-Energy Independence and Security Act of 2007 sect401 (PL 110-140)

High-Performance Buildings Defined

Secure

Accessible

Productive

Aesthetics

Sustainable

BuildingSupplies

Manufacturing

Finance

Transportation

Workforce

Buildings are a Key Aspect of the Economy

Utilities

Materials

Historic Preservation

Safe

Resilient

Cost Effective

Integrate

Optimize

Life-Cycle

Identifying and Meeting Performance Goals

Army Net Zero Initiative

Common Definition for ZEBbull Zero Energy Building (ZEB)

ndash An energy-efficient building where on a source energy basis the actual annual delivered energy is less than or equal to the on-site renewable exported energy

bull The designation Zero Energy Building (ZEB) should be used only for buildings that have demonstrated through actual annual measurements that the delivered energy is less than or equal to the on-site renewable exported energy

bull Also similar definitions for campus community portfolio

httpenergygoveerebuildingsdownloadscommon-definition-zero-energy-buildings

Achieving Energy Performance Goals

bull Establishing targets based on Actual Measured Results

ndash Performance Standards

ndash Outcome-Based Codes

ndash ESPCsUSPCs

ndash Performance-Based Contracting

ndash Design-Build-Operate-MaintainP3

IIIIIIIIIII

I

I

I

IIIIIIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

Mind the Gap

Design amp Construction

Operations

$$$$$$$$$$$$

$$

$$

$ $$$$$$$$$$$$$$$$

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

COBieIntegrative Design

Performance-Focused GSA P100

GSA Federal Center South

Governor Deukmejian Courthouse Long Beach

bull Public-Private PartnershipDBFOM

bull The performance-based contract allowed the courthouse to be constructed without any public funding and provides for the ongoing maintenance and performance of the facility

bull Judicial Council can deduct a specific amount from the availability payment if components of the building do not work

bull For example there is a $5000 deduct for every two hours that certain elevators are inoperable

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Secure

Accessible

Productive

Aesthetics

Sustainable

BuildingSupplies

Manufacturing

Finance

Transportation

Workforce

Buildings are a Key Aspect of the Economy

Utilities

Materials

Historic Preservation

Safe

Resilient

Cost Effective

Integrate

Optimize

Life-Cycle

Identifying and Meeting Performance Goals

Army Net Zero Initiative

Common Definition for ZEBbull Zero Energy Building (ZEB)

ndash An energy-efficient building where on a source energy basis the actual annual delivered energy is less than or equal to the on-site renewable exported energy

bull The designation Zero Energy Building (ZEB) should be used only for buildings that have demonstrated through actual annual measurements that the delivered energy is less than or equal to the on-site renewable exported energy

bull Also similar definitions for campus community portfolio

httpenergygoveerebuildingsdownloadscommon-definition-zero-energy-buildings

Achieving Energy Performance Goals

bull Establishing targets based on Actual Measured Results

ndash Performance Standards

ndash Outcome-Based Codes

ndash ESPCsUSPCs

ndash Performance-Based Contracting

ndash Design-Build-Operate-MaintainP3

IIIIIIIIIII

I

I

I

IIIIIIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

Mind the Gap

Design amp Construction

Operations

$$$$$$$$$$$$

$$

$$

$ $$$$$$$$$$$$$$$$

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

COBieIntegrative Design

Performance-Focused GSA P100

GSA Federal Center South

Governor Deukmejian Courthouse Long Beach

bull Public-Private PartnershipDBFOM

bull The performance-based contract allowed the courthouse to be constructed without any public funding and provides for the ongoing maintenance and performance of the facility

bull Judicial Council can deduct a specific amount from the availability payment if components of the building do not work

bull For example there is a $5000 deduct for every two hours that certain elevators are inoperable

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Integrate

Optimize

Life-Cycle

Identifying and Meeting Performance Goals

Army Net Zero Initiative

Common Definition for ZEBbull Zero Energy Building (ZEB)

ndash An energy-efficient building where on a source energy basis the actual annual delivered energy is less than or equal to the on-site renewable exported energy

bull The designation Zero Energy Building (ZEB) should be used only for buildings that have demonstrated through actual annual measurements that the delivered energy is less than or equal to the on-site renewable exported energy

bull Also similar definitions for campus community portfolio

httpenergygoveerebuildingsdownloadscommon-definition-zero-energy-buildings

Achieving Energy Performance Goals

bull Establishing targets based on Actual Measured Results

ndash Performance Standards

ndash Outcome-Based Codes

ndash ESPCsUSPCs

ndash Performance-Based Contracting

ndash Design-Build-Operate-MaintainP3

IIIIIIIIIII

I

I

I

IIIIIIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

Mind the Gap

Design amp Construction

Operations

$$$$$$$$$$$$

$$

$$

$ $$$$$$$$$$$$$$$$

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

COBieIntegrative Design

Performance-Focused GSA P100

GSA Federal Center South

Governor Deukmejian Courthouse Long Beach

bull Public-Private PartnershipDBFOM

bull The performance-based contract allowed the courthouse to be constructed without any public funding and provides for the ongoing maintenance and performance of the facility

bull Judicial Council can deduct a specific amount from the availability payment if components of the building do not work

bull For example there is a $5000 deduct for every two hours that certain elevators are inoperable

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Identifying and Meeting Performance Goals

Army Net Zero Initiative

Common Definition for ZEBbull Zero Energy Building (ZEB)

ndash An energy-efficient building where on a source energy basis the actual annual delivered energy is less than or equal to the on-site renewable exported energy

bull The designation Zero Energy Building (ZEB) should be used only for buildings that have demonstrated through actual annual measurements that the delivered energy is less than or equal to the on-site renewable exported energy

bull Also similar definitions for campus community portfolio

httpenergygoveerebuildingsdownloadscommon-definition-zero-energy-buildings

Achieving Energy Performance Goals

bull Establishing targets based on Actual Measured Results

ndash Performance Standards

ndash Outcome-Based Codes

ndash ESPCsUSPCs

ndash Performance-Based Contracting

ndash Design-Build-Operate-MaintainP3

IIIIIIIIIII

I

I

I

IIIIIIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

Mind the Gap

Design amp Construction

Operations

$$$$$$$$$$$$

$$

$$

$ $$$$$$$$$$$$$$$$

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

COBieIntegrative Design

Performance-Focused GSA P100

GSA Federal Center South

Governor Deukmejian Courthouse Long Beach

bull Public-Private PartnershipDBFOM

bull The performance-based contract allowed the courthouse to be constructed without any public funding and provides for the ongoing maintenance and performance of the facility

bull Judicial Council can deduct a specific amount from the availability payment if components of the building do not work

bull For example there is a $5000 deduct for every two hours that certain elevators are inoperable

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Army Net Zero Initiative

Common Definition for ZEBbull Zero Energy Building (ZEB)

ndash An energy-efficient building where on a source energy basis the actual annual delivered energy is less than or equal to the on-site renewable exported energy

bull The designation Zero Energy Building (ZEB) should be used only for buildings that have demonstrated through actual annual measurements that the delivered energy is less than or equal to the on-site renewable exported energy

bull Also similar definitions for campus community portfolio

httpenergygoveerebuildingsdownloadscommon-definition-zero-energy-buildings

Achieving Energy Performance Goals

bull Establishing targets based on Actual Measured Results

ndash Performance Standards

ndash Outcome-Based Codes

ndash ESPCsUSPCs

ndash Performance-Based Contracting

ndash Design-Build-Operate-MaintainP3

IIIIIIIIIII

I

I

I

IIIIIIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

Mind the Gap

Design amp Construction

Operations

$$$$$$$$$$$$

$$

$$

$ $$$$$$$$$$$$$$$$

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

COBieIntegrative Design

Performance-Focused GSA P100

GSA Federal Center South

Governor Deukmejian Courthouse Long Beach

bull Public-Private PartnershipDBFOM

bull The performance-based contract allowed the courthouse to be constructed without any public funding and provides for the ongoing maintenance and performance of the facility

bull Judicial Council can deduct a specific amount from the availability payment if components of the building do not work

bull For example there is a $5000 deduct for every two hours that certain elevators are inoperable

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Common Definition for ZEBbull Zero Energy Building (ZEB)

ndash An energy-efficient building where on a source energy basis the actual annual delivered energy is less than or equal to the on-site renewable exported energy

bull The designation Zero Energy Building (ZEB) should be used only for buildings that have demonstrated through actual annual measurements that the delivered energy is less than or equal to the on-site renewable exported energy

bull Also similar definitions for campus community portfolio

httpenergygoveerebuildingsdownloadscommon-definition-zero-energy-buildings

Achieving Energy Performance Goals

bull Establishing targets based on Actual Measured Results

ndash Performance Standards

ndash Outcome-Based Codes

ndash ESPCsUSPCs

ndash Performance-Based Contracting

ndash Design-Build-Operate-MaintainP3

IIIIIIIIIII

I

I

I

IIIIIIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

Mind the Gap

Design amp Construction

Operations

$$$$$$$$$$$$

$$

$$

$ $$$$$$$$$$$$$$$$

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

COBieIntegrative Design

Performance-Focused GSA P100

GSA Federal Center South

Governor Deukmejian Courthouse Long Beach

bull Public-Private PartnershipDBFOM

bull The performance-based contract allowed the courthouse to be constructed without any public funding and provides for the ongoing maintenance and performance of the facility

bull Judicial Council can deduct a specific amount from the availability payment if components of the building do not work

bull For example there is a $5000 deduct for every two hours that certain elevators are inoperable

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Achieving Energy Performance Goals

bull Establishing targets based on Actual Measured Results

ndash Performance Standards

ndash Outcome-Based Codes

ndash ESPCsUSPCs

ndash Performance-Based Contracting

ndash Design-Build-Operate-MaintainP3

IIIIIIIIIII

I

I

I

IIIIIIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

Mind the Gap

Design amp Construction

Operations

$$$$$$$$$$$$

$$

$$

$ $$$$$$$$$$$$$$$$

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

COBieIntegrative Design

Performance-Focused GSA P100

GSA Federal Center South

Governor Deukmejian Courthouse Long Beach

bull Public-Private PartnershipDBFOM

bull The performance-based contract allowed the courthouse to be constructed without any public funding and provides for the ongoing maintenance and performance of the facility

bull Judicial Council can deduct a specific amount from the availability payment if components of the building do not work

bull For example there is a $5000 deduct for every two hours that certain elevators are inoperable

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

IIIIIIIIIII

I

I

I

IIIIIIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

IIIIIIIIIIIIIIII

Mind the Gap

Design amp Construction

Operations

$$$$$$$$$$$$

$$

$$

$ $$$$$$$$$$$$$$$$

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$

COBieIntegrative Design

Performance-Focused GSA P100

GSA Federal Center South

Governor Deukmejian Courthouse Long Beach

bull Public-Private PartnershipDBFOM

bull The performance-based contract allowed the courthouse to be constructed without any public funding and provides for the ongoing maintenance and performance of the facility

bull Judicial Council can deduct a specific amount from the availability payment if components of the building do not work

bull For example there is a $5000 deduct for every two hours that certain elevators are inoperable

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Performance-Focused GSA P100

GSA Federal Center South

Governor Deukmejian Courthouse Long Beach

bull Public-Private PartnershipDBFOM

bull The performance-based contract allowed the courthouse to be constructed without any public funding and provides for the ongoing maintenance and performance of the facility

bull Judicial Council can deduct a specific amount from the availability payment if components of the building do not work

bull For example there is a $5000 deduct for every two hours that certain elevators are inoperable

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

GSA Federal Center South

Governor Deukmejian Courthouse Long Beach

bull Public-Private PartnershipDBFOM

bull The performance-based contract allowed the courthouse to be constructed without any public funding and provides for the ongoing maintenance and performance of the facility

bull Judicial Council can deduct a specific amount from the availability payment if components of the building do not work

bull For example there is a $5000 deduct for every two hours that certain elevators are inoperable

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Governor Deukmejian Courthouse Long Beach

bull Public-Private PartnershipDBFOM

bull The performance-based contract allowed the courthouse to be constructed without any public funding and provides for the ongoing maintenance and performance of the facility

bull Judicial Council can deduct a specific amount from the availability payment if components of the building do not work

bull For example there is a $5000 deduct for every two hours that certain elevators are inoperable

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Management Processes for Resilience

bull The Critical Infrastructure Security and Resilience Risk Management Process (CISR-RMP) objective is a model process that can be implemented by a variety of tools and adaptations of existing processes to provide results for comparisons interdependencies analysis options valuation aggregations and major resource decisions at multiple scales

bull Operationalizing the NIPP 2013ndash Set Goals amp Objectivesndash Identify Infrastructurendash Assess amp Analyze Riskndash Implement Risk Management

Activitiesndash Measure Effectiveness

httpswwwnibsorgpage=irdp_projects

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Data and Information Supporting Performance

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Rethinking the Data Ecosystem

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Shared Services + Access to Data

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

A Building Information Model (BIM) is a digital representation of physical and functional characteristics of a facility As such it serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward

A basic premise of BIM is collaboration by different stakeholders at different phases of the life cycle of a facility to insert extract update or modify information in the BIM process to support and reflect the roles of that stakeholder The BIM is a shared digital representation founded on open standards for interoperability

United States National BIM Standard V1 P1 Jan 2008

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Courtesy of Autodesk

The Facility Lifecycle

21

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Simulations-Comfort

-Ventilation heating

-Energy

-Light sound

-Insulation

-Fire usage

-Environment

-Life time predictions

-Crowd behavior

- Safety

Specifications-Specification sheets

-Classification standards

-Estimates accounting

Briefing-Functional req

-Estimates

-Conditions

-Requirements

Knowledge databases-Best practise knowledge

-Own practice

Laws and regulations-Building regulations

-Building specifications

Design and Analysis-Drawings calculations

-Architect engineerhellip

Modeling-Visualisation 3D models

Procurement-Product databases

-Price databases

Facility management-Letting sale operations

-Maintenance

-Guaranties

Demolition refurbishment-Rebuild

-Demolition

-Restoration

Construction management-Scheduling

-Logistics 4D

By Lars Bjoslashrkhaug

Illustrations by Byggforsk Olof

Granlund NBLN University of

California Stanford University

Costing- Initial cost

- Life-cycle

- Value Engineering

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Construction toOperations

Buildinginformation

exchange(COBie)

SpecifiersrsquoPropertiesinformationexchange(SPie)

EquipmentLayoutinformationexchange(ELie)

Keys to Facility Management Handover

ERDC (c) 2009

Equipment Lists

Warranties and Spares

Approved Submittals

Layout Drawings

Performance

Standards

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Information Hierarchy ndash GIS-CIM-BIM RelationshipIA

I-IFC U

sage

Space

Natural Asset

Linear Structure

Structure

Building

Facility Built

Theatre World

Sub-SystemsSystem

Level

Site

Real Property Asset

Country

State Province

County

Installation Region

Node

Segment

Room

Space

System

Level

Sub-Systems

Room

Water Sea

Land Parcel

Underground

Air Space

Overlay

Overlay

Components

Components

City

OGCreg

KeyGISCIMBIM

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Using BIM Gaming amp VR to Optimize Facility Performance

COBieBIM

Rich VR

Basic Walkthrough

Scenario Development

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

bull A simple quick and reliable means for obtaining preliminary risk and resilience scores and ratings

bull A software tool designed to prepare rapid but comprehensive assessments

bull An all hazard approach

bull Applicable to facilities in federal state and local agencies and the private sector

bull Covers buildings tunnels and mass transit stations

bull Allows individual facility assessments to be customized to specific protection strategies for specific hazards

bull Includes automated checklist for ISC criteria evaluation

Integrated Rapid Visual Screening (IRVS)

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Sensors Controls and the Internet of Things

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

OT IP Controllers are in Everything

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

EIampE Cybersecurity Efforts

EEIM AMI TWG

MILDEP ICS Inventories

Network CampA

JTANICS

Installation

CDRrsquos Handbook

CYBERCOM

JBASICS TTPs

SPIDERS Phases 1 2 3

Cybersecuring Control Systems UFC

CYBERGUARD

14-1 Exercise

CSET 40 51 60 62 70 71 80

NIST SP 800-82 R2 ICS

RMF KS EIampE Control System webpage

lsquo14lsquo13lsquo12 lsquo15 lsquo16

IampE ICS Memo 1

Many Stakeholders DoD Policy Experiment Exercise Roles

IG Reports

HASC

brief 1

DoDI 8500

Cybersecurity

DoDI 8510

Risk Mgt

Framework

FFC Workshops

HASC

brief 2

DoDI 8530

Network

DoDI 8531

Vulnerability

IampE ICS Memo 2

DoDI 8140

Workforce

NIST Cyber-Physical Systems

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

WBDG Cybersecurity Resource Page

httpwwwwbdgorgresourcescybersecurityphp

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Workforce Credentials

In Development Blast Design Professional

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Workforce Credentials

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Workforce Cyber Skills ndash NIST NICE

Collect and Analyze Data Capture cybersecurity workforce and training data to understand capabilities and needsRecruit and Retain Incentivize the hiring and retention of highly skilled and adaptive professionals needed for a secure digital nationEducate Train and Develop Expand the pipeline for and deliberately develop an unrivaled cybersecurity workforceEngage Educate and energize all cybersecurity workforces and the American public to strengthen the nationrsquos front lines of cybersecurity

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Taking the Next Steps

bull Optimizing Procurement and Management Processes

bull Changing the Data Ecosystem Operationalizing BIM

bull Shifting to PerformanceOutcome-Based Standards and Criteria

bull Engaging the Workforce of Today and Tomorrow

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Attracting The Next Generation

httpwwwnibsorgMarsCity

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

Addressing Challenges in Federal Facilities from Cyber Risk to

Operational Performance

Ryan M Colker JD

Director Consultative CouncilPresidential Advisor

National Institute of Building Sciences

1090 Vermont Ave NW 700

Washington DC 20005

202-289-7800 x133

rcolkernibsorg

rmcolker

OSIsoft Intelligence and National Security ForumApril 20 2017

top related