cloud computing and intelligent systems: two fields at a crossroads

46
Infinite Dimensions Solving Tomorrow’s Problems Today CSCI'14 Cloud Computing and Intelligent Systems Two Fields at a Crossroads Dr. Jeffrey Wallace The 2014 International Conference on Computational Science and Computational Intelligence (CSCI'14)

Upload: jeffrey-wallace

Post on 14-Jun-2015

519 views

Category:

Technology


1 download

DESCRIPTION

Many “big data” software systems are not interactive, automated, or run in a real-time mode. The true utility of cloud computing and “big data systems” can be increased by providing an execution framework and control software that is native to cloud architectures and supports interactivity and time synchronization. In addition, a framework to integrate different artificial intelligence and machine learning algorithms is combined with the execution framework to create a powerful cloud computing system development platform.

TRANSCRIPT

Page 1: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Cloud Computing and Intelligent Systems

Two Fields at a Crossroads

Dr. Jeffrey Wallace

The 2014 International Conference on Computational Science and Computational Intelligence (CSCI'14)

Page 2: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

2

CSCI'14

Cloud Computing and Intelligent Systems

• Context• Technical Challenges• Examples

– Unmanned Systems Control• Anti-ship Missile Defense• Battlefield Extraction of Wounded

• Technology Enablers– System/Component Integration– Algorithm/Environment Integration

• Summary

Page 3: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Context• Unique Systems Engineering and Development

Capability– A distillation of over $2B in government R&D– Addresses both people and technology

• Partnered with the Office of the Secretary of Defense, the Joint Chiefs of Staff, the 4 services, Academia, and others

• Solved world-class/grand challenge problems on F-35, CVN-21, healthcare IT, etc.

• Systems Integrator for the Continuous Transformation Environment

3

Page 4: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

Continuous Transformation Environment

“A Cloud Computing Range”

Page 5: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

5

CSCI'14

CTE at a Glance• CTE Objectives

– Prototype development and experimentation: Innovation in a collaborative environment by industry, government, and academia in an open systems collaborative environment

– Integration, verification, test, and release of Commercial-Off-The-Shelf (COTS) products for government use

– Rapidly prove operational utility of high technology solutions– Open systems and standards compliance evaluation,

documentation, and capabilities matrix

• Solve GAO identified big integrator problem1

– Organizing principle: “Give innovation a chance.”

• Consortium of large and small technology companies and facilities partners

1 Government Accounting Office-09-326SP, http://www.gao.gov/new.items/d09326sp.pdf

Page 6: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CTE Network

6

Quality Technology Services (QTS) and Verizon (VZW) are the current facilities providers OCONUS Sites are VZW CONUS VZW: Engelwood, CO; Culpeper, VA, Miami, FL Remaining CONUS Sites are QTS, in particular the 1.3M sq. ft. Richmond, VA site

Page 7: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

Main CTE Experimentation Lab LocationRichmond- High Density Multi-Data Center Campus

500,000 Sq Ft of Planned Raised Floor Multiple Distinct Data Center Buildings

(Current Basis of Design)

1

3

2 Office Space

1.3 Million Sq Ft Campus

Page 8: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Technical Challenges• Rapidly create complex, realistic, and scalable

networks of systems and component inter-relationships

• Distribution of autonomous controls and monitors• Implementation of complex webs of cause and effect• Dynamic alteration of the component execution

structure – Adaptation and evolution of the system

• Ability to handle billions of active processes in real-time– Harness power of sequential, distributed and/or parallel

processing – optimizing the use of any compute/network/storage configuration

– Smartphones to supercomputers

8

Page 9: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

Unmanned Systems Control

October 27, 2008 USIC Conference, San Diego, CA

9

Page 10: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Hypersonic Anti-Ship Missile Challenges

• Critical Battlespace defense gap• Interactions happening faster than humans

can react• Current Command and Control (C2) is not

real-time, performance limited, and the only source of information

• Greatly affects real-time response for kinetic engagement capabilities

10

Page 11: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Anti-Ship Missile Defense

Increase Response time for Fleet Simplify Installation, Maintenance, &

Operation

SBX

DDG

e.g. DF-21

UAS

Weapon

USV

Anti-Ship Missile

SpaceSensor

Page 12: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

12

Sea BasePerimeter

ASW Threat Identification Perimeter

SUW Threat Monitoring Perimeter

SUW Threat Identification Perimeter

18 nmi

15 nmi

50 nmi

15 nmi

ASMD Threat Perimeter

Page 13: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

13

Sea BasePerimeter

ASW Threat Identification Perimeter

SUW Threat Monitoring Perimeter

SUW Threat Identification Perimeter

ASMD Threat Perimeter

X

Page 14: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

Cloud of ProjectilesEach USV’s Gun Creates a Cloud

14

Page 15: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

New Fleet Capabilities

• Automated Fleet Systems – Adaptive & composable– Knowledge built into systems– Emphasizes speed and flexibility

• Ability to fuse new information, knowledge, and structures rapidly– Mesh networks and systems– Example: Sensor net that automatically refocuses

based on accurate real time fused information

• C2 and fire control moves from Fleet platforms to Network

15

Page 16: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

Inter-system Interoperability and Interaction with Personnel “On Scene” Example: Nightingale II

16

Autonomous transit from starting point, to pick-up point, to medical unit

4

A. Call for MedEvac received at Nightingale Control

B. Best UAV is chosen automatically

C. Route is autonomously planned & uploaded

D. UAV is launched automatically

12

Autonomous collision & obstacle avoidance

Similar process for: Logistics, Combat Rescue, & Special Ops

No Fly Zone

C2

No Fly

Zone

A

B

C

D

1

Autonomous Clear-Zone

landing3

5

UGV+BEAR deploys

BEAR deploys

6 BEAR recovers &

Medic treats

7UAS/UGV/BEAR

system rejoins and goes to destination

Page 17: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Nightingale II

• Autonomous:– VTOL UAV– High-mobility UGV(s)– Asset allocation and mission planning

• Interoperability / coordination with existing– Dismounted ground personnel– Air operations– Ground operations– Artillery & strike operations– Political & no-fly boundaries

– High-data-rate non-LOS communicationsOctober 27, 2008 USIC Conference, San Diego, CA 1

7

Page 18: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Nightingale IIChallenges

• Autonomous VTOL UAV – Autonomous obstacle avoidance

• Wires, antennae, etc.– Sensor with sufficient resolution & range for

vehicle maneuverability limits– Day, night, weather, dust/sand/dirt (“brown

out”)

– Autonomous collision avoidance (other aircraft)• Small UAVs, birds, etc.

– Sensor with sufficient resolution & range for vehicle maneuverability limits

– Day, night, weather, dust/sand/dirt (“brown out”)

October 27, 2008 USIC Conference, San Diego, CA 18

Page 19: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Nightingale IIChallenges

• Autonomous VTOL UAV (cont)– Autonomous LZ identification

• LZ size, geometry, roughness, slope• Ingress/egress flight-path

– Obstacles– Moving ground personnel, vehicles– Exposure to enemy

» Lines of fire» Exposure time

• Coordination with UGV mobility constraints– Navigable path between LZ and casualty

October 27, 2008 USIC Conference, San Diego, CA 19

Page 20: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'1420

Nightingale IIChallenges

• Rough-terrain UGV(s) – Mobility

• Tracks, wheels, legs• Water crossing• Mud, sand, snow, ice• Interiors (stairs, doors, elevators, etc.)

– Autonomous capabilities • Beyond Grand Challenge, Urban Challenge

– Casualty extraction• Careful casualty handling • Does the UGV need a UGV?

October 27, 2008 USIC Conference, San Diego, CA

Page 21: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

System/Component Integration

• Most well-known methods and technology originate in “business IT”…

• Optimizing execution and efficiency and enabling computation at scale is typically the province of “high performance computing”

• Real-time execution and synchronization are addressed by several communities, e.g. robotics

21

Page 22: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

Ease of Development/Integration/InteroperabilityImplement/Support Any Architecture

ApplicationConnectors

MessageBrokers

EnterpriseResource Managers

ApplicationServers

ComponentBrokers

Page 23: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

Data Source 1

Application 1

ComputeProcess 1

Compute Process M

Data Source 2

Data Source N

Application X

WAIT_FOR (DS1 semaphore, wait time1)

WAIT_FOR (DSP semaphore, wait timep)

Typical Complex Application-System

Page 24: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

The DNA of Complex Systems

• Look at nature to understand complex systems

• Internal Processes• External Processes• Internal Events• External Events

• Intermix of all four is required– Implementing in a scalable manner is key

Page 25: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Internal Processes Analogy: The Heart Beat

• Atria pump blood to ventricles, which contract

• Nonstop contractions are driven by the heart's electrical system

Internal Process: Synchronous or Asynchronous – Intrincsic Capabilities

Page 26: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

External Processes Analogy: Pacemaker

• External process monitors and interacts with an object (i.e., a pacemaker monitors the heart’s rhythm)

• The electric current makes the heart beat within a certain range

External Process: Synchronous or Asynchronous – Monitor and Control

Page 27: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Internal Events Analogy: Heart Attack

• Internal occurrence without pre-established time scale

• Certain factors cause the occurrence. Blood flow is restricted, or the nerve system, which controls the heart, malfunctions

Internal Occurrence: Irregular Time Scale – Intrinsic Capabilities

Page 28: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

External Events Analogy: Defibrillation

• External event changes a passive object’s state (i.e., a defibrillator is used for resuscitation)

• External electrical shock is applied to the heart

• Foundational representation method

External Occurrence: Irregular Time Scale – Monitor and Control

Page 29: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

FE FE

FE FE FE

FE

FE

FE

FE FE

FE

FE FE FE FE FE

FE FE

FE FE

FE FE

FE FE

FE FE

FE FE

FE FE

FE FE

FE FE

FE FE

FE FE

FE FE

User Application

Interface Services

Hardware Device

Interface Services

3D Visualization

Interface Services

Web Interface

Interface Services

CommunicationSpeed

Slow

Medium

Fast

Configurable Computational MeshPolymorphic Computing Architecture (PCA)

FE = Functional Element

29

Page 30: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

Component Repository

Composability Automation

CASE Tool EnvironmentUser Defined

IT SystemInterface

User DefinedHardwareInterface

Web ServicesAPI

(JNI, SOAP, OWL, etc.)

SharedMemory IP JTRS

ReflectiveMemory

Security State Saving Core Programming

DistributedObject Mgmt

Std App Dev Interface

SynchronizationManagement

Event ManagementServices

KnowledgeRepresentation

Integration Meta-DataData

Translation

Communication Services (Unicast, Multicast, Broadcast)

Common Application Services

Intelligent Application Services

System Execution Services

Service Decomposition

CompressionEncryption

BLOSLink-16 Others

30

Page 31: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

API ExampleTurret/Fire Control

Slew Elevate

Fire When Slew and Elevate are Complete

Process Firing Commands (and Queuing Them)

31

Page 32: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

Example: Turret Fire Commandvoid Turret::fire(){ P_VAR P_BEGIN(2)

// Wait until the turret movement is completed

WAIT_FOR(1, slewComplete, -1); WAIT_FOR(2, elevateComplete, -1);

// Fire the weapon, this would activate the real gun

Fire_M256(); RB_cout << "Flash, Boom, Bang, Echo" << endl; fireComplete = 1; P_END}

32

Page 33: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Algorithm/Environment Integration

• Must be able to integrate arbitrary types of models (e.g. rule-based, network-based, fuzzy, combinations, etc.)

• A system must account for functionally disparate phenomena, in order to represent “intelligence” more effectively, for example:– Recognition of patterns– Adapting new solutions or strategies– Rule following

Page 34: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

Adaptive, Dynamic, Knowledge-based Execution/ControlConceptual Graphs

Computational Ontology Framework

ConceptsConcepts ActorsActorsRelationshipsRelationships

CAT STAT LOCSIT MATCAT STAT LOCSIT MATMAT

A Cat sits on a matA Cat sits on a mat Une Chat assis surune matteUne Chat assis surune matte

Page 35: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

Basic CG Formation Rules

Concept 1

Relationship 1

Relationship 1

Concept 2

Concepts or Other Actors

Actor 1

Actors or Relationships

Actors or Relationships

Concept 1

Concept

Concept or other Actors

Concept 1

Relationship 1

Actor 1

INVALID

Page 36: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Extensions

• A CG execution engine with abilities to:– Embed in a hardware controller or a software program– Associate the software and hardware components as

indicated by the CG structure– Control, execute, and integrate the entire system

• Customization of concepts, relationships, and actors by the integrator, providing capability to: – Accommodate new hardware, or software

components, without returning to original developers for new versions of graph systems

Page 37: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Extensions

• A mechanism to control the CG execution engine – Each node maintains a truth value to

managed graph execution– A concept from belief network theory

• Collectively, the extensions embodied in the system enable intelligent automation, execution, and control of complex hardware and software assemblies

Page 38: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Summary of Extensions

• A collection of user-defined concept nodes• A collection of user-defined relationship nodes• A collection of user-defined actor nodes• A unique ID numbering scheme to identify every node, regardless of

type• A description of the connected nodes, and route of the connection• A list of references to input concept nodes (those with no incoming

arcs)– A valid CG must contain at least one input concept node

• A list of references to the output concept nodes (those with no outgoing arcs)– A valid CG must contain at least one output concept node

• A data structure that records the truth value of each node

Page 39: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Paradigm of Execution

1. The system is starteda. Each component in the system is initialized

b. Synchronization relationships are established

c. Inputs are read and loaded into system components

2. The CG associated with the system is initialized and parseda. Each system component is associated with a CG element using the unique ID

tag (concept, relationship, actor)

b. Each component is registered in the correct collection mechanism for each type, using the unique ID tag

3. The system begins operating, with various evolution methods. For example:a. A user inputs information, which changes the state of the system (either event-

based, process-based, or simple update loop)

b. Regular update cycles occur for various system aspects

4. The system operation mechanism executes, and an Execution Cycle operation for the CG is activated

5. Each time a system operation mechanism is activated, step 4 is repeated

Page 40: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CG ExecutionDividend: 9.0

Divisor: 4.0

Number: 144.0

Quotient: 2.0

Remainder: 1.0

SquareRoot: 12.0

Sum: 14.0

divide plus

sqrt

Dividend: 9

Divisor: 4

Number: 144

Quotient: 2

Remainder: 1

SquareRoot: 12

Sum: *s

divide plusplus

sqrt

IF ?r = 0IF ?r = 0

T

TT

T

TT

TT

T

F

Page 41: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

Example of a Path of Route in a CG

runs

Is a

generating

for

Responsible for

of Producing

AMachine

AnInterpreter

Algorithm

AnInterpretation

An Agent

A Graph A Behavior

Page 42: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

42

CSCI'14

Summary• Representation of complex webs of

synchronized causes and effects is central to the implementation of complex systems

• Computation, correlation of simultaneously evolving systems and interrelated phenomena

• Ability to control an activity based on a web of logic, and start another in response to dynamic conditions

• Achievement of scalability without loss of capability

Page 43: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

Backup

43

Page 44: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

CSCI'14

Software Development Framework: JEE

• Minimizes amount of code, people, skill-level, development, test, integration, and time required

• Standardizes processes, templates, and documentation

• Works with all modern languages and standard Application Programming Interfaces (APIs)

• Does not compromise any other software vendor’s intellectual property – typically a key cost, schedule, and performance driver

• Can be taught to all development team members in an extremely short period of time (< 1 to 2 days)

11

Page 45: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

Example: Building Automation Management System

Level 1Information

managementsystem

Level 2Information processingAnd supervisory system

Level 3Information processing/

Automation system

Level 4Process field

Page 46: Cloud Computing and Intelligent Systems: Two Fields at a Crossroads

Infinite Dimensions

Solving Tomorrow’s Problems Today

Components in a BAMS

fanAir conditioning

PC

Heat energy

sanitary

lighting

Waste-managementelectricalacoustics

video

safety

elevator

Emergency powersupply

transformer

heating

Building

700