A Disaster Recovery System Featuring Uncertainty Visualization and Distributed Infrastructure

Metrics of a System for Disaster Relief

Lynne GreweCalifornia State University East Baylynne.grewe@csueastbay.edu

Presentation by Funda Erdin

My name is Funda Erdin and I am going to present the talk on Metrics of a System for Disaster Relief on behalf of Professor Lynne Grewe. I am a student of Lynnes in Computer Science but, was not part of the group directly involved in this research. As such, I hope to be able to explain the system well but, will pass on any questions to Lynne or you can contact her directly at the email listed here and in the paper.1Disaster Recovery

Disaster Recovery is an important problem and can encompass both man-made and natural disasters. Here we show a few images of disaster scenes. Disasters can include events like fires, hurricanes, earth quakes, bombings.2IssuesDisaster Incident Definition/ProtocolCategories of Data representing IncidentMethods of Data CaptureData and Uncertainty Computer RepresentationFusion Processes to Reduce Data Size.Storage and Data Distribution NeedsPersonnel Roles and related Security NeedsData PresentationCommunication Needs and PerformanceAdministration and Incident Control ToolsHere are some of the many issues that this research attempts to address in its creation of a system to handle disaster recovery. Highlighted in yellow are the topics we are going to emphasize in our discussion today and they have in common the issue of METRICS for our disaster recovery system.3Previous WorkCurrently, mostly disaster relief is performed without any computer management tools as shown in imagesProtocols (NIMS/ICS)Describe human interactions not as quantifiable as neededSpecialized ComponentsSome previous work concentrates on very specific issues (e.g. ambulance routing)C3 related workCommand, Control, Communications C3, US military related work, goals are not disaster relief

Lets first look at previous work in the field of disaster recovery.Currently very little computers involved, and certainly not at the level of what we have created. Related Research has some proposed systems. Ours unique in a number of ways refer to the paper for more details on this. But, include use of data fusion, uncertainty visualization, distributed infrastructure and more.NIMS/ICS this is a protocol about command and personnel interactions. Uses paper forms, and these forms are often very sparse or open (hence not quantifiable easilypeople can write as little or as much or as differently as they want). Specialized WorkE.g. Show map tracking ambulances driving using GIS and GPS.C3 : this is military research, there are some ties here, our work is unique in a number of ways, Note: FEMA (federal emergency management agency in US is now part of Homeland Security).4

Here is an example of an ICS form. As you can see the information is very open meaning what a person might right in will change in completeness and format from person to person.

Example : location is this an address, a map location or??? While this form is small there is a lot to fill out and if changes need to be made, it will be again on papercomputers better at this. Also, we can standardize more the input metrics so that there is complete understanding from users and it can also help us in data fusion and presentation stages.5Our System: DiRecT(Disaster Recovery Tool)VisualizationUncertainty VisualizationDistributed InfrastructureCommunications Application of Mobile AgentsProtocol StructureClient Control

Our proposed problem is the creation of a system called DiRecT that has these features.

Protocol Structure adheres to NIMS/ICS command structure.6

DiRecT Overview

This is an overview of the DiRecT systems. Includes:

DiRecT field Client can be used by field personnel to enter in data, view visualization, communicate with others, etc.DiRecT Incident Command Station all the facilities of the Field Client plus additional functions associated with an Incident Commander like personnel and resource requests and assignments.DiRecT Server server responsible for storage and distribution of information.DiRecT Admin Client application for DOC/EOC (disaster and emergency centers) has capabilities of incident creation, assignment, resource allocation, personnel creation and assignment, etc.7DiRecT Server EJB components for persistence and business logic JMS and Mobile agents for instant-memoing JMS for incident updates Oracle database for persistence

DiRecT Field & Incident Command Clientscreate a new incidentmanage multiple incidentsrequest resources, personnel and equipment for a given incidentassignment of personnel

DiRecT Admin Client Activation / Deactivation of incidentsCreation of new personnel, equipment and resources.Assigning personnel to incidentsFulfilling resource requestsPurging incidents from the database

IncidentTracking of victims, personnelHazardous materialsNatural hazards responseSearch-and-rescue missionsFire controlAir, rail, ground, and water transportation accidentsIncidents with multiple casualtiesand others.Planned human events, e.g., large crowd gatherings, concerts, etc.

Using the NIMS/ICS protocol an Incident can be defined to have these associated issues and OTHERS11Incident Creation

Hiding this slide .dont need but, this shows setup of initial Area Grid (called Incident Visualization Grid) that is associated with an Incident . It is a metric size giving some sense of the physical size of the Incidentthis can be altered at any time, but, is used to define the area we do visualization against.12Beginning of Incident

So, once an Incident is defined this is the main interface seen by the Field Client. It contains on the left a current visualization (here we only have a simple map to start with) and on the right are the tab of:Data for data entryComm communications moduleReports for filling out (if desire ) reports like those in NIMS/ICSVisual Control allows user to control visualization they see (like saying show me only the most certain events/objects in the Incident).Incident Control for request with regards to Incident needs.13Incident DataMany kinds of data possible, different operating units (firefighters, police, etc) may want different kinds of data.DiRecTs Data CategoriesBioTargets (victims)Search AreasEquipmentPersonnelHazardsImagery

We choose these data categories as they were the most prominent and commonly found in different kinds of incidents.We will look at the data and uncertainty metrics used to capture these kinds of data entries in the next slides.One area of future enhancement is the inclusion of more data. However, to have too many categories would clutter the interface and possibly make it more difficult to enter in data in a timely (quick) fashion14Data and Uncertainty Metric GoalsQuickly enter in dataCapture the essence of the underlying dataAllow for longer more narrative (open) forms of data capture optionally.Have quantitative metrics when possible to make visualization easier and storage efficient.Have metrics easily understood by all types of possible users.Have metrics be intuitive when possible.

We choose these data categories as they were the most prominent and commonly found in different kinds of incidents.We will look at the data and uncertainty metrics used to capture these kinds of data entries in the next slides.One area of future enhancement is the inclusion of more data. However, to have too many categories would clutter the interface and possibly make it more difficult to enter in data in a timely (quick) fashion15BioTarget Data MetricsCapture common dataQuantizeCapture uncertainties.Data measured: IdentityLocationHealthSafety

Remember dont want to require too much information.Chose these elements as the most import and common ones.16Biotarget Data CaptureIdentity

Identity ScreenNameAgeClassification human or animal (keep simple)Certainty = both identity and presence certainty combined in 1 metric, USE COMMON SENSE idea of probability 0 (completely uncertain) to 100 (completely certain)17Biotarget Data CaptureLocation

Location ScreenAddress or Map CoordinatesMap Coordinates can enter in using MOUSE OR by hand in dialog boxes.Certainty again 0 to 100 range18Biotarget Data CaptureHealth

Location ScreenAddress or Map CoordinatesMap Coordinates can enter in using MOUSE OR by hand in dialog boxes.Certainty again 0 to 100 range19Biotarget Data CaptureSafety / Status

SafetyLevel here we are trying to quantify where 0 is danger/unsafe and 100 is safeOptional descriptionCertainty 0 to 10020Search Area MetricsRepresent areas of search (or past search)Typical geometries rectangular, circularCapture uncertainties.Data measured: Geometry size, shape, location, searching or searched

Scenes here are from FEMA data which show areas of search as overlays on imagery as rectangles and circlesthese are common geometries used.21Search Area Data Capture Give identity through nameLabel as searching or searchedGive geometry and associated certainty of this

Geometry enter in with mouse clicks or text boxes

Certainty only for geometry22Equipment Data MetricsRepresents various kinds of equipment and resources in the fieldCould be lots of different kinds of equipmentData measured: Identity, type, location

Certainly difficult to specify all of the kinds of equipment possible. This is a real challenge and could lead to some interesting user-interface-specification interfaces when it comes to the visualization task.23Equipment Data Capture Give identity through nameLabel Category or type in your own if not listedLocation same as biotarget data captureRight screen shows listing of current equipment in Incident.

Besides the visualization of data, there is also a listing of data elements like the list of Equipment you see on the right. You can select a piece of equipment by clicking here or on its visualization (will show later).24Personnel Data MetricsRepresents various personnel in the field (firefighters, police, etc).Data measured: Identity, personnel type, location

25Personnel Data Capture Give identity through nameType indicates unit personnel belongs to.Location same as BioTarget data capture

Certainty here reflects presence in incident or not (does not reflect identity as it does for BioTargets)26Hazard Data MetricsRepresents hazards in the scene.Many kinds (fire, water, wind, etc).Data measured: Identity, location

27Hazard Data Capture Give identity through name, type, optional description, condition and certaintyCondition scale of 0 to 100 indicating level of containment & severity. 0 is contained/low level problem. 100 is not contained/critical

28Imagery Data MetricsRepresents raw imagery type data collected about incident.Many kinds possible photographic imagery, infra-red, maps, etc.Data is ALREADY quantifiedProblem here is to register the data against our Incident Visualization Grid so it can be fused.Data measured: File upload, User entered Registration points

29Imagery Data Capture Name of image layerActivate layer or notData fileRegistration informationSpecified by user by clicking with mouse on upper-left and lower-left location ofimage boundaries.Opacity controlOptional descriptionRotation control

No certainty metric captured here as user is providing registration (albeit with inherent errors)It is assumed that through this there is some kind of visual confirmation that its identity is validated.Does simple registration, can apply more elaborate techniques for computer fine registration.30DiRecT VisualizationDiRecT take these data and certainty metrics and performs visualization

Some Visualization CuesOpaqueness-TransparencyIcons/GlyphsColor (pseudo-coloring or color representation)Brightness/IntensityTextureAtmospheric EffectsAdding/Altering GeometryLayersFocusPop-up textual informationAnimationMorphingTime FadingSounds (volume, key, duration, fade)

There are lots of visualization (and uncertainty visualization) techniques. Here are a few.32Biotarget VisualizationIconic

Color

Transparency

Location

Bloom

indicates BioTarget idenity typeIndicates combined Healthand Safety w/Certaintyindicates identity and presence certaintyindicates location informationindicates location certainty

We are not going to show you for each data type how we do visualization as this is not the focus of this talk. However, we will discuss it for BioTargets.DO NOT represent all information about a BioTarget visually, but, we feel the MOST important infoWould be too visually cluttered to try to represent all metrics visually.User can click on icon (or the object in its listing) to see the data entry GUIs and read more details and optional descriptions about a BioTarget.

33Biotarget ColorCHCSALTERED COLORICON100100Unchanged RED50100Unchanged RED7575Some Uncertainty ORANGE5050Significant Uncertainty ORANGE YELLOW00Very Much Uncertain - YELLOWColor of Icon = F(Health,Saftey, Certainty) Red = Max(ColorSafetyR, ColorHealthR) Green =Min(ColorSafetyG,ColorHealthG)

This visualization is intuitive. Red alarm/high concern. Green safe Yellow caution/uncertain.

Sometimes makes sense to combine data metrics into 1 visual queue.

Color = Health + Safety + Certainty of EachThis makes sense as both bad health OR unsafe are CRITICAL conditions you would want personnel to respond to quickly.

This visualization is intuitive. Red alarm/high concern. Green safe Yellow caution/uncertain.34

Example VisualiztionImage, map, BioTargets, Search Areas, Equipment, Hazard and Personnel.

A simple visualization with samples from each of the categories.35Search Area VisualizationColorsearching searched

Shape

Transparency

Location

Can show if wantbut, not necessary

36Equipment Visualization Iconic &Color Medical Hazard WaterTransparency

Location&Bloom

Can show if wantbut, not necessary

37Personnel Visualization Iconic

Transparency

Location&Bloom

Can show if wantbut, not necessary38Hazard Visualization Iconic &Color Water Explosion ChemicalTransparency

Location&Bloom

Can show if wantbut, not necessary

39Visualization ControlControl clutterBetter DecisionsView only desired data

DiRecT has many other features we do not have time to discuss. One very important one related to Visualization is the filtering of visuals through the control panel. Make it easier to see things or importance at the time OR can be used to find things.40Contrast

No need to show.41 Biotarget

BeforeHighlight 60%

Shows filtering based on certainty.44Infometrics basic statistics about Incident.CountSearch

Search and highlight for biotargets Health