integrated geotechnical data management for working engineers

Integrated Geotechnical Data Integrated Geotechnical Data Management for Working Management for Working Engineers and GeologistsEngineers and Geologists

Geohazards in Transportation Geohazards in Transportation in the Appalachian Regionin the Appalachian Region

4 4 –– 5 August 20045 August 2004Columbus, OhioColumbus, Ohio

Scot D. WeaverScot D. WeaverEarthSoft, Inc.EarthSoft, Inc.

AgendaAgenda

�� Geotechnical Data Management and the Geotechnical Data Management and the Impact on Geohazard MitigationImpact on Geohazard Mitigation

�� U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers Approach�� Proposed SystemProposed System�� Benefits of CollaborationBenefits of Collaboration�� ConclusionConclusion�� QuestionsQuestions

Geotechnical Data ManagementGeotechnical Data Management

�� Volume of DataVolume of Data�� Inability/Difficulty in Accessing DataInability/Difficulty in Accessing Data�� Incompatibility of Existing SystemsIncompatibility of Existing Systems�� Impact on Geohazards MitigationImpact on Geohazards Mitigation

Geotechnical Data ManagementGeotechnical Data ManagementVolume of DataVolume of Data

��Some project datasets filled thirty or more boxes.Some project datasets filled thirty or more boxes.��When the When the case was closed, as there was no practical way to archive case was closed, as there was no practical way to archive the data, it was all thrown awaythe data, it was all thrown away��..��

Quote from state agency:

Geotechnical Data ManagementGeotechnical Data ManagementVolume of DataVolume of Data

��Without the ability to manage data electronically, the quality of work suffered and hundreds of millions of data were lost forever.��

Quote from state agency:

Geotechnical Data ManagementGeotechnical Data ManagementInability/Difficulty in Accessing DataInability/Difficulty in Accessing Data

District only uses hard copies of log and testing District only uses hard copies of log and testing data.data. The information is stored in warehouses at The information is stored in warehouses at different places throughout Omaha.different places throughout Omaha.��

��The department is truly archaic The department is truly archaic when dealing with records.when dealing with records. It is It is my understanding that themy understanding that the

Quote from an engineer in Quote from an engineer in the US Army Corps of the US Army Corps of Engineers:Engineers:

Geotechnical Data ManagementGeotechnical Data ManagementInability/Difficulty in Accessing DataInability/Difficulty in Accessing Data

What can this result in?What can this result in?

In one Army Corps District, tens of In one Army Corps District, tens of thousands of dollars were spent thousands of dollars were spent unnecessarily on drilling new unnecessarily on drilling new boreholes within meters of boreholes within meters of previous drilling sites, simply previous drilling sites, simply because they didnbecause they didn��t know that the t know that the data existed.data existed.

Geotechnical Data ManagementGeotechnical Data ManagementIncompatibility of Existing SystemsIncompatibility of Existing Systems

�� Legacy SystemsLegacy Systems

�� New data acquisition systemsNew data acquisition systems�� Observation/field notebookObservation/field notebook�� RealReal--time monitoringtime monitoring�� Tabular field data entry (EDDs)Tabular field data entry (EDDs)�� Electronic field data entry formsElectronic field data entry forms�� Instrumentation/telemetryInstrumentation/telemetry

�� New data transfer protocols (and old devices)New data transfer protocols (and old devices)

�� Data Data ��hostagehostage�� scenarios (proprietary formats)scenarios (proprietary formats)

Geotechnical Data ManagementGeotechnical Data ManagementImpact on Geohazards MitigationImpact on Geohazards Mitigation

Nothing is more damaging to a new truth than an old Nothing is more damaging to a new truth than an old error.error.

──Johann Wolfgang von GoetheJohann Wolfgang von Goethe

If approached correctly, geotechnical data If approached correctly, geotechnical data management can be the cornerstone and foundation management can be the cornerstone and foundation for effective decision support and risk management. for effective decision support and risk management. Strong corollaries exist in the environmental market to Strong corollaries exist in the environmental market to support this approach.support this approach.

�� In 2003, the CADD/GIS Technology Center at the CorpsIn 2003, the CADD/GIS Technology Center at the Corps��Waterways Experiment Station (WES) in Vicksburg, MS Waterways Experiment Station (WES) in Vicksburg, MS funded Center Project #03.005funded Center Project #03.005

�� Objective: Objective: ��Develop an enterpriseDevelop an enterprise--wide geotechnical databasewide geotechnical database��

�� 17 US Army Corps of Engineer Districts were surveyed 17 US Army Corps of Engineer Districts were surveyed to determineto determine

�� the type and extent of geotechnical data of concernthe type and extent of geotechnical data of concern�� existing tools utilized for geotechnical data existing tools utilized for geotechnical data management and analysismanagement and analysis

U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure


�� In 2003, the CADD/GIS Technology Center at the CorpsIn 2003, the CADD/GIS Technology Center at the Corps��Waterways Experiment Station (WES) in Vicksburg, MS Waterways Experiment Station (WES) in Vicksburg, MS funded Center Project #03.005funded Center Project #03.005

�� Objective: Objective: ��Develop an enterpriseDevelop an enterprise--wide geotechnical databasewide geotechnical database��

�� 17 US Army Corps of Engineer Districts were surveyed 17 US Army Corps of Engineer Districts were surveyed to determineto determine

�� the type and extent of geotechnical data of concernthe type and extent of geotechnical data of concern�� existing tools utilized for geotechnical data existing tools utilized for geotechnical data management and analysismanagement and analysis


As a result of the survey a data structure has been As a result of the survey a data structure has been proposed that encompasses all known geotechnical data proposed that encompasses all known geotechnical data elements currently used within the Corps.elements currently used within the Corps.

�� Geotechnical, Geologic, NonGeotechnical, Geologic, Non--Geotechnical TablesGeotechnical Tables

�� 53 tables, over 600 fields53 tables, over 600 fields

�� Relational structureRelational structure


As a result of the survey a data structure has been As a result of the survey a data structure has been proposed that encompasses all known geotechnical data proposed that encompasses all known geotechnical data elements currently used within the Corps.elements currently used within the Corps.

�� Definition includes fieldDefinition includes field�� namename�� typetype�� length (if applicable)length (if applicable)�� required?required?�� key field?key field?

�� validationvalidation�� descriptiondescription�� aliases, abbreviationsaliases, abbreviations�� exampleexample


Geotechnical TablesGeotechnical TablesStatic material properties, water content, density, Static material properties, water content, density, AtterbergAtterberg, sieve, , sieve, hydrometer, specific gravity, compaction, UU/CU, compression, hydrometer, specific gravity, compaction, UU/CU, compression, direct shear, permeability, sedimentation, elastic modulus, direct shear, permeability, sedimentation, elastic modulus, downhole point (CPT), downhole point (CPT), ��

Geologic TablesGeologic TablesLithology, stratigraphy, sample, sample parameter, drill activitLithology, stratigraphy, sample, sample parameter, drill activity, y, drill parameter, drill parameter, ��

NonNon--Geotechnical TablesGeotechnical TablesProject, location, location parameter, coordinate, well, well Project, location, location parameter, coordinate, well, well construction, water level, water table, company, construction, water level, water table, company, ��


Data Structure must be compatible with SDSFIE.Data Structure must be compatible with SDSFIE.

What is SDSFIE?What is SDSFIE?

Spatial Data Standard for Facilities, Infrastructure, and Spatial Data Standard for Facilities, Infrastructure, and Environment (SDSFIE)Environment (SDSFIE)

�� Set of graphic and nonSet of graphic and non--graphic standards for GIS graphic standards for GIS implementationimplementation

�� The only nonThe only non--proprietary data content standard designed proprietary data content standard designed for use with predominant commercial GIS, CADD, and for use with predominant commercial GIS, CADD, and database softwaredatabase software



�� Standard for GIS implementation throughout the Standard for GIS implementation throughout the Department of DefenseDepartment of Defense

�� de facto standard for GIS implementation in many de facto standard for GIS implementation in many federal, state, and local agencies; public utilities; and federal, state, and local agencies; public utilities; and private industryprivate industry

HoweverHowever��



��while the SDSFIE is great with 2D features, and above while the SDSFIE is great with 2D features, and above ground, it is lacking in support of 3D subsurface features. ground, it is lacking in support of 3D subsurface features. It can well handle commissariesIt can well handle commissaries��

��but not but not consolidation consolidation

tests.tests.



The geotechnical attributes and domain tables defined in The geotechnical attributes and domain tables defined in the data structure will be added to the next version of the data structure will be added to the next version of SDSFIE.SDSFIE.


Ultimate goal of Center Project #03.005 is to produce an Ultimate goal of Center Project #03.005 is to produce an enterprise Geotechnical Data Management Systementerprise Geotechnical Data Management System

�� Easy to enter, edit, retrieve subsurface/laboratory dataEasy to enter, edit, retrieve subsurface/laboratory data

�� Interface with GIS, engineering design applicationsInterface with GIS, engineering design applications

�� Support production of boring logs for contract documentsSupport production of boring logs for contract documents


Ultimate goal of Center Project #03.005 is to produce an Ultimate goal of Center Project #03.005 is to produce an enterprise Geotechnical Data Management Systementerprise Geotechnical Data Management System

�� Anticipated implementation:Anticipated implementation:�� ArmyArmy 80 installations80 installations�� Army CorpsArmy Corps 41 District offices41 District offices�� NavyNavy 110 installations110 installations�� Air ForceAir Force 110 installations110 installations�� Other Federal agenciesOther Federal agencies 2929

The proposed system includes not only support for field The proposed system includes not only support for field and laboratory rock and soils data, but also:and laboratory rock and soils data, but also:

�� Geohazard InventoriesGeohazard Inventories�� Document ManagementDocument Management�� Research & PlanningResearch & Planning�� Instrumentation & MonitoringInstrumentation & Monitoring�� Archived Data and DocumentsArchived Data and Documents�� Emergency ResponseEmergency Response�� ConstructionConstruction�� StructuresStructures�� Highway Maintenance Highway Maintenance

Proposed SystemProposed SystemScopeScope

Proposed SystemProposed SystemData Entry and ImportingData Entry and Importing

Data Entry Forms Data Entry Forms

Enter data in a familiar format


Let the DEF automatically generate EDD

formats


Electronic DataElectronic DataDeliverableDeliverable(EDD) Checking(EDD) Checking

.Net, XML C# codeOffline EDD Preparation and CheckingOffers Private Checking mechanism Supports many EDDsUsed by more than 100 laboratories

.Net, XML C# codeOnline EDD Web-enabledReceipt and Checking, Automated WorkflowSharePoint Doc Mgmt Interfaces

StandaloneEDP

Enterprise EDP EQuIS

Enterprise

EDD Submission

Valid Values, Format Definitions Downloaded from EQuIS

Checkers use same code—closed loop transaction!

EDP Data FlowEDP Data Flow

EQuISEnterpriseData Mgmt

SharePointDocument

Mgmt

EDD Reports�Failure Reports and Error Logs

�Acceptance Reports

�Analysis Reports

�Decision Support Reports

�3rd Party Graphics

�DQM Reports

Doc mgmt provides:

Version Controls

File Mgmt

Edit Mgmt

Keyword Searches

EDP Feedback LoopEDP Feedback Loop


Integration/Import from gINT Databases Integration/Import from gINT Databases

GeotechnicalData

ManagementSystem


ArcPadArcPad integration with handheld device for incorporation integration with handheld device for incorporation of GPS data of GPS data

Proposed SystemProposed SystemDocument ManagementDocument Management

Integration with Falcon/DMS Integration with Falcon/DMS

Proposed SystemProposed SystemGeotechnical Reports/GraphicsGeotechnical Reports/Graphics

IntegrationIntegrationwith gINT:with gINT:Borehole Log Borehole Log

Proposed SystemProposed SystemGISGIS

�� Open GIS Consortium (OGC) CompliantOpen GIS Consortium (OGC) Compliant�� Support Dynamic Linear SegmentationSupport Dynamic Linear Segmentation�� Both thinBoth thin--client (i.e. client (i.e. ArcIMSArcIMS) and thick) and thick--client (i.e. client (i.e. ArcGISArcGIS) solutions) solutions�� Conventionally, GIS is used as an analysis tool. Conventionally, GIS is used as an analysis tool. Solution uses GIS as a user interface:Solution uses GIS as a user interface:

�� data selectiondata selection�� postingposting�� viewingviewing�� integration with other modeling and analysis toolsintegration with other modeling and analysis tools

Proposed SystemProposed System““PushPush”” Automated ReportingAutomated Reporting

�� Reports (or graphs, or logs) delivered automaticallyReports (or graphs, or logs) delivered automatically

�� May be eventMay be event--driven, i.e.driven, i.e.��a new borehole has been entered into the databasea new borehole has been entered into the database��

OrOr

�� May be scheduled, i.e.May be scheduled, i.e.��every Friday at 1 p.m. give me a report of all drilling every Friday at 1 p.m. give me a report of all drilling activity for that weekactivity for that week��

Proposed SystemProposed System““PushPush”” Automated ReportingAutomated Reporting

1. Report 1. Report scheduledscheduled

2. Report 2. Report generated generated when condition when condition is metis met

EQuIS Integrated OutputEQuIS Integrated Output

Data must be Data must be integrated into its integrated into its geophysical, geophysical, environmental, environmental, and cultural and cultural context for many context for many analyses leading analyses leading to decisionto decision--making. This is making. This is achieved at a high achieved at a high level through the level through the EQuIS for ArcGIS EQuIS for ArcGIS interface.interface.

Benefits of CollaborationBenefits of Collaboration

This project may benefit by collaboration and cooperation This project may benefit by collaboration and cooperation of several agencies and companies.of several agencies and companies.

�� Consistent with national initiative to support information Consistent with national initiative to support information and technology transferand technology transfer

�� Requires the establishment of electronic standards for Requires the establishment of electronic standards for geotechnical data (soil, rock and water)geotechnical data (soil, rock and water)

�� Provides the foundation for data sharing in similar Provides the foundation for data sharing in similar geologic regionsgeologic regions

Benefits of CollaborationBenefits of Collaboration

This project may benefit by collaboration and cooperation This project may benefit by collaboration and cooperation of several agencies and companies.of several agencies and companies.

�� Lessens the significance of political boundaries Lessens the significance of political boundaries

�� Improves cooperation between state agencies and Improves cooperation between state agencies and between state agencies and federal oversight agenciesbetween state agencies and federal oversight agencies

�� Reduces cost and delay associated with change ordersReduces cost and delay associated with change orders

�� Reduces costs associated with project designReduces costs associated with project design

�� Overall improved decisionOverall improved decision--support to mitigate geohazardssupport to mitigate geohazards

ConclusionConclusion

The described collaborative approach, The described collaborative approach, innovative, marketinnovative, market--leading, proven base leading, proven base technology and combined experience will technology and combined experience will

provide the foundation for effective provide the foundation for effective geotechnical decision support, leading to geotechnical decision support, leading to

improved geohazard mitigation.improved geohazard mitigation.

ConclusionConclusion

The Geotechnical Data Management The Geotechnical Data Management System described is the anticipated course System described is the anticipated course

of action for the Ohio DOT.of action for the Ohio DOT.

Questions?Questions?

Thank You!Thank You!