the web, text, data, and xml
DESCRIPTION
The Web, Text, Data, and XML. December 3, 1998. Bruce Bargmeyer EPA/OIRM/EIM Division Tel: (202) 260-5306 [email protected] WWW URL: http://sdct-sunsrv1.ncsl.nist.gov/~bargmeye. Terminology and the EDR. Thesaurus. Data Elements. Ontology. Sources. XML. Topics. - PowerPoint PPT PresentationTRANSCRIPT
SDC-0055-057-JE-8013
December 3, 1998
SDC-0055-057-JE-8013
Bruce Bargmeyer
EPA/OIRM/EIM Division
Tel: (202) 260-5306
WWW URL: http://sdct-sunsrv1.ncsl.nist.gov/~bargmeye
index.html
SDC-0055-057-JE-8013
Topics
Terminology and the EDR
Thesaurus
Data Elements
Ontology
Sources
Sharing Environmental Information
XML
SDC-0055-057-JE-8013
• System managers• System developers• Subject area specialists• Program managers• Scientists• NGOs• Public• Legislative bodies• Statistician/analysts• Regulation writers• ……..
Users:
SDC-0055-057-JE-8013
• System managers• System developers• Subject area specialists• Program managers• Scientists• NGOs• Public• Legislative bodies• Statistician/analysts• Regulation writers• ……..
Users:
SDC-0055-057-JE-8013
• Produce State of the Environment report•Design/build computer systems•Writing legislation and regulations•Track/monitor status of environment•Statistical analyses•Problem solving•Environmental planning
Activities:
SDC-0055-057-JE-8013
Users
Accessing text and data
EEA
DOE
DoD
EPAenvironagricultureclimatehuman healthindustrytourismsoilwaterair
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text data
environagricultureclimatehuman healthindustrytourismsoilwaterair
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text
ambienteagriculturatiemposalud hunanoindustriaturismotierraaguaaero
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text data
data
environagricultureclimatehuman healthindustrytourismsoilwaterair
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text data
Others . . .
ambienteagriculturatiemposalud hunoindustriaturismotierraaguaaero
123345445670248591308
123345445670248591308
3268082513485038
3268082513485038270800002178
text data
SDC-0055-057-JE-8013
EEA
DOE
DoD
EPA 123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text dataenvironagricultureclimatehuman healthindustrytourismsoilwaterair
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text datasambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text dataenvironagricultureclimatehuman healthindustrytourismsoilwaterair
Others . . .
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
123345445670248591308
123345445670248591308
3268082513485038
3268082513485038270800002178
text data
environagricultureclimatehuman healthindustrytourismsoilwaterair
SDC-0055-057-JE-8013
Search Engine Queries
SearchEngine
EEA
DOE
DoD
EPA 123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text dataenvironagricultureclimatehuman healthindustrytourismsoilwaterair
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text datasambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text dataenvironagricultureclimatehuman healthindustrytourismsoilwaterair
Others . . .
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
123345445670248591308
123345445670248591308
3268082513485038
3268082513485038270800002178
text data
environagricultureclimatehuman healthindustrytourismsoilwaterair
SDC-0055-057-JE-8013
SearchEngine
Search engines do not find traditional
data.
EEA
DoD
EPA
text
textenvironagricultureclimatehuman healthindustrytourismsoilwaterair
textambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
textenvironagricultureclimatehuman healthindustrytourismsoilwaterair
Others . . .
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
text
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
datas
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
data
data
environagricultureclimatehuman healthindustrytourismsoilwaterair
DOE
Challenges
SDC-0055-057-JE-8013
Challenges
SearchEngine
Search engines are not used well for
multilingual information.
environagricultureclimatehuman healthindustrytourismsoilwaterair
environagricultureclimatehuman healthindustrytourismsoilwaterair
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
environagricultureclimatehuman healthindustrytourismsoilwaterair
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
EEA
DOE
DoD
EPA 123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text datas
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text data
Others . . .
text data
text
SDC-0055-057-JE-8013
Challenges
SearchEngine
Hard to use retrieved data in PC
software.
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
EEA
DOE
DoD
EPA 123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text datas
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
data
Others . . .
data
environagricultureclimatehuman healthindustrytourismsoilwaterair
environagricultureclimatehuman healthindustrytourismsoilwaterair
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
text
environagricultureclimatehuman healthindustrytourismsoilwaterair
SDC-0055-057-JE-8013
Challenges
??
SearchEngine
Users lack information on data
quality and meaning.
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
EEA
DOE
DoD
EPA 123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text datas
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
data
Others . . .
data
environagricultureclimatehuman healthindustrytourismsoilwaterair
environagricultureclimatehuman healthindustrytourismsoilwaterair
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
text
environagricultureclimatehuman healthindustrytourismsoilwaterair
??
SDC-0055-057-JE-8013
Challenges
SearchEngine
Data exchange between systems is
difficult.
environagricultureclimatehuman healthindustrytourismsoilwaterair
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
environagricultureclimatehuman healthindustrytourismsoilwaterair
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
EEA
DOE
DoD
EPA 123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text datas
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text data
Others . . .
text data
text
environagricultureclimatehuman healthindustrytourismsoilwaterair
SDC-0055-057-JE-8013
Search engines do not find traditional data Search engines and DBMSs not used well
for multilingual information Users lack information on data quality and
meaning Hard to use retrieved data in PC software Data exchange between systems is difficult Not tailored for environmental information
Challenges
SDC-0055-057-JE-8013
Steps Forward
SearchEngine
Metadata Registry Terminology Thesaurus Themes GEMET
Catalog of Data Sources (CDS)Environmental Data Registry (EDR)
EEA
DOE
DoD
EPA
text
textenvironagricultureclimatehuman healthindustrytourismsoilwaterair
textambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
textenvironagricultureclimatehuman healthindustrytourismsoilwaterair
Others . . .
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
text
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
data
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
datas
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
data
data
environagricultureclimatehuman healthindustrytourismsoilwaterair
SDC-0055-057-JE-8013
Increased Understanding
Catalog of Data Sources (CDS)Environmental Data Registry (EDR)
SearchEngine
StructuredMetadata
Metadata Registry Terminology Thesaurus Themes GEMET
EEA
DOE
DoD
EPA
text
textenvironagricultureclimatehuman healthindustrytourismsoilwaterair
textambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
textenvironagricultureclimatehuman healthindustrytourismsoilwaterair
Others . . .
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
text
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
data
123345445670248591308
123345445670248591308
3268082513485038270800002178
data
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
datas
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
data
data
environagricultureclimatehuman healthindustrytourismsoilwaterair
SDC-0055-057-JE-8013
Facilitates Data Access
Middleware
StructuredMetadata
Catalog of Data Sources (CDS)Environmental Data Registry (EDR)
Metadata Registry Terminology Thesaurus Themes GEMET
EEA
DOE
DoD
EPA 123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text dataenvironagricultureclimatehuman healthindustrytourismsoilwaterair
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text datasambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text dataenvironagricultureclimatehuman healthindustrytourismsoilwaterair
Others . . .
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
123345445670248591308
123345445670248591308
3268082513485038
3268082513485038270800002178
text data
environagricultureclimatehuman healthindustrytourismsoilwaterair
SDC-0055-057-JE-8013
Enhanced Data System Exchange
Middleware
EnhancedData
Exchange
Catalog of Data Sources (CDS)Environmental Data Registry (EDR)
DataStandards
Metadata Registry Terminology Thesaurus Themes GEMET
EEA
DOE
DoD
EPA 123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text dataenvironagricultureclimatehuman healthindustrytourismsoilwaterair
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text datasambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text dataenvironagricultureclimatehuman healthindustrytourismsoilwaterair
Others . . .
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
123345445670248591308
123345445670248591308
3268082513485038
3268082513485038270800002178
text data
environagricultureclimatehuman healthindustrytourismsoilwaterair
EDIXML-EDIXML-DataWeb Forms
SDC-0055-057-JE-8013
Queries Through Middleware
Ontology GEMET
StructuredMetadata
Catalog of Data Sources (CDS)Environmental Data Registry (EDR)
IntelligentSystems
MiddleWare
InfoSleuth
Metadata Registry Terminology Thesaurus Themes
DataStandards
EEA
DOE
DoD
EPA 123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text dataenvironagricultureclimatehuman healthindustrytourismsoilwaterair
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text datasambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text dataenvironagricultureclimatehuman healthindustrytourismsoilwaterair
Others . . .
ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
123345445670248591308
123345445670248591308
3268082513485038
3268082513485038270800002178
text data
environagricultureclimatehuman healthindustrytourismsoilwaterair
SDC-0055-057-JE-8013
Queries Using Resource Agents
Resource Agents (RAs)
StructuredMetadata
Catalog of Data Sources (CDS)Environmental Data Registry (EDR)
IntelligentSystems
MiddleWare
InfoSleuth
Metadata Registry Terminology Thesaurus Themes
DataStandards
EEA
DOE
DoD
EPA 123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text data
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text dataenvironagricultureclimatehuman healthindustrytourismsoilwaterair
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text datasambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero
123345445670248591308
123345445670248591308
3268082513485038270800002178
3268082513485038270800002178
text dataenvironagricultureclimatehuman healthindustrytourismsoilwaterair
RA
RA
RA
RA
environagricultureclimatehuman healthindustrytourismsoilwaterair
Ontology GEMET
SDC-0055-057-JE-8013
Example of data changes world-wide.
Change
ISO
ANSIIndustry
EPA
Country
Country changesCZ Czechoslovakia*
CZ Czech Republic**LO Slovakia**
* FIPS PUB 10-3** FIPS PUB 10-4
SDC-0055-057-JE-8013
Example of data changes world-wide.
Change
ISO
ANSIIndustry
EPA
Biological terms
New speciesNew classification
Scientific NameVernacular Name
Taxonomic Serial Number
SDC-0055-057-JE-8013
Example of data changes world-wide.
Change
ISO
ANSIIndustry
EPA
Chemicals
New chemicalSystematic Name
SynonymCAS Number
SDC-0055-057-JE-8013
As data changes world-wide, metadatachanges can be recorded and effectively
communicated between metadata registries.
Change
ISO
ISO/IEC 11179Metadata Registry
Standard
DefenseData Dictionary
Sources
Catalog ofData Sources
HealthCare
FinanceAdministration
IntelligentTransportation
System
EnvironmentalData
RegistryANSI
IndustryEPAS
tan
dar
d D
ata
SDC-0055-057-JE-8013
Terminology
fish
= fish
SDC-0055-057-JE-8013
Concept
Sign Object
Elements of Terminology
troutSalmo truttabrown trouttruite
any of several game fishes of the genus Salmo, related to the salmon...
SDC-0055-057-JE-8013
Terminology
Terms ContextConcept
troutSalmo truttatruite
common namescientific nameFrench name
any of several game fishes of the genus Salmo, related to the salmon...
UIN=6349
SDC-0055-057-JE-8013
Search Example:Fish TroutTrout
Documents Data1 2 3 4 5 6 7 8
SearchEngine
Terms ContextConcept
Brown troutSalmo truttatruite
common namescientific nameFrench name
UIN=6349Thesaurus
Salmo truttaBrown Trout
trout
fish
SDC-0055-057-JE-8013
DataElements
Name: trout species
Definition: The names of species of trout.
Values: brook trout -- Salvelinus fontinalisbrown trout -- Salmo truttacutthroat trout-- Oncorhynchus clarkii ...
Systems:STORETEnvirofacts . . .
DataElements
DBMSQuery
Web-enabled FormsEDI Messages
DataInterchange
Federal RegisterRegulationsReports
DocumentsPublishing
Terms ContextConcept
Brown troutSalmo truttatruite
common namescientific nameFrench name
UIN=6349
SDC-0055-057-JE-8013
EPA
EEA
DOE
DoD
Terms ContextConcept
Brown troutSalmo truttatruite
common namescientific nameFrench name
UIN=6349
LocalMapping
CentralMapping
Query AgentBrokerMediatorResource Agent
IntelligentInformation
Services (IIS):Ontology
Example:
fish trout brown trout
SDC-0055-057-JE-8013
General EuropeanMultilingual
EnvironmentalThesaurus(GEMET)
Facilitated Sessions:Government
FederalState/Local
Private EnterpriseAcademia
Thesauri DataElements
Data Sources
Terms ContextConcept
Brown troutSalmo truttatruite
common namescientific nameFrench name
UIN=6349
SDC-0055-057-JE-8013
OntologyOntologyThesaurusThesaurus
Deployment Technologies
DataDataElementsElements
SearchEngine
DBMS/EDI/ Documents
IIS
a category of vertebrate, cold-blooded craniate animals with permanent gills...
SDC-0055-057-JE-8013
As data changes world-wide, metadatachanges can be recorded and effectively
communicated between metadata registries.
ISO/IEC 11179Metadata Registry
Standard
DefenseData Dictionary
Sources
Catalog ofData Sources
HealthCare
FinanceAdministration
IntelligentTransportation
System
Sta
nd
ard
Da
taEDR
Change
ANSIIndustry
EPA
ISO
SDC-0055-057-JE-8013
What is XML?
Extensible Markup Language (XML) Simplified SGML
(Standard Generalized Markup Language, ISO 1986)
Next generation HTML Semantic structure of document or data Extensible, industry-specific tag sets Display determined by style sheets
(CSS, XSL)
(Source: John McCarthy, Frank Olken, and Roy Tennant, April 1998)
SDC-0055-057-JE-8013
XML Example
Markup
Character Data
<?xml version =“1.0”?>
<book>
<author>
<name>Richard Light</name>
<email>[email protected]</email>
</author>
<title>PresentingXML</title>
</book>
(Source: John McCarthy, Frank Olken, and Roy Tennant, April 1998)
SDC-0055-057-JE-8013
XML Goals & Philosophy
Overcomes shortcomings of HTML Allows processing of Web documents by
sophisticated document processing software Overcomes shortcomings of SGML
Allows media-independent electronic publishing
Interoperates with HTML and SGML Provides vendor-neutral data exchange
(Source: John McCarthy, Frank Olken, and Roy Tennant, April 1998)
SDC-0055-057-JE-8013
Increasing industry interest and acceptance
Parsers in multiple computer languages JAVA, C++, Perl, Python, etc.
Additional industry-specific tag sets Full Web browser support Growing set of authoring/processing tools
Where is XML Going?
(Source: John McCarthy, Frank Olken, and Roy Tennant, April 1998)
SDC-0055-057-JE-8013
OntologyOntologyThesaurusThesaurus
Role of XML
DataDataElementsElements
SearchEngine
DBMS / EDI / Documents
IIS
XMLXML XMLXML
XMLXML
XMLXML
SDC-0055-057-JE-8013
As data changes world-wide, metadatachanges can be effectively
communicated using XML between metadata registries.
ISO/IEC 11179Metadata Registry
Standard
DefenseData Dictionary
Sources
Catalog ofData Sources
HealthCare
FinanceAdministration
IntelligentTransportation
System
Change
ISO
ANSIIndustry
EPASta
nd
ard
Da
taEDR
XML
XML
XML
XML
XML
SDC-0055-057-JE-8013
Progress
• Memorandum of Agreement - EPA, EEA, DOD, DOE
• Joint Action Document
• Tasks, Deliverables and Milestones for InfoSleuth Project– Phase One demonstration successful
• GEMET Agreement
SDC-0055-057-JE-8013
Cooperative Efforts
• Joint Articles with the EEA
• Common environmental terminology– GEMET
• Structured descriptions of data and text– EDR & CDS
• Terminology collaboration with selected states
SDC-0055-057-JE-8013
Cooperative Efforts
• Technology Demonstrations– GEMET for cataloging and searching
• Search engine for text and data
– EDR and CDS development and integration• Global Information Locator Service
– MCC InfoSleuth• EPA, DOD, DOE, EEA
• EPA and states
SDC-0055-057-JE-8013
Next Steps
• Collaborate on terminology– Thesaurus, topic trees, ontology
• Collaborate on metadata
- Well-formed data elements
• Collaborate on data/text description– Connect EDR to CDS through Global Information
Locator Service
• Collaborate on metadata registries (e.g., EDR)
SDC-0055-057-JE-8013