da_map
TRANSCRIPT
![Page 1: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/1.jpg)
Sachin Bhate (PI), Jim Corbin, John Van Der ZwaagYee Lau and Surya N Renduchintala
June 18, 2003
Sponsor: Office of Naval Research
![Page 2: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/2.jpg)
“Oceanographers are there, researchers are there, there are models running in every part of ocean, there is a buoy floating somewhere, there is some data collected possibly every minute, and there is a weatherman out somewhere watching for us. It is very important for us to keep our eyes and ears open, keep a clear mind and think, how we can build new bridges between these modelers and data collectors, improve the communication between researchers and weathermen, and create a wave of virtual collaboration in oceanographic and atmospheric community.”
- Sachin Kumar Bhate
![Page 3: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/3.jpg)
Motivation behind DA_MAP
• Provide transparent access to diverse data
• Integrate data access interactively with visualization and analysis
• Be intuitive and user friendly • Exploit utility of a desktop/laptop computer
• Exploit state-of-the-art software technology• Be easily extensible and platform independent
Create an application for a METOC data analyst/modeler that allows more time to be spent on analysis and less on finding data and figuring out how to use it. It should:
![Page 4: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/4.jpg)
Emphasis areas
• NAVOCEANO: Our initial user
• METOC Data Analysis and Model Assessment.
• Ocean model output and in-situ observations
• Data Registration and Metadata
• SearchNQuery mechanism (Correlation)
• Interactive visualization/analysis environment
![Page 5: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/5.jpg)
Our Technical Approach• Java
– Our main driver for application– Graphical User Interface– Visualization (Java2D)– NetCDF Java Interface (Unidata)
• JWS (Java Web Start)– An application deployment web technology, gives the
user the power to launch full-featured applications with a click from a standard web browser
– Just an HTTP server is enough– Facilitates easy installation and updates for
applications– Launch DA_MAP on any desktop from anywhere.
![Page 6: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/6.jpg)
More…
• XML (eXtensible Markup Language)
– Metadata representation and data registration
– Search and query operation
– Easy to understand and implement
– Less maintenance
– Better future prospects
JAVA
JWS XML
![Page 7: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/7.jpg)
DA_MAP Architecture
Registration Search&Query Data Analysis
Middle TierHTTP server, JWS,
XML
Metadata
(XML)
Front End
(JWS, Java, XML, XPath)
Back EndLocal Data
RemoteData
![Page 8: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/8.jpg)
Data Flow between different modules of DA_MAP
Data Registration/Metadata CreationSearchNQuery
Data AnalysisLocal/Remote
Data
Store Metadata
(XML records)
Register Data(Create metadata &
Data Dictionary)
Provide DataLocation
Import Data
Access Metadata
Metadata Repository
(XML metadata,Data dictionary)
Access Metadataand Data Dictionary
![Page 9: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/9.jpg)
DA MAP Portal
Integrated environment withaccess to:• Setting workspace• METOC data registration• Metadata creation• METOC Data Search• METOC Data Analysis• Interactive Analysis
![Page 10: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/10.jpg)
Data Registration Module
• Metadata easily read from self describing NetCDF data files• User interface for mapping variable names (Data Dictionary)• Metadata stored in XML format.
• Define datatypes to create mappings for a class of METOC data variables and dimensions to automatemetadata creation for large number of data files.
• Next…..Closer look at the metadata records…
![Page 11: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/11.jpg)
Metadata (XML)<damapMetadataModel> <modelType type="SWAFS"> <dataType type="SWAFS_AMERICAS"> <modelRun name="swafs_americas_gom_1052194377"> <dtg>
<beginDate year="2001" month="3" day="7" time="1:0:0" epochalTime="983926800"/> <endDate year="2001" month="3" day="9" time="19:0:0" epochalTime="984164400"/> </dtg> <listParameters>
<parameter pname="longitude" min="261.99573" max="279.95447"/> <parameter pname="current_Vcomponent" min="-100.0" max="2.21"/><parameter ………………………………………………………….. “/> <parameter pname="sigma" min="0.0" max="0.97"/> <parameter pname="bathy" min="6.0" max="5620.0"/>
</listParameters> <domain> <domainValues elon="-80.0" wlon="-98.0" nlat="31.0" slat="17.0"/> </domain> <Location>
<URL uname="file://C:/data/SWAFS/swafs_americas_gom.nc"/> </Location> </modelRun> </dataType> </modelType></damapMetadataModel>
![Page 12: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/12.jpg)
Data Dictionary & Mappings (XML)
<damapDataTypes> <dataType type="SWAFS_AMERICAS" class="model" dataGenerator="SWAFS">
<mapping parameter="lon" map="longitude"/> <mapping parameter="curr_vcmp" map="water_Vcomponent"/> <mapping parameter="time" map="time"/> <mapping parameter="tau" map="tau"/> <mapping parameter="sal" map="salinity"/> <mapping parameter="sea_temp" map="water_temperature"/> <mapping parameter="surf_el" map="surface_elevation"/> <mapping parameter="lat" map="latitude"/> <mapping parameter="curr_ucmp" map="water_Ucomponent"/> <mapping parameter="sigma" map="sigma"/> <mapping parameter="bathy" map="bathy"/>
</dataType></damapDataTypes>
![Page 13: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/13.jpg)
Registration Module (Snapshots)
Add new mappings
![Page 14: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/14.jpg)
SearchNQuery Module
• XML Query Engine• Search on small metadata files rather than large primary
data files. • Data search based on temporal and spatial domain• Search based on models and observations• Keyword search• Save user-defined region• Query result display in temporal and spatial domain• Save query results and export directly to METOC Data
Analysis module
![Page 15: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/15.jpg)
Search&Query Module (Snapshots)
Save results for later use
![Page 16: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/16.jpg)
METOC Data Analysis and Assessment
• Floating interface• Easy mixing and matching of METOC datasets.• Interface and functionalities
– Choice of Horizontal and Vertical view– Choice of base plot.– Palette associated with each plot.– Provide new extent for view– Model data display (SWAFS, NCOM, etc.)
• Colorfill, contours, vectors, Streaklines – Observation data display (ADCP, drifters, Buoy etc.)
• Horizontal & vertical plots.– Overlay of model versus model data and
model versus observation
![Page 17: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/17.jpg)
More…
• Model time series• Sigma to Z-level conversion• Vertical Stacking of time series plots• Interactivity within the display• Import data directly into analysis module• Difference Maps, Color legend• Editors for various functions
![Page 18: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/18.jpg)
METOC Data Analysis SnapshotsGateway to METOC data analysis.
![Page 19: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/19.jpg)
METOC Data Header information Quick View
Visualization View Selection
![Page 20: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/20.jpg)
METOC Data
Analysis DisplayWindowDepicting VariousFeatures
Data Source:NAVOCEANO(Public ReleaseApproved)
![Page 21: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/21.jpg)
Model Contours, Colorfills & Currents (SWAFS)
Editors associated with these views• Scalar Editor• Vector Editor• Palette Editor• Grid Editor
Data Source:NAVOCEANO (Public Release Approved)
Streak lines
Sea Temperature
Model Currents
![Page 22: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/22.jpg)
Model Contours, Colorfills & Currents (NCOM)
Editors associated with these views• Scalar & Vector Editor• Palette Editor
Data Source:Florida State University(COAPS)
Sea Temperature Sea Temperature & Model currents
![Page 23: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/23.jpg)
Observations (Shipboard ADCP)
ADCP ‘U’ Component at certain time & depth ADCP ‘U&V’ Component at certain time & depth
Editors associated with these views• Horizontal View Editor (Scalar & Vector)• Palette Editor• Grid Editor
Horizontal Plots
Note: ADCP data synthesized. Tracks & values associated not true.
![Page 24: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/24.jpg)
Observations (Shipboard ADCP)
Editors associated with these views• Vertical View Editor (Scalar & Vector)• Palette Editor• Axes Editor
Time Series (U Component)
Stick Plots (U&V Component)
Note: ADCP data synthesized. Time & values associated not true.
Time Series Stack (U, V & W Component)
![Page 25: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/25.jpg)
Overlays Model & Observations
Stick Plots: Model current v/s ADCP current
Horizontal Plots: Model ‘U’ v/s ADCP ‘U’ Component
Note: ADCP & Model data synthesized. Tracks & model data values associated not true.
![Page 26: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/26.jpg)
Interactive Polygon over METOC Data Display to find Correlated METOC Data
User can create a polygon over an area of interest on any DA_MAP display to find METOC data (model or observations) correlatedin time and space.
Results on next page…..
Note: ADCP data synthesized. Tracks & values associated not true.
![Page 27: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/27.jpg)
Display Correlated Data (overlaid)
Note: ADCP & Model data synthesized. Tracks & model data values associated not true.
Time Series Stack (Observation & model Current)
Horizontal overlay (Observation & model Current)
![Page 28: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/28.jpg)
Difference Maps (SWAFS)
Data Source:NAVOCEANO(Public ReleaseApproved)
![Page 29: DA_MAP](https://reader030.vdocuments.us/reader030/viewer/2022020123/55a286981a28abc35f8b45d3/html5/thumbnails/29.jpg)
Bathymetry (NCOM)
Data Source:Florida State University(COAPS)