ExView: A Real-time Experiment Browser used for SW06 Cruise Collaboration

Andrew Maffei, Steve Lerner, Art Newhall, Cindy Sellers, Laura Stolp, John Kemp, Jim Akens (WHOI)Scott Glenn and team (Rutgers)SW06 Meeting, San DiegoJanuary 31, 2006

SW06 Logistics App. Goals Help to make sure vehicles don’t run over moorings or

each other. Provide a common view for all participants of a multi-

disciplinary, multi-vehicle, multi-PI experiment. Provide a way to distribute Internet-based information to all

ships (even those without SATCOM) Provide a way to easily communicate information between

ships Provide a way for shore and ship based staff to monitor

experiment status. Provide a historical archive of experiment that can be built

upon during post-experiment collaboration

ExView: How we did it Latte as prototype ExView: Custom webapp built for this experiment

(using WHOI 4DGeoBrowser Tech) Shore-based webserver mining Internet resources Dedicated, synchronized laptops, hosting a

mirrored website, was installed on each ship Ship wireless network using SATCOM and WiFi Supportive science and shipboard staff during design

and implementation Dedicated support staff on shore during ops Luck

ExView Main Screen Features

•Logistics Map

•Integrated Logistics Data

•Cruise Archive

•Date/Time Browsing

•Environmental Data

•Map Display

•Ship/Glider Tracks

•Mooring Locations

•Report Viewers & Summaries

•New: Integration of post-cruisedata products and views for data analysis purposes

ExView Daily Reports

ExView Daily Reports

17 apps at 4dgeo.whoi.edu

Synchronized Laptops Refurbished, “cookie-cutter” laptops that

are easily replaced when they fail. Linux, Apache, Rsync are workhorses 2 Ethernet connections for each laptop

Installed SWAP and Serial/Ethernet converters (for GPS) where necessary

Configured rsync in a restricted manner All directories have only one author

Shore ExView: Cgi-bin, html, and data directories Ship ExView: toshore/from-oceanus, toshore/from-

knorr, … No files deleted

RSYNC IS SIMPLY MAGIC

SW06 wireless data network

Comm Technology

Disruption Characteristics

Link Speed

Knorr HiSeasNet ( C )

~93% up (good antenna location)

180Kbps down, 96Kbps up(shared w Atlantis, SJ)

Endeavor HiSeasNet (Ku)

~50% (heading and weather dependent)

128Kbps up/down(shared w New Horizon)

RVTEC SWAP Within 7nm. when antennas in sight of one another

2-11Mbps

Shipboard LAN

24x7 10/100 Mbps

1.5 Gbytes in 3 months = 1550bps

Dedicated Support Staff Cindy Sellers on shore Steve and Andy as backup Hand holding of information suppliers

and ship/shore information viewers Noticed when things did not seem to be

going quite right (from science perspective)

Provided sense of humor and a positive attitude

Luck SWAP stayed up on site even though

there were many problems with it at dock

2 HiSeasNet ships meant connectivity to Internet was usually available via one or other

Rsync better than we expected No huge files were sent during SW06

(we discouraged its use for data files -- send matlab plots instead!)

Accomplishments and Lessons Learned All goals met. Exceeded our own

expectations in areas of reliability, participant involvement, and effort required to maintain

Daily Reports for file transfers might be cumbersome but works well for reducing bandwidth used and increasing average information content transferred.

Synchronized “laptop-websites” work well on UNOLS vessels and are much easier to implement that we thought before SW06.

SW06 Post-cruise

Realtime* and Post-cruise Data Samples

Category Source Format Sampling Rate

Total Size (local only)

Views

Shiptracks Ships Text 1/min 73M Main/map

DailyReports Rutgers, Ships

PPT, Webform

1/day 269M Dailyreport View

Weather Reports

NOAA Website

Image/Text 6/day 252M Weather View

CODAR/SST Rutgers Image/Text 1/hr 507M CODAR View

Satellite/Radar

Miami Image/Text Variable 37M Satellite Image View

GliderTracksand data imgs

Rutgers Image/Text Variable 272M Glider View (WIP)

Engineering Data (wireless comms, etc.)

WHOI, Ships Text Variable ? WIP

Shru WHOI Image, Audio 1/min 39G(raw = TB)

Shru3 & Multi-Shru View (WIP)

Shark WHOI Image, Audio 1/min ? Shark View (WIP)

Available ExView ViewsName Data Displayed Widgets Status

Main View Map, Events/Text ClickableMap, EventList, CalTime

In Exview

Daily Reports Images/Text CalTime In ExView

Weather Viewer SatImagge/Text CalTime In ExView

Glider Viewer DataImages/Text CalTime In ExView(under devel)

Satellite Image Viewer SatImages/Text CalTime In ExView

Shipboard Wireless Engineering Display

RtData, Text None In ExView

SHRU Display Images/Text, Audio, Environmental Ship Data, Annotations

Map, CalTiime, VCR Buttons, TempTimeBar, Image Annotation, Audio Clips, Image Composites

In ExView(under devel)

Multi-SHRU Display Images/Audio/Text TBD Under devel

Shark Display TBD TBD Under devel

SHRUView Integrated Info and Widgets

•Spectrograms

•Audio Files (Play/Download)

•Temperature Profiles

•Clickable Temp TimeBar

•Calendar/Time Search

•Environmental Data

•IMET (KNR, OCE)

•Add/View Interpretations

•Map Display

•Ship/Glider Tracks

•Mooring Locations

Post-cruise Interpretations

Other Candidate Views?Name Data Displayed Widgets Status/Comments

PO Mooring Data View TBD TBD

Ship Data (IMET) View TBD TBD

Predicted Sound Speed Profile View

TBD TBD

ASISView TBD TBD

StratView TBD TBD

Journal Article Viewer TBD TBD

Scanfish View TBD TBD

Model View TBD TBD

……..

Steps for creating ExView views for your data products

Spend 2 hours white-boarding with us Iterate on view layout via email and conference

call on a mockup of the view design with us We provide you with time estimate based on

design complexity,new widgets required, etc. We establish on image format, plotting and model

parameters, filename, etc. conventions to be used.

You create data products (typically graphic images) and make them available on your server.

We build new view and incorporate it into ExView

http://sealion.whoi.edu/om-bin/ge_sw06.kml

Future work Publish a paper describing role of ExView in

SW06 and examine SW06 experiment in context of planned national ocean observatory needs/efforts underway.

Build viewers for interested PIs so that their data products can be integrated into ExView.

More tightly associate various ExView views (using overlays, dhtml, etc.)

Work w NSF to incorporate ExView and SWAP2 as standard on UNOLS vessels

Integrate Google Earth more fully into ExView

Thanks to you all. You were great to work with. WHOI ExView Team

Jim Akens, John Kemp, Steve Lerner, Jim Lynch, Andy Maffei, Art Newhall, Cindy Sellers, Laura Stolp, Barrie Walden

COOL Lab - Scott Glenn and his whole team Shipboard Technical Staffmembers and crew

- Udel, URI, WHOI, Quest SW06 - All participants for their patience,

helpful suggestions, willingness to contribute.

Extra Slides

Building ShruViewStep Who What

1 Art Sampled binary data from SHRUs and run post-processing task to determine data quality and best way to create images and audio

2 Art, Steve, Andy

Used whiteboard to compose new ExView View that incorporated pre-existing and new information sources, and “widgets” from existing ExView Toolbox into an *expert* view of this information

3 ASA Determined required information sources for SHRU View: 1-min Spectograms (new), 1-min soundfiles (new), Watertemp plots (new), ship Env Data (existing), platform locations (existing)

4 ASA Determined widgets for SHRUView: SW06LogisticsMap, CalTIme Browser, SpectrogramAnnotation widget (derived from pre-existing similar tool), WaterTempBrowsing widget (new)

5 Steve Review initial data products created in 1 and suggest image/audio processing parameters that will help products work best in ExView

6 Art Steve

Agree on conventions for filenaming, plot axes, image resolution, audio file size/duration, etc. that will work best for both scientific analysis and ExView performance.

7 Art Builds all spectograms, tempprofiles, and audiofiles from SHRU data and makes available on his webserver

8 Steve Builds SHRU View and incorporates into ExView application environment

What might a POMooringView Look Like?