Download - The Emerging Heliophysics Informatics Infrastructure J. Ireland ADNET Systems, Inc. / NASA-GSFC
The Emerging Heliophysics Informatics
Infrastructure
J. Ireland
ADNET Systems, Inc. / NASA-GSFC
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
QuickTime™ and a decompressor
are needed to see this picture.
Credit: NASA Scientific Visualization Studio; ENLIL Heliospheric Model; BATS-R-US Magnetospheric Model
Space Weather
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
Credit: NASA Scientific Visualization Studio; ENLIL Heliospheric Model; BATS-R-US Magnetospheric Model
QuickTime™ and a decompressor
are needed to see this picture.
Space Weather
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
•Connect the physics along the Sun-Earth line.
•Data access - both observations and modeling - is key to progress.
•Tools to examine data - lots of data.
Space Weather
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
Informatics infrastructure
•Informatics: a broad academic field encompassing information science, information technology, algorithms, and social science.
•Infrastructure is the basic physical and organizational structures needed for the operation of a society or enterprise.
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
•Virtual Observatories (archives): simplified access to data from multiple instruments
- Solar: www.virtualsolar.org
- Magnetosphere: vmo.gsfc.nasa.gov
- Heliosphere: vho.gsfc.nasa.gov
- virtual archive for model output: ???
- SOTERIA (SODA): soteria-space.eu
- HELIO: www.helio-vo.eu
- NOAA: www.swpc.noaa.gov
Emerging...
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
•Feature/Event databases
- European Grid of Solar Observations Solar Event catalog: sec.ts.astro.it/sec_ui.php
- Heliophysics Knowledgebase: lmsal.com/hek
- SOTERIA Online Solar Event Catalogue
- NOAA SWPC
- other catalogues at many different locations
Emerging...
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
Locally IDL + Solarsoft + local FITS files = maximum flexibility
• Festival- IDL application
Auchère et al, 2008Sol. Phys., 248, 213
Looking at the heliosphere
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
•www.solarmonitor.org
- Very little of its own content
- Relies on services - images, active region numbers - provided by others.
- Narrowly focused on active regions/flares but it is a useful web application.
Looking at the heliosphere
Gallagher et al., Sol. Phys, 2002, 209, 171
Over the web
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
Looking at the heliosphere
Over the web
• SOHO Movie Theater- full disk + coronagraphs- arbitrary time range
http://sohodata.nascom.nasa.gov/cgi-bin/soho_movie_theater
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
Over the web• http://www.lmsal.com/solarsoft/last_events/- active region / flares- near Sun field models- AIA, STEREO, ACE, GOES, Hinode
A space weather web application
Looking at the heliosphere
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
SOHO images
Mobile
Looking at the heliosphere
solar monitor / space weather
STEREO data
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
•SDO: > 1.4 TB uncompressed image data /day.
•Model output: many terabytes per run (petaflop/exaflop machines)
•Advanced Technology Solar Telescope: ~ 42 TB / day
•How to let all users examine these data?
Petabytes and beyond
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
JPEG2000 Compression• Split original image
into n x n pixel blocks.• Encode each n x n pixel block using Discrete Wavelet Transform.➡ Spatially localized
• Lossy or lossless encoding.• More complex codec - but more flexible.
Cohen-Daubechies-Feauveau 7/9 wavelet
n x n
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
JPEG2000 Compression
All zoom levels are encoded in one file
Wavelet transform naturally encodes multiple length-scales since wavelets
subsample locally
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
• JPIP = JPEG2000 Interactive Protocol
• JPIP provides a client−server architecture for transmitting JPEG2000 imagery over networks
• Can query arbitrary parts, quality levels of images and movies
• Transfer only needed data
• XML header stores FITS keywords
Remote access to images
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
•JPEG2000 file format
•Back-end: images of solar and heliospheric data in JPEG2000 format served to Helioviewer client applications. Well described API - anyone can use our images.
•Front-end: browse clients that display these images with other meta-data provided by other services.
•Open source (almost completely).
•ESA and NASA funded.
Helioviewer Project
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
User makes request
client
JPEG2000
service
locationtimes data
Tiler
HV
JPIP
JHV
moviesimages
Client / server
Feature / event
service
feature meta data
times catalog
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
QuickTime™ and ampeg4 decompressor
are needed to see this picture.
www.helioviewer.org
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
JHelioviewer
QuickTime™ and ampeg4 decompressor
are needed to see this picture.
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
QuickTime™ and a decompressor
are needed to see this picture.
examine the data your way
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
Helioviewer Project•Core services solve the problem of
examining large archives of large 2d images from multiple instruments over the web
•Web client: www.helioviewer.org
•Desktop client: www.jhelioviewer.org (release candidate now available)
•More information: www.helioviewer.org/wiki
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
Conclusions
•Data are getting bigger faster.
- transfer of science data still a problem
•Multiple organizational efforts are under way.
•New technology is allowing the creation of new visualization and data access tools.
•Connect solar tools to the rest of the heliosphere
- HELIO (top-down)
- VxO / Helioviewer (bottom-up)
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
Some thoughts from our experience
•Data must be made available to others so that they may build their own applications.
- Separation of the archive from its delivery.
- Well documented service oriented architecture.
- Make easy accessibility to data a standard requirement for all contributors to Space Weather information.
•Shared standards.
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
End
J. Ireland Seventh European Space Weather WeekADNET Systems, Inc/ NASA
GSFC
QuickTime™ and a decompressor
are needed to see this picture.
Credit: NASA Scientific Visualization Studio; ENLIL Heliospheric Model; BATS-R-US Magnetospheric Model
Space Weather