Advances in Data Advances in Data Coordination for Coordination for

Establishing Heliophysics as Establishing Heliophysics as a Basic Science a Basic Science

A Researcher’s Perspective in the A Researcher’s Perspective in the Context of New Directions for the FieldContext of New Directions for the Field

TopicsTopics

Heliophysics as a basic scienceHeliophysics as a basic science• Great Observatory as aspect of larger endeavorGreat Observatory as aspect of larger endeavor• Need for diverse data to establish universal lawsNeed for diverse data to establish universal laws

Areas for advancement in data coordinationAreas for advancement in data coordination• Virtual observatoriesVirtual observatories• Data formatsData formats• Data availabilityData availability

Informatics sessions at this meetingInformatics sessions at this meeting

Heliophysics as a basic scienceHeliophysics as a basic science Movement to Movement to

establish what we establish what we do as a basic do as a basic academic fieldacademic field• Parker’s advocacyParker’s advocacy• 2004 NRC report2004 NRC report• IHY science themeIHY science theme• NASA strategyNASA strategy

Funding justificationFunding justification Preservation and Preservation and

growth of the Great growth of the Great ObservatoryObservatory

“It cannot be emphasized too strongly that the development of a solid understanding of the magnetic activity, occurring in so many forms in so many circumstances in the astronomical universe, can be achieved only by coordinated study of the various forms of activity that are accessible to quantitative observation in the solar system.”

E. Parker, 1979E. Parker, 1979Cosmical Magnetic FieldsCosmical Magnetic Fields

Parker’s AdvocacyParker’s Advocacy

Plasma Physics of the Local CosmosPlasma Physics of the Local CosmosA scientific assessment and strategy for the study of magnetized plasmasA scientific assessment and strategy for the study of magnetized plasmas Creation and annihilation of Creation and annihilation of

magnetic fieldsmagnetic fields• DynamosDynamos• ReconnectionReconnection

Formation of structures and Formation of structures and transientstransients• Collisionless shocksCollisionless shocks• Cellular structures and current Cellular structures and current

sheetssheets• Boundary layers and flux ropesBoundary layers and flux ropes• Cross-scale couplingCross-scale coupling

Explosive energy conversionExplosive energy conversion• CMEsCMEs• SubstormsSubstorms

Plasma interactionsPlasma interactions• Electromagnetic (non-contact)Electromagnetic (non-contact)• Flow-objectFlow-object• Plasma-neutralPlasma-neutral• Radiation-plasmaRadiation-plasma

Energetic particle accelerationEnergetic particle acceleration

NATIONAL RESEARCH COUNCILOF THE NATIONAL ACADEMIES

2004

Goal 1: Develop the basic science of Goal 1: Develop the basic science of heliophysics through cross-disciplinary heliophysics through cross-disciplinary studies of universal processesstudies of universal processes

Selected ThemesSelected Themes• Evolution and Generation of Magnetic Evolution and Generation of Magnetic

Structures and TransientsStructures and Transients• Energy Transfer and Coupling ProcessesEnergy Transfer and Coupling Processes• Flows and CirculationsFlows and Circulations• Boundaries and InterfacesBoundaries and Interfaces

International Heliophysical Year International Heliophysical Year

Science Goals and ThemesScience Goals and Themes IHY 2007

From http://ihy.gsfc.nasa.gov

Justification for funding?Justification for funding?Striving to establish Striving to establish heliophysics as a basic heliophysics as a basic science may be the most science may be the most viable way to maintain viable way to maintain the health of the fieldthe health of the field• Avoids slipping into role of Avoids slipping into role of

applied heliophysics on applied heliophysics on demand without demand without concurrent basic concurrent basic heliophysics supportheliophysics support

• As the applied side of As the applied side of heliophysics grew strong heliophysics grew strong through the focus on space through the focus on space weather in the 90s, so the weather in the 90s, so the basic side can grow strong basic side can grow strong through the new focus on through the new focus on universal laws universal laws

• New focus makes us New focus makes us relevant to the larger relevant to the larger science endeavorscience endeavor

Larger space enterprise

Appliedheliophysics

Basicheliophysics

Data Needs for HeliophysicsData Needs for Heliophysics

Establishing heliophysics as a basic science Establishing heliophysics as a basic science calls for calls for • Discovery of universal physical laws that apply in Discovery of universal physical laws that apply in

diverse environmentsdiverse environments• Comparative studies using diverse data setsComparative studies using diverse data sets• Advancement in data management that Advancement in data management that

facilitates usage by scientists from diverse fieldsfacilitates usage by scientists from diverse fields Areas for advancementAreas for advancement

• Virtual observatoriesVirtual observatories• Data formatsData formats• Data availabilityData availability

Virtual ObservatoriesVirtual Observatories

Major advance in data availability occurred Major advance in data availability occurred in the ISTP era in the ’90s, on websites like in the ISTP era in the ’90s, on websites like CDAWebCDAWeb

Virtual observatories are a welcome Virtual observatories are a welcome outgrowthoutgrowth

Future effortsFuture efforts• Promote one-on-one indoctrinationPromote one-on-one indoctrination• Improve search engine (e.g., to recognize Improve search engine (e.g., to recognize

phenomenological terms like “coronal hole”)phenomenological terms like “coronal hole”)

Data FormatsData Formats Past experience: Encountering Common Data Past experience: Encountering Common Data

Format (CDF) filesFormat (CDF) files• Learn from manual?—written in computer jargonLearn from manual?—written in computer jargon• Learn from someone who knowsLearn from someone who knows• Hire programmer or graduate student Hire programmer or graduate student • Now can get some help from NASA/GSFC web site, Now can get some help from NASA/GSFC web site,

“Space Physics Guidelines for CDF” “Space Physics Guidelines for CDF” Recent experience: Encountering Flexible Image Recent experience: Encountering Flexible Image

Transport System (FITS) filesTransport System (FITS) files• Purchase “Liberator(!)” to view files in Adobe PhotoshopPurchase “Liberator(!)” to view files in Adobe Photoshop• Other help options available from NASA/GSFC web siteOther help options available from NASA/GSFC web site

Data Availability ProblemsData Availability Problems

Lack of documentationLack of documentation• Files of excellent data exist without meaningful Files of excellent data exist without meaningful

labels and physical unitslabels and physical units• One must contact the P.I.’s graduate students, One must contact the P.I.’s graduate students,

who pass on the information by word of mouthwho pass on the information by word of mouth P.I. firewallsP.I. firewalls

• In some cases, P.I.s still maintain control of In some cases, P.I.s still maintain control of data in order that it be used accuratelydata in order that it be used accurately

Too little support for organizing dataToo little support for organizing data

ExampleExample Special note: Special note:

We are in the process of re-organizing our file We are in the process of re-organizing our file system. Some of the directories above may be system. Some of the directories above may be empty…. The files are still available! They just empty…. The files are still available! They just haven't been moved into the proper directories haven't been moved into the proper directories yet. If you wish to search for these files on your yet. If you wish to search for these files on your own, please follow the directory structure on one own, please follow the directory structure on one of many scattered disks located of many scattered disks located here.here.… There is … There is also an also an indexindex directory that will provide clues to directory that will provide clues to the location of individual files. the location of individual files. I apologize for this (temporary) inconvenience but I apologize for this (temporary) inconvenience but there are literally tens of thousands of files that there are literally tens of thousands of files that need to be moved and it is a slow process. need to be moved and it is a slow process.

ConclusionsConclusions Building heliophysics into a basic science with Building heliophysics into a basic science with

universal laws calls for comparative studies of universal laws calls for comparative studies of data from a wide array of instruments in the data from a wide array of instruments in the Great ObservatoryGreat Observatory

Ways to facilitate usage of these data by Ways to facilitate usage of these data by researchers with diverse backgrounds areresearchers with diverse backgrounds are• Provide software packages for data analysis in which the Provide software packages for data analysis in which the

programming is transparent to the userprogramming is transparent to the user• Provide sufficient support for organizing and Provide sufficient support for organizing and

documenting data so that future generations can use it documenting data so that future generations can use it without help from the P.I. or his/her minionswithout help from the P.I. or his/her minions

• Give instructions in language that is not jargonGive instructions in language that is not jargon

Earth and Space Science Earth and Space Science Informatics (IN) SessionsInformatics (IN) Sessions

All joint with SA, SM, and SHAll joint with SA, SM, and SH Wednesday afternoon through Friday morningWednesday afternoon through Friday morning For example, IN42A, IN43D: Semantic Scientific For example, IN42A, IN43D: Semantic Scientific

Data Integration Data Integration • ““The vast majority of data-driven science investigations of the Earth-Sun The vast majority of data-driven science investigations of the Earth-Sun

system are limited in their ability to effectively explore the most system are limited in their ability to effectively explore the most important (often most difficult) problems because they are forced to important (often most difficult) problems because they are forced to interconnect at the data-element, or syntactic, level rather than at a higher interconnect at the data-element, or syntactic, level rather than at a higher scientific, or semantic, level. In many cases, syntax-only interoperability scientific, or semantic, level. In many cases, syntax-only interoperability IS the state-of-the-art. In order for scientists…to discover, access, and IS the state-of-the-art. In order for scientists…to discover, access, and use data from unfamiliar sources, they are forced to learn details of the use data from unfamiliar sources, they are forced to learn details of the data schema, other people’s naming schemes and syntax decisions. The data schema, other people’s naming schemes and syntax decisions. The need is for a way to provide scientists with the option of describing what need is for a way to provide scientists with the option of describing what they are looking for in terms that are meaningful and natural to them, they are looking for in terms that are meaningful and natural to them, instead of in a syntax that is not. ...” instead of in a syntax that is not. ...”