Sky Survey Database DesignSky Survey Database Design

National e-Science CentreNational e-Science Centre

EdinburghEdinburgh

8 April 20038 April 2003

AgendaAgenda

10.00 Start10.00 StartWelcome, introductions & goalsWelcome, introductions & goals – – Bob MannBob MannSky survey databases – problemsSky survey databases – problems

Introduction – Introduction – Bob MannBob MannRecent/current work in Edinburgh – Recent/current work in Edinburgh – Nigel HamblyNigel HamblyThoughts on spatial indexing – Thoughts on spatial indexing – Clive Page, Bob MannClive Page, Bob Mann

12.30 Lunch12.30 Lunch Sky survey databases – solutionsSky survey databases – solutions

Oracle AstroGrid testbed – Oracle AstroGrid testbed – Ian CarneyIan Carney

DiscussionDiscussionWhat to do, when and how?What to do, when and how?

(15.00 Tea)(15.00 Tea)17.00 Close17.00 Close…beer?…beer?

Meeting goalsMeeting goals

Aid DBMS choice for new Edinburgh databases Aid DBMS choice for new Edinburgh databases – WFCAM & VISTA Science Archives (WSA, VSA)WFCAM & VISTA Science Archives (WSA, VSA)– Use SQL Server, learn about DB2 & OracleUse SQL Server, learn about DB2 & Oracle

Investigate possibilities for collaboration in Investigate possibilities for collaboration in areas of mutual interestareas of mutual interest– Large, spatial, distributed databasesLarge, spatial, distributed databases– DBMS integration into web/Grid service frameworkDBMS integration into web/Grid service framework

Why Astronomy Why Astronomy Data?Data?

It has no commercial valueIt has no commercial value–No privacy concernsNo privacy concerns–Can freely share results with othersCan freely share results with others–Great for experimenting with algorithmsGreat for experimenting with algorithms

It is real and well documentedIt is real and well documented–High-dimensional dataHigh-dimensional data (with confidence intervals) (with confidence intervals)–SpatialSpatial data data–TemporalTemporal data data

Many Many different instrumentsdifferent instruments from many from many different placesdifferent places and many and many different timesdifferent times

Federation is a goalFederation is a goalThe questions are interestingThe questions are interesting

–How did the universe form?How did the universe form?

There is a lot of it (petabytes)There is a lot of it (petabytes)

IRAS 100

ROSAT ~keV

DSS Optical

2MASS 2

IRAS 25

NVSS 20cm

WENSS 92cm

GB 6cm

Slide from Jim Gray

(Microsoft Research)

Meeting goals (cont’d)Meeting goals (cont’d)

Anything else?Anything else?

– What do our IBM & Oracle colleagues want: What do our IBM & Oracle colleagues want:

from today?from today?

from interaction with astronomers?from interaction with astronomers?