gavo – after one year
DESCRIPTION
GAVO – after one year. H.-M. Adorf & the GAVO team. GAVO’s Pillars. Publication and federation of datasets including theoretical ones Spatial matching & classification & visualization (NGSE) Grid computing. The GAVO Team. PI: Wolfgang Voges, MPE, Garching - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/1.jpg)
GAVO – after one year
H.-M. Adorf & the GAVO team
![Page 2: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/2.jpg)
ADA III - 29-04-2004
GAVO’s Pillars
Publication and federation of datasets including theoretical ones
Spatial matching & classification & visualization (NGSE)Grid computing
![Page 3: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/3.jpg)
ADA III - 29-04-2004
The GAVO Team
PI: Wolfgang Voges, MPE, GarchingCoI: Matthias Steinmetz, AIP, PotsdamHans-Martin Adorf, MPEHarry Enke, AIPGerard Lemson, MPE
![Page 4: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/4.jpg)
ADA III - 29-04-2004
Collaborations
MPE, Garching (Peter Schuecker)AIP PotsdamCanadian Virtual Obs. (CVO), VictoriaUniversitaetssternw. Muenchen (USM)MPA, Garching (Planck, …)
![Page 5: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/5.jpg)
ADA III - 29-04-2004
GAVO Work Areas
Publication of ROSAT datasets REST-based SCS service (HTTP GET in;
XML, CSV, HTML out) SOAP-based SCS service
MCMCS Download ManagerFuzzy spatial matcherGrid-based detection of galaxy clustersROSAT matcher/classifier service
![Page 6: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/6.jpg)
ADA III - 29-04-2004
ROSAT All-Sky Survey (RASS)
BSC, FSC & Photons VO-compatibility: Input: Simple cone search Output: VOTable, …
New features Exposure times Galactic & Cartesian coordinates Healpix indices
![Page 7: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/7.jpg)
ADA III - 29-04-2004
SCS
![Page 8: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/8.jpg)
ADA III - 29-04-2004
Result
![Page 9: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/9.jpg)
ADA III - 29-04-2004
VOTable
![Page 10: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/10.jpg)
ADA III - 29-04-2004
MCMCS Download Manager
Tool … … accesses registry at JHU
User … … selects up to 70 distributed catalogues … specifies one or more sky-locations
Tool … … queries remote catalogues … retrieves datasets (VOTables) for further
processing
![Page 11: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/11.jpg)
ADA III - 29-04-2004
MCMCS Download Manager
![Page 12: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/12.jpg)
ADA III - 29-04-2004
MCMCS Download Manager
![Page 13: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/13.jpg)
ADA III - 29-04-2004
Workflow
![Page 14: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/14.jpg)
ADA III - 29-04-2004
Fuzzy spatial matcher
Essential for data miningPrototype features
Performs “fuzzy” match between pairs of source lists from different catalogues
Computes probability of real match based on astrometric uncertainties
Moving matcher into production use Currently exported to Canadian Virtual
Observatory Feeding matches to ClassX classifier
Long-term goal: assemble an SED
![Page 15: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/15.jpg)
ADA III - 29-04-2004
Fuzzy spatial matcher (ctd)
![Page 16: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/16.jpg)
ADA III - 29-04-2004
Grid computing
What is Grid-computing? Globus Toolkit, SGE, EJBs WebServices
Detection of galaxy clusters using RASS photons, SDSS
RASS source classification using RASS B/FSC, SUMSS, NVSS,
USNO
![Page 17: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/17.jpg)
ADA III - 29-04-2004
Workflow
![Page 18: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/18.jpg)
ADA III - 29-04-2004
Galaxy-cluster detection
Search for galaxy clusters in heterogeneous databases RASS photons SDSS
Software FORTRAN 90 code (data analysis) Perl scripts (data/grid management) Globus Toolkit
![Page 19: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/19.jpg)
ADA III - 29-04-2004
Galaxy-cluster detection
Components Setup script
Sets up the directory structure Distributes the software across the grid
Execution script Triggers the parallel execution on the
compute nodes Data collection script
Retrieves the results from the compute nodes
![Page 20: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/20.jpg)
ADA III - 29-04-2004
GAVO Mini-GRID
![Page 21: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/21.jpg)
ADA III - 29-04-2004
Status
Perl scriptsUpgrading the RASS Photon DBSoon integrate the SDSS mirror copy
![Page 22: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/22.jpg)
ADA III - 29-04-2004
RASS-source classifier
ClassX: international collaboration T.A. McGlynn, A.A. Suchkov, E.L. Winter, R.J.
Hanisch, R.L. White, F. Ochsenbein, S. Derriere, W. Voges, M.F. Corcoran
Requires data from several sky-surveys X-ray: ROSAT BSC+FSC Optical: USNO, (SDSS) Infrared: (2MASS) Radio: FIRST, NVSS, SUMSS
Distributed multi-wavelength VO-application
![Page 23: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/23.jpg)
ADA III - 29-04-2004
Data Flow
![Page 24: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/24.jpg)
ADA III - 29-04-2004
PoseQuery
![Page 25: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/25.jpg)
ADA III - 29-04-2004
DisplayQueryResult
![Page 26: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/26.jpg)
ADA III - 29-04-2004
DisplayMatchResult
![Page 27: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/27.jpg)
ADA III - 29-04-2004
The matching problem
![Page 28: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/28.jpg)
ADA III - 29-04-2004
DisplayXMatchResult
![Page 29: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/29.jpg)
ADA III - 29-04-2004
DisplayClassXResult
![Page 30: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/30.jpg)
ADA III - 29-04-2004
RASS-source classifier
State & session management Using Java Servlet session mechanism Internal abstract state machine
Strong points End-to-end VO-application Works with lists of objects / sky-coordinates Accesses several distributed databases Uses deterministic matcher (at Vizier and SDSS) Uses probabilistic matcher (at GAVO) Uses data analysis service (at NASA)
![Page 31: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/31.jpg)
ADA III - 29-04-2004
RASS-source classifier
Future work Use IVOA-standards or protocols
VOTable WSDL, SOAP-based Web Services Add graphics
Multi-threaded Modularize, generalize and make S/W
configurable
![Page 32: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/32.jpg)
ADA III - 29-04-2004
RASS-source classifier
Open questions Is an HTML form-based GUI
sufficiently powerful to control a complex grid application?
What are the user expectations wrt the workflow?
Is there a standard workflow that one could use / agree upon?
![Page 33: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/33.jpg)
ADA III - 29-04-2004
Conclusion
GAVO is a small, but ambitious projectTwo Grid applications Detection of galaxy clusters
Globus Toolkit Classification of ROSAT sources
Based on WebServices
![Page 34: GAVO – after one year](https://reader035.vdocuments.us/reader035/viewer/2022062322/568147c3550346895db505ed/html5/thumbnails/34.jpg)
ADA III - 29-04-2004
References
GAVO Mid-Term Report, 90 pages, http://www.g-vo.org (soon)
Detection of X-ray Clusters of Galaxies by Matching RASS Photons and SDSS Galaxies within GAVO, P. Schuecker, H. Boehringer, W. Voges, A&A (submitted)
Automated classification of ROSAT sources using heterogeneous multiwavelength catalogs, T.A. McGlynn et al., ApJ (submitted)