budapest 2006 grid activities in ukraine nataliya kussul space research institute nasu-nsau, ukraine...
TRANSCRIPT
![Page 1: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/1.jpg)
Budapest 2006
Grid Activities inGrid Activities inUkraineUkraine
Nataliya Kussul
Space Research Institute
NASU-NSAU, Ukraine
WGISS 21, Budapest 2006
![Page 2: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/2.jpg)
Budapest 2006
Main issues:Main issues:
• Infrastructure– Hardware resources– Technologies
• Applications– Numerical Weather Prediction– Meteosat Data Processing Services
• Cloud Mask• Cloud Motion• Fractal Feature Extraction
• Current State of Grid
• Projects involved
• Prospects
![Page 3: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/3.jpg)
Budapest 2006
Current InfrastructureCurrent Infrastructure
![Page 4: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/4.jpg)
Budapest 2006
Hardware resourcesHardware resources
• Cluster SKIT-1– 24x2 Intel Xeon (2.6 GHz)– Infiniband interconnect
• Cluster SKIT-2– 32x2 Intel Itanium II (1.4 GHz)– SCI interconnect
• Development cluster– 2x2 AMD Opteron (2.2 GHz)– Gigabit Ethernet interconnect
![Page 5: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/5.jpg)
Budapest 2006
Hardware resourcesHardware resources
• LustreFS NAS: 14TB storage• iSCSI SAN: 2TB storage• Gigabit Ethernet inter-cluster connection• A number of UNIX-based workstations• Condor pool of MS Windows workstations
![Page 6: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/6.jpg)
Budapest 2006
SKIT-1 SKIT-2 Development cluster
![Page 7: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/7.jpg)
Budapest 2006
Cluster load reportsCluster load reports
WRF model load profile
![Page 8: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/8.jpg)
Budapest 2006
TechnologiesTechnologies
• Globus Toolkit v4 – Grid middleware
• Karajan – workflow description language
• UNM MapServer – OGC-compliant software for geospatial data presentation
• Torque – local cluster scheduler
• OpenMPI & Scaly – MPI standard implementations
• Ganglia – monitoring tool
• Ruby – scripting language
![Page 9: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/9.jpg)
Budapest 2006
ApplicationsApplications
• Meteosat cloud mask extraction• Cloud motion estimation• Fractal features extraction• Numerical Weather Prediction (WRF model)
![Page 10: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/10.jpg)
Budapest 2006
WRF run subsystem (1)WRF run subsystem (1)
• Configured for territory of Ukraine• Input & boundary condition from GFS• 3 day forecasts every 6 hours• 10 km horizontal grid, 200x200 gridpoints• 31 vertical levels• One run takes 3.5 hours on 2x2 Opteron
system
![Page 11: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/11.jpg)
Budapest 2006
WRF run subsystem (2)WRF run subsystem (2)
![Page 12: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/12.jpg)
Budapest 2006
WRF run subsystem (2)WRF run subsystem (2)
![Page 13: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/13.jpg)
Budapest 2006
WRF visualizationWRF visualization• UMN MapServer based• Available at http://cosmogis.org.ua/?option=com_wrf
![Page 14: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/14.jpg)
Budapest 2006
Meteosat visualizationMeteosat visualization• UMN MapServer based• Available at http://cosmogis.org.ua/?option=com_mapserver
![Page 15: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/15.jpg)
Budapest 2006
Cloud motion estimationCloud motion estimation
– useful as the source data for Numerical Weather Prediction models
– temporary interpolation/extrapolation of image sequences for now casting
– based on adapted optical flow techniques
![Page 16: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/16.jpg)
Budapest 2006
Fractal features extraction
– Based on modeling of Meteosat images by Generalized Brownian Motion processes
– Useful for detecting turbulent areas
![Page 17: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/17.jpg)
Budapest 2006
Current stateCurrent state
• At the moment Grid middleware is being deployed on SKITs frontend node.
• SKITs are using proprietary local scheduler
• An adapter between Globus GRAM and scheduler should be developed
![Page 18: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/18.jpg)
Budapest 2006
Projects involved (1)Projects involved (1)
• “Cosmogis” project supported by Ukrainan National Space Agency
• STCU project “Grid technologies for environmental monitoring using satellite data” (started on December, 2005)
• Innovative project of National Academy of Science of Ukraine ”Development of pilot project of Ukrainian GEOSS/GMES segment” (2006)
![Page 19: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/19.jpg)
Budapest 2006
Projects involved (2)Projects involved (2)
• INTAS-CNES-NSAU call – Project “Data Fusion Grid Infrastructure” is
under preparation -
Practical way to initiate cooperative activity of agencies on Grid creation
• We are looking for partners!
![Page 20: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/20.jpg)
Budapest 2006
Plans: TechnologyPlans: Technology
• To develop Grid-enabled archive for geospatial data based on OGSA-DAI
• To establish data assimilation of MSG and ATOVS data into modeling process
• To use Grid infrastructure to perform a model automatic adaptation experiment
• To work out patterns for inter-domain security policy
![Page 21: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/21.jpg)
Budapest 2006
Plans: organizationalPlans: organizational
• To connect to European academic network GEANT
• To connect to Ukrainian academic network URAN
• To become a regional center of GEOSS/GMES
• To participate in the development of WAG• To include Ukrainian databases into ECHO
system
![Page 22: Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006](https://reader036.vdocuments.us/reader036/viewer/2022062519/56649e635503460f94b5f601/html5/thumbnails/22.jpg)
Budapest 2006
Thank you!