the osg and grid operations center rob quick open science grid operations center - indiana...
TRANSCRIPT
![Page 1: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/1.jpg)
The OSG and Grid Operations Center
Rob QuickOpen Science Grid Operations
Center - Indiana University
ATLAS Tier 2-Tier 3 Meeting
Bloomington, Indiana - 20 June 2007
![Page 2: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/2.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Outline
• The OSG and The GOC• Client Installation (Tim Silvers)
• CE Installation
• GOC Services (John Rosheck)
• Wrap
![Page 3: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/3.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Open Science Grid• Distributed computing infrastructure for large-scale
scientific research.• Petascale computing and storage resources in
uniform grid computing environment.• Researchers from astrophysics, bioinformatics,
computer science, medical imaging, nanotechnology and physics.
• Production and Integration Grids• ~90 sites in the US, Asia, South America• OSG partners, include campus, regional, national and
international grids.
![Page 4: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/4.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Open Science Grid
![Page 5: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/5.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
The Open Science Grid Operations Center (GOC)
![Page 6: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/6.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
The Open Science Grid Operations Center (GOC)
• Critical Service Support• Communication Hub• Security Incident Response• Provide Software Caches• Coordinate Grid Wide Policy• Problem Tracking and Resolution
![Page 7: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/7.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Critical Services• Virtual Organization Resource
Selector (VORS)
![Page 8: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/8.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Other Existing Information
Services• CEMon/BDII Integrated Server• VOMS Monitor• GIP Validator• Gratia Account Data (FNAL)• GridCat (Deprecated with Next Release)• MonALISA (Deprecated with Next
Release)• Duplicated for Integration Test Bed
![Page 9: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/9.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Other Infrastructure Services
• VOMS (Infrastructure and Small VOs)• Site Maintenance Tool• Registration Database• Critical Service Monitoring
(Nagios)
![Page 10: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/10.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
OSG Communication
Hub• Trouble Ticketing System (Footprints)• 24x7 Trouble Reporting and Ticket Creation• OSG Twiki• RSS Operations News Feed• GOC Information Web Pages (
www.grid.iu.edu)• Weekly Operations Meeting (WLCG and
OSG)• Various Mailing Lists (osg-
![Page 11: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/11.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Security Response• Technician on-call 24/7/365 to
evaluate security incidents.• Critical Incidents are Immediately
Addressed with OSG Security Officer• security@, incident@, abuse@
opensciencegrid.org• 24/7/365 phone availability
![Page 12: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/12.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
OSG Software Cache• OSG and ITB Caches
• Compute Element• Configuration of Condor, PBS,
LSF, SGE• Worker Node Client• Client• VOMS• GUMS• Patches and Optional
Components• Coming Soon GOC Developed
Packages Including Monitoring Probes
![Page 13: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/13.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Coordinate OSG Wide Policy
• Standard Operating Procedures• Administrative Registration
Information• Policy Enforcement
![Page 14: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/14.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Problem Tracking and Solution
• OSG Ticketing System• All Problems that cross out of a VO get
ticketed. This includes peering grids (EGEE).
• GOC Operators follow up on all tickets to assure acceptable solution is found.
• Automated Exchange of tickets with some Larger VOs, Service Providers, and Peering Grids.
![Page 15: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/15.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
The Near Future for the OSG GOC
• Site Availability and Validation Project• Focus on Getting Site Administrators
Involved and Feeling Responsible for Maintaining a “Good Site”
• Series of probes based on standards of Grid Monitoring Working Group
• Probe data will eventually feed VORS and SAM
• Infrastructure being developed
![Page 16: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/16.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
OSG Information Management
Project• Consolidating Information Within the
OSG• Schema Being Developed• Data Will Feed OSG Monitoring Tools
(VORS, Information and Accounting Services)
• Project Includes Dashboards for Site Admins, Operations, VO Admins, and Others Views yet to be defined
![Page 17: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/17.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
![Page 18: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/18.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Other Projects• Redundancy of Critical Services
(Indianapolis and Bloomington)• Ticket Metrics and Trending• Smooth VO Additions• Defining a “Good Site” and getting Site
Admins interested in maintaining one• Syslog-ng central log collection
![Page 19: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/19.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Client Installation
• Tim Silvers - GOC Analyst
![Page 20: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/20.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
CE Installation• TWiki Installation Instructions
• Pacman and Install • Configuration
• Start Up of Services
![Page 21: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/21.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Installation Instructions
• https://twiki.grid.iu.edu/twiki/bin/view/ReleaseDocumentation/CEInstallGuide
• # pacman -get OSG:ce• # pacman -get OSG:Globus-
<JobManager>-Setup (Condor, LSF, PBS, SGE)
• # pacman -get OSG:wn-clinet (Gatekeeper and Worker Nodes)
• # pacman -get OSG:ManagedFork (Optional)
![Page 22: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/22.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Configuration of OSG
• # $VDT_LOCATION/monitoring/configure-osg
• Series of Questions (DEMO)
![Page 23: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/23.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Turn on Services• # vdt-control --on
[root@feynman grid]# vdt-control --listService | Type | Desired State-------------------+--------+--------------fetch-crl | cron | enablevdt-rotate-logs | cron | enablegris | init | do not enableglobus-gatekeeper | inetd | enablegsiftp | inetd | enablemysql | init | enableglobus-ws | init | enableedg-mkgridmap | cron | do not enablegums-host-cron | cron | enableMLD | init | do not enableapache | init | enabletomcat-5 | init | enable
![Page 24: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/24.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Verify and Register• As User
# $VDT_LOCATION/verfiy/site_verify.pl
• Register your resource at:
https://goc.grid.iu.edu/registration/main.php?whichReg=rp
![Page 25: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/25.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
GOC Services• John Rosheck - GOC Senior System
Administrator and Developer
![Page 26: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/26.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
OSG Service Links• https://twiki.grid.iu.edu• http://software.grid.iu.edu/pacman/• https://goc.grid.iu.edu/• http://vors.grid.iu.edu/cgi-bin/index.cgi• http://is.grid.iu.edu/cgi-bin/status.cgi• http://gip-validate.grid.iu.edu/production/
index.html• http://gratia-osg.fnal.gov:8880/gratia-reporting/• http://www.grid.iu.edu/maintenance/• http://www.grid.iu.edu/news/• http://www.grid.iu.edu/cgi-bin/contact.pl
![Page 27: The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697c0121a28abf838ccc306/html5/thumbnails/27.jpg)
R. Quick "WLCG-OSG-EGEE Interop" 26 Jan 2007
Thank You
• Special Thanks GOC Team: John Rosheck, Tim Silvers, Kyle Gross, and Arvind Gopu
• www.opensciencegrid.org• www.grid.iu.edu