open science gridcd-docdb.fnal.gov/0008/000845/001/i2-osg-talk.pdf5/27/05 d. petravick - open...

21
Open Science Grid D. Petravick, FNAL I2 Spring Meeting/HEP SIG May 3, 2005

Upload: others

Post on 17-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

Open Science Grid

D. Petravick, FNAL

I2 Spring Meeting/HEP SIG

May 3, 2005

Page 2: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 2

Open Science GridConsortium

• The Open Science Grid (OSG) Consortiumwas formed in 2004 by teams from U.S.universities and national laboratories in orderto build and support a production qualitypeta-scale Grid infrastructure for large scalescience.

• Partners with EGEE, LCG and TerraGrid.• Non US institutions.may be partners.

– Case under consideration is when an applicationbring s in non US sites.

Page 3: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 3

CMS and U.S. OSGparticipants

Page 4: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 4

OSG Organizational Structure

Page 5: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 5

Two Important TechnicalGroups

• Storage (active for a year)

• Network (just forming)

• Buffering Storage and networking arecomplimentary activities.

Page 6: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 6

Storage Technical Group

• The Storage Technical group is lead by PaulSheldon (Vanderbilt) and Robert Kennedy(Fermilab).

• The main activity of the group is to deploymanaged storage elements on the OSG.– Independently implemented, interoperating, SE

are being deployed.• LBL DRM• Fermilab/DESY Dcache.• Interest in from the IBP people (Tennessee)• Possible interest from Xootd people (SLAC)

Page 7: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 7

OSG Storage element

Page 8: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 8

March Tape IngestDemonstration

Page 9: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 9

Current Production

Page 10: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 10

Current (POSIX side) reads

Page 11: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 11

CMS plans

• SE at US Tier 1 (FNAL)

• SE at US Tier 2s (Caltech, Florida, MIT,Nebraska, Purdue, UCSD, Wisconsin)

• Partial deployment and use in Recentlyconcluded Service Challenge.

• Storage Embedded in OSG.

Page 12: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 12

Network Technical Group

• The Network Technical group is lead byShawn McKee(Michigan) and DonaldPetravick (Fermilab).

• We are beginning to organize.– Have seeded a monitoring activity.

– Want to consider the needs of the HEPexperiments exploiting OSG.

Page 13: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 13

Evident Areas of Interest

• Understand the impact of ourapplication on the existing networksinfrastructures.– Large Data Transfers for LHC experiments

within the US are just being organized.

• HEP desires an “overlay network”composed from all available resources

Page 14: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 14

Mona Lisa Monitoring

• For OSG-ITB– Integration Test Bed

• http://gocmon.uits.iupui.edu:8888/

Page 15: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 15

HEP Overlay network

• Esnet and I2.

• Ultralight

• US university initiatives.

• LHC net.

• T[12] <-> T[12] worldwide

Page 16: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 16

Page 17: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 17

UltraLightUltraLight Network: Network: PHASE 2PHASE 2

Move into productionMove into production(2007)(2007)

Optical switching fullyOptical switching fullyenabled amongst primaryenabled amongst primarysitessites

Integrated internationalIntegrated internationalinfrastructureinfrastructure

Page 18: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 18

FNAL Inbound traffic

Page 19: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 19

Summary

• The OSG is a significant computationalresource.

• HENP stakeholders are counting on the OSGto provide a grid framework in the US for theLHC.

• Many contributions beyond the DOE labs andT2 centers.

• OSG is in a position to exploit resourcesopportunistically, including high impactnetworks.

Page 20: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 20

Grid computing and nationalinfrastructure.

• In HEP tape is usedin data movement,not only dataarchive.

• Data movement is atnational scales.

• D0, one currentHEP system.

Page 21: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium

5/27/05 D. Petravick - Open Science GRid 21