grid computing in a commodity world kccmg fall impact 2005 lorin olsen, sprint nextel
TRANSCRIPT
![Page 1: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/1.jpg)
Grid Computing in a Commodity World
KCCMG Fall Impact 2005
Lorin Olsen, Sprint Nextel
![Page 2: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/2.jpg)
Our Earliest Introductions
![Page 3: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/3.jpg)
How Grid Computing Has Evolved
![Page 4: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/4.jpg)
Definitions
• Grid computing uses the resources of many separate computers connected by a network (usually the internet) to solve large-scale computation problems.
• Grid computing offers a model for solving massive computational problems by making use of the unused resources (CPU cycles and/or disk storage) of large numbers of disparate, often desktop, computers treated as a virtual cluster embedded in a distributed telecommunications infrastructure.
Wikipedia, http://en.wikipedia.org/wiki/Grid_computing
![Page 5: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/5.jpg)
DoD Global Information Grid (GIG)
• Storage • Messaging • Enterprise Service Management • Discovery • Mediation • Information Assurance • Application Hosting • User Assistant • Collaboration
DOD directive, Deputy Secretary of Defense on September 19, 2002
![Page 6: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/6.jpg)
![Page 7: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/7.jpg)
![Page 8: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/8.jpg)
![Page 9: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/9.jpg)
GridCafe @ CERN• The sharing of resources on a global scale is the very essence of
the Grid. • Security is a critical aspect of the Grid, since there must be a very
high level of trust between resource providers and users• If the resources can be shared securely, then the Grid really starts
to pay off when it can balance the load on the resources.• Communications networks have to ensure that
distance no longer matters.• Open standards are needed in order to make sure that R&D
worldwide can contribute in a constructive way to the development of the Grid.
“GridCafe: Building Blocks”; Francois Grey, Matti Heikkurinen, Rosy Mondardini, Robindra Prabhu; http://gridcafe.web.cern.ch/gridcafe/gridatwork/buildingblocks.html
![Page 10: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/10.jpg)
Types of Grids• Computational grid
A computational grid is focused on setting aside resources specifically for computing power. In this type of grid, most of the machines are high-performance servers.
• Scavenging grid A scavenging grid is most commonly used with large numbers of desktop machines. Machines are scavenged for available CPU cycles and other resources. Owners of the desktop machines are usually given control over when their resources are available to participate in the grid.
• Data grid A data grid is responsible for housing and providing access to data across multiple organizations. Users are not concerned with where this data is located as long as they have access to the data. For example, you may have two universities doing life science research, each with unique data. A data grid would allow them to share their data, manage the data, and manage security issues such as who has access to what data.
Bart Jacob, IBM Corporation, “Grid computing: What are the key components?”, http://www-128.ibm.com/developerworks/grid/library/gr-overview/index.html
![Page 11: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/11.jpg)
Computational Grids
![Page 12: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/12.jpg)
Solve Grand Challenges
• A Grand Challenge Problem is a general category of unsolved problems. The definition of a Grand Challenge problem has a certain degree of inherent subjectivity surrounding what is, or is not, a Grand Challenge. A Grand Challenge problem exhibits at least the following characteristics:– The problem is demonstrably hard to solve, requiring several
orders-of-magnitude improvement in the capability required to solve it.
– The problem can not be unsolvable. If it probably cannot be solved, then it can't be a Grand Challenge. Ideally, quantifiable measures that indicate progress toward a solution are also definable.
– The solution to a Grand Challenge problem must have a significant economic and/or social impact.
![Page 13: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/13.jpg)
Grand Challenge Examples
• Applied Fluid Dynamics • Meso- to Macro-Scale Environmental Modeling • Ecosystem Simulations • Biomedical Imaging and Biomechanics • Molecular Biology • Molecular Design and Process Optimization • Cognition • Fundamental Computational Sciences • Grand-Challenge-Scale Applications • Nuclear power and weapons simulations
![Page 14: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/14.jpg)
Open Grid Computing Environment (OGCE)
![Page 15: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/15.jpg)
EU Grid Imperatives
![Page 16: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/16.jpg)
Enabling Grids for E-sciencE (EGEE)
![Page 17: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/17.jpg)
LCG/EGEE ComponentsThe principal components of the middleware package are:• The Globus Toolkit (GT2) developed by the Globus Project • The Condor system developed at the University of Wisconsin, Madison • The Globus and Condor components and some other tools from US projects are
integrated and packaged as the Virtual Data Toolkit by the VDT project at the Univeristy of Wisconsin, Madison. VDT provides support for this package to LCG/EGEE.
• Tools developed by the DataGrid Project (EDG). The EU-funded DataGrid project ended in 2004, but the institutes that had developed the tools needed for the LCG/EGEE grid continue to support them until they are replaced by improved software.
• New middleware components developed as part of the gLite toolkit by the EGEE project. The first release of gLite will provide improved tools for workload scheduling, grid catalog, and a monitoring infrastructure. Future releases will add additional functionality and provide re-engineered components with the aim of satisfying the requirements of the main EGEE application domains: high energy physics, biology and medicine. This middleware activity of EGEE works very closely with the LCG project, and has a formal place in the management of LCG.
“LCG Middleware”; http://lcg.web.cern.ch/LCG/activities/middleware.html
![Page 18: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/18.jpg)
LHC Computer Grid Monitoring
![Page 19: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/19.jpg)
LHC Computer Grid Monitoring
![Page 20: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/20.jpg)
Scavenging Grids
![Page 21: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/21.jpg)
Solve Not So Grand Challenges
![Page 22: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/22.jpg)
![Page 23: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/23.jpg)
Stanford: Folding@Home
![Page 24: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/24.jpg)
IBM: World Community Grid
![Page 25: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/25.jpg)
Berkeley Open Infrastructure for Network Computing (BOINC)
![Page 26: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/26.jpg)
BOINC-Powered Projects
![Page 27: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/27.jpg)
Climatepredictions.net
![Page 28: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/28.jpg)
Einstein@Home
![Page 29: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/29.jpg)
LHC@Home
![Page 30: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/30.jpg)
Data Grids
![Page 31: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/31.jpg)
Distributed Filesystems and Grids
• First came distributed filesystems (NFS)
• Then came commercial clustered filesystems (Veritas)
• Linux pioneered installable, distributed filesystems (Coda)
• Red Hat GFS
![Page 32: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/32.jpg)
Database Grids
![Page 33: Grid Computing in a Commodity World KCCMG Fall Impact 2005 Lorin Olsen, Sprint Nextel](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e365503460f94b2518e/html5/thumbnails/33.jpg)
European Data Grid (EDG)