![Page 1: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/1.jpg)
“High Performance Collaboration –The Jump to Light Speed"
Talk toA Visiting Team from Intel
Calit2@UCSDJune 25, 2006
Dr. Larry Smarr
Director, California Institute for Telecommunications and Information Technology;
Harry E. Gruber Professor,
Dept. of Computer Science and Engineering
Jacobs School of Engineering, UCSD
![Page 2: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/2.jpg)
From “Supercomputer–Centric” to “Supernetwork-Centric” Cyberinfrastructure
1.E+00
1.E+01
1.E+02
1.E+03
1.E+04
1.E+05
1.E+06
1985 1990 1995 2000 2005
Ba
nd
wid
th (
Mb
ps
)
Megabit/s
Gigabit/s
Terabit/s
Network Data Source: Timothy Lance, President, NYSERNet
32x10Gb “Lambdas”
1 GFLOP Cray2
60 TFLOP Altix
Bandwidth of NYSERNet Research Network Backbones
T1
Optical WAN Research Bandwidth Has Grown Much Faster Than
Supercomputer Speed!
Co
mp
utin
g S
peed
(GF
LO
PS
)
![Page 3: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/3.jpg)
National Lambda Rail (NLR) and TeraGrid Provides Cyberinfrastructure Backbone for U.S. Researchers
NLR 4 x 10Gb Lambdas Initially Capable of 40 x 10Gb wavelengths at Buildout
Links Two Dozen State and Regional Optical
Networks
DOE, NSF, & NASA
Using NLR
San Francisco Pittsburgh
Cleveland
San Diego
Los Angeles
Portland
Seattle
Pensacola
Baton Rouge
HoustonSan Antonio
Las Cruces /El Paso
Phoenix
New York City
Washington, DC
Raleigh
Jacksonville
Dallas
Tulsa
Atlanta
Kansas City
Denver
Ogden/Salt Lake City
Boise
Albuquerque
UC-TeraGridUIC/NW-Starlight
Chicago
International Collaborators
NSF’s TeraGrid Has 4 x 10Gb Lambda Backbone
![Page 4: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/4.jpg)
The OptIPuter Project – Creating High Resolution Portals
Over Dedicated Optical Channels to Global Science Data• NSF Large Information Technology Research Proposal
– Calit2 (UCSD, UCI) and UIC Lead Campuses—Larry Smarr PI– Partnering Campuses: SDSC, USC, SDSU, NCSA, NW, TA&M, UvA,
SARA, NASA Goddard, KISTI, AIST, CRC(Canada), CICESE (Mexico)• Industrial Partners
– IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Lucent• $13.5 Million Over Five Years—Now In the Fourth Year
NIH Biomedical Informatics
NSF EarthScope and ORIONResearch Network
![Page 5: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/5.jpg)
OptIPuter Software Architecture--a Service-Oriented Architecture Integrating Lambdas Into the Grid
GTP XCP UDT
LambdaStreamCEP RBUDP
DVC Configuration
Distributed Virtual Computer (DVC) API
DVC Runtime Library
Globus
XIOGRAM GSI
Distributed Applications/ Web Services
Telescience
Vol-a-Tile
SAGE JuxtaView
Visualization
Data Services
LambdaRAM
DVC Services
DVC Core Services
DVC Job Scheduling
DVCCommunication
Resource Identify/Acquire
NamespaceManagement
Security Management
High SpeedCommunication
Storage Services
IPLambdas
Discovery and Control
PIN/PDC RobuStore
Source: Andrew Chien, UCSD
![Page 6: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/6.jpg)
OptIPuter Scalable Adaptive Graphics Environment (SAGE) Allows Integration of HD Streams
Photo: David Lee, NCMIR, UCSD
OptIPortal– Termination
Device for the
OptIPuter Global
Backplane
![Page 7: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/7.jpg)
OptIPortal– Termination Device for the OptIPuter Global Backplane
• 20 Dual CPU Nodes, 20 24” Monitors, ~$50,000• 1/4 Teraflop, 5 Terabyte Storage, 45 Mega Pixels--Nice PC!• Scalable Adaptive Graphics Environment ( SAGE) Jason Leigh, EVL-UIC
Source: Phil Papadopoulos SDSC, Calit2
![Page 8: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/8.jpg)
The New Optical Core of the UCSD Campus-Scale Testbed:Evaluating Packet Routing versus Lambda Switching
Goals by 2007:>= 50 endpoints at 10 GigE>= 32 Packet switched>= 32 Switched wavelengths>= 300 Connected endpoints
Approximately 0.5 TBit/s Arrive at the “Optical” Center
of CampusSwitching will be a Hybrid
Combination of: Packet, Lambda, Circuit --OOO and Packet Switches
Already in Place
Funded by NSF MRI
Grant
Lucent
Glimmerglass
Force10
![Page 9: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/9.jpg)
Calit2/SDSC Proposal to Create a UC Cyberinfrastructure
of OptIPuter “On-Ramps” to TeraGrid Resources
UC San Francisco
UC San Diego
UC Riverside
UC Irvine
UC Davis
UC Berkeley
UC Santa Cruz
UC Santa Barbara
UC Los Angeles
UC Merced
OptIPuter + CalREN-XD + TeraGrid = “OptiGrid”
Source: Fran Berman, SDSC , Larry Smarr, Calit2
Creating a Critical Mass of End Users on a Secure LambdaGrid
![Page 10: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/10.jpg)
Creating a North American Superhighway for High Performance Collaboration
Next Step: Adding Mexico to Canada’s CANARIE and the U.S. National Lambda Rail
![Page 11: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/11.jpg)
www.glif.is
Created in Reykjavik, Iceland 2003
Countries are Aggressively Creating Gigabit Services:Interactive Access to CAMERA Data System
Visualization courtesy of Bob Patterson, NCSA.
![Page 12: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/12.jpg)
First Remote Interactive High Definition Video Exploration of Deep Sea Vents
Source John Delaney & Deborah Kelley, UWash
Canadian-U.S. Collaboration
![Page 13: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/13.jpg)
PI Larry Smarr
![Page 14: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/14.jpg)
Marine Genome Sequencing ProjectMeasuring the Genetic Diversity of Ocean Microbes
CAMERA will include All Sorcerer II Metagenomic Data
![Page 15: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/15.jpg)
Flat FileServerFarm
TeraGrid Backplane(10000s of CPUs)
W E
B
PO
RT
AL
Web
Local Cluster
DirectAccess LambdaCnxns
DedicatedCompute Farm(1000 CPUs)
Data-BaseFarm 10 GigE
Fabric
Calit2’s Direct Access Core Architecture Will Create Next Generation Metagenomics Server
Source: Phil Papadopoulos, SDSC, Calit2
+ W
eb S
ervi
ces
UserEnvironment
CAMERAComplex
![Page 16: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/16.jpg)
Analysis Data Sets, Data Services, Tools, and Workflows
• Assemblies of Metagenomic Data– e.g, GOS, JGI CSP
• Annotations– Genomic and Metagenomic Data
• “All-against-all” Alignments of ORFs– Updated Periodically
• Gene Clusters and Associated Data– Profiles, Multiple-Sequence Alignments, – HMMs, Phylogenies, Peptide Sequences
• Data Services– ‘Raw’ and Specialized Analysis Data– Rich Query Facilities
• Tools and Workflows– Navigate and Sift Raw and Analysis Data– Publish Workflows and Develop New Ones– Prioritize Features via Dialogue with Community
Source: Saul KravitzDirector of Software Engineering
J. Craig Venter Institute
![Page 17: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/17.jpg)
Calit2 and the Venter Institute Will Combine Telepresence with Remote Interactive Analysis
OptIPuter Visualized
Data
HDTV Over
Lambda
Live Demonstration
of 21st Century National-Scale Team Science
25 Miles
Venter Institute
![Page 18: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/18.jpg)
Calit2 Works with CENIC to Provide the California Optical Core for CineGrid
Calit2UCI
USC
SFSU
UCB
In addition, 1Gb and 10Gb Connections to:
• Seattle, Asia, Australia, New Zealand
• Chicago, Europe, Russia, China
• Tijuana, Rosarita Beach, Ensenada
Discussions with CITRIS
Calit2’s CineGrid Team is Working with Cinema Industry
in LA and SF
Extending SoCal OptIPuter to USC
School of Cinema-Television
Calit2UCSD
Prototype of CineGrid
Digital Archive of Films
Partnering with SFSU’s Institute for
Next Generation Internet
![Page 19: High Performance Collaboration – The Jump to Light Speed](https://reader036.vdocuments.us/reader036/viewer/2022062514/559cd7671a28ab885f8b46d5/html5/thumbnails/19.jpg)
First Trans-Pacific Super High Definition Telepresence Meeting in New Calit2 Digital Cinema Auditorium
Keio University President Anzai
UCSD Chancellor Fox
Lays Technical Basis for
Global Digital
Cinema
Sony NTT SGI