1. 1. From the Shared Internet to Personal Light Waves: How the OptIPuter is Transforming Scientific Research Invited Talk Naval Postgraduate School Monterey, CA March 27, 2008 Dr. Larry SmarrDirector, California Institute for Telecommunications and Information TechnologyHarry E. Gruber Professor,Dept. of Computer Science and EngineeringJacobs School of Engineering, UCSD
2. 2. Abstract During the last few years, a radical restructuring of optical networks supporting e- Science projects has occurred around the world. U.S. universities are beginning to acquire access to high bandwidth lightwaves (termed quot;lambdasquot;) on fiber optics through the National LambdaRail and the Global Lambda Integrated Facility. The NSF-funded OptIPuter project explores how user controlled 1- or 10- Gbps lambdas can provide direct access to global data repositories, scientific instruments, and computational resources from the researcher's Linux clusters in their campus laboratories. These end user clusters are reconfigured as quot;OptIPortals,quot; providing the end user with local scalable visualization, computing, and storage. Creating this cyberinfrastructure necessitates a new alliance between campus network administrators and high end users. I will describe how this user configurable OptIPuter global platform opens new frontiers in collaborative work environments, digital cinema, interactive ocean observatories, and marine microbial metagenomics.
3. 3. Calit2 Continues to PursueIts Initial Mission: Envisioning How the Extension of InnovativeTelecommunications and Information Technologies Throughout the Physical World will Transform Critical Applications Important to the California Economy andits Citizens Quality Of Life.Calit2 is a University of California Institutional Innovation Experiment on How to Invent a Persistent Collaborative Research and EducationEnvironment that Provides Insight into How the UC, a Major Research University, Might Evolve in the Future. Calit2 Review Report: p.1
4. 4. Two New Calit2 Buildings Provide New Laboratories for Living in the Future Convergence Laboratory Facilities Nanotech, BioMEMS, Chips, Radio, Photonics Virtual Reality, Digital Cinema, HDTV, Gaming Over 1000 Researchers in Two Buildings Linked via Dedicated Optical Networks UC Irvinewww.calit2.net Calit2 Has Pulled Together Over 300 Grants and 100 Companies
5. 5. Calit2 Research Partnership with San Diegos SPAWAR Calit2 / SPAWAR Cooperative Research Agreement $15 Million Over 5 Years UCSD Campus WideAdministered by Calit2 Won Based on an Openly Advertised CFP SPAWAR Can Quickly Add a Researcher to SPAWAR Research Grants Has Funded Over 40 Separate Projects During Five Years Sixteen Professors From ECE, CSE, Calit2, CogSci, SIO, & BioSci Signal Processing Satellite, Wireless, Laser, and Fiber Networks Remote Sensing Security Acoustics Learning Tools Buoy Design Service Oriented Architectures
6. 6. The OptIPuter Project: Creating High Resolution Portals Over Dedicated Optical Channels to Global Science Data ScalableAdaptiveGraphics Environment (SAGE)$13.5M OverFive YearsPictureSource: Mark Ellisman, David Lee,Jason Leigh Calit2 (UCSD, UCI) and UIC Lead CampusesLarry Smarr PIUniv. Partners: SDSC, USC, SDSU, NW, TA&M, UvA, SARA, KISTI, AIST Industry: IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Lucent
7. 7. Dedicated Optical Channels Makes High Performance Cyberinfrastructure Possible(WDM)10 Gbps per User ~ 200x Shared Internet Throughput c* f Source: Steve Wallach, Chiaro Networks LambdasSingle 10G Lightpath to Individual UsersEnables Data-Intensive Science
8. 8. National Lambda Rail (NLR) and TeraGrid Provides Cyberinfrastructure Backbone for U.S. Researchers NSFs TeraGrid Has 4 x 10Gb International Seattle Lambda Backbone CollaboratorsPortlandBoise UC-TeraGridUIC/NW-Starlight Ogden/Cleveland Salt Lake CityChicago New York City DenverPittsburgh San FranciscoWashington, DCKansas City Raleigh Albuquerque TulsaLos AngelesAtlantaSan DiegoPhoenixDallas Baton RougeLas Cruces / Links TwoEl Paso Jacksonville Dozen State and Pensacola DOE, NSF, Regional Optical & NASAHoustonSan AntonioNetworks Using NLR NLR 4 x 10Gb Lambdas InitiallyCapable of 40 x 10Gb wavelengths at Buildout
9. 9. Calit2 Has Become a Global Hub for Optical Connections Between University Research Centers at 10Gbps Maxine Brown, Tom DeFanti, Co-ChairsiGrid 2005 TH E GL OBAL LAMBDA INTEGRATED FACILITYwww.igrid2005.orgSeptember 26-30, 2005 Calit2 @ University of California, San DiegoCalifornia Institute for Telecommunications and Information Technology21 Countries Driving 50 Demonstrations Using 1 or 10Gbps Lightpaths 100Gb of Bandwidth into the Calit2@UCSD Building Sept 2005
10. 10. First Trans-Pacific Super High Definition Telepresence Meeting Using Digital Cinema 4k Streams4k = 4000x2000 Pixels = 4xHDStreaming 4kwith JPEG 2000100 TimesCompression the Resolution Gbit/sec of YouTube!Lays Technical Basis forGlobalDigital Keio UniversityCinema President Anzai SonyNTT UCSD SGIChancellor Fox Calit2@UCSD Auditorium
11. 11. CineGrid @ iGrid2005: Six Hours of 4K Projected in Calit2 Auditorium 4K Distance Learning4K Virtual Reality 4K Anime 4K Scientific Visualization 4K Digital CinemaSource: Laurin Herr
12. 12. From Digital Cinema to Scientific Visualization:JPL Simulation of Monterey Bay4k ResolutionSource: Donna Cox, Robert Patterson, NCSA Funded by NSF LOOKING Grant
13. 13. Cisco CWave for CineGrid: A New Cyberinfrastructurefor High Resolution Media Streaming*Source: John (JJ) Jamison, CiscoPacificWave1000 Denny Way(Westin Bldg.)SeattleStarLightNorthwestern UnivLevel3Chicago1360 Kifer Rd. McLean 2007SunnyvaleEquinix818 W. 7th St.Cisco Has Built 10 GigE Waves on CENIC, PW,Los AngelesCENIC Wave & NLR and Installed Large 6506 Switches forAccess Points in San Diego, Los Angeles, Calit2 Sunnyvale, Seattle, Chicago and McLean San Diego for CineGrid Members CWave core PoP Some of These Points are also GLIF GOLEs 10GE waves on NLR and CENIC (LA to SD)*May 2007
14. 14. Beyond 4k From 8 Megapixels Towards a Billion Pixels Calit2@UCI Apple Tiled Display WallDriven by 25 Dual-Processor G5s HDTV50 Apple 30 Cinema DisplaysDigital Cameras Digital CinemaDataOne Foot ResolutionUSGS Images of La Jolla, CA Source: Falko Kuester, Calit2@UCI NSF Infrastructure Grant
15. 15. Multi-Gigapixel Images are Available from Film Scanners Today Multi-GigaPixel ImageBalboa Park, San Diego The Gigapxl Project http://gigapxl.org
16. 16. Large Image with Enormous Detail Requires Interactive OptIPortal Systems http://gigapxl.orgThe OptIPuterProject Works witha Wide Rangeof >100M PixelImagesOne Square Inch Shot From 100 Yards
17. 17. High Resolution Aerial Photography Generates ImagesWith 10,000 Times More Data than Landsat7 Landsat7 Imagery 100 Foot Resolution Draped on elevation data Shane DeGross, Telesis USGS New USGS Aerial Imagery At 1-Foot Resolution ~10x10 square miles of 350 US Cities2.5 Billion Pixel Images Per City!
18. 18. The Calit2 Great Walls at UCSD and UCI Use CGLXand Are Now a Gbit/s HD Collaboratory Feb 29, 2008 Calit2@ UCI wall Calit2@ UCSD wall OptIPortals Used to Visually Study Very Large Collages of NASA Space Observatories
19. 19. My OptIPortalTM Affordable Termination Device for the OptIPuter Global Backplane 20 Dual CPU Nodes, 20 24 Monitors, ~$50,000 1/4 Teraflop, 5 Terabyte Storage, 45 Mega Pixels--Nice PC! Scalable Adaptive Graphics Environment ( SAGE) Jason Leigh, EVL-UIC Source: Phil Papadopoulos SDSC, Calit2
20. 20. U Michigan Virtual Space Interaction Testbed (VISIT)Instrumenting OptIPortals for Social Science Research Using Cameras Embedded in the Seams of Tiled Displays and Computer Vision Techniques, we can Understand how People Interact with OptIPortals Classify Attention, Expression,Gaze Initial Implementation Based onAttention Interaction DesignToolkit (J. Lee, MIT) Close to Producing Usable Eye/Nose Tracking Data using OpenCV Leading U.S.Researchers on the Social Aspects ofCollaborationSource: Erik Hofer, UMich, School of Information
21. 21. Campus Preparations Needed to Accept CENIC CalREN Handoff to Campus Source: Jim Dolgonas, CENIC
22. 22. Great Opportunity to Bring CENIC 10Gbps Fiber to Monterey Bay Research & Education Institutions
23. 23. Current UCSD Experimental Optical Core: Ready to Couple to CENIC L1, L2, L3 ServicesGoals by 2008:CENIC L1, L2 >= 50 endpoints at 10 GigE Services >= 32 Packet switched >= 32 Switched wavelengths Lucent >= 300 Connected endpointsGlimmerglassApproximately 0.5 TBit/sArrive at the Optical Centerof Campus Switching will be a HybridCombination of: Packet, Lambda, Circuit -- Force10 OOO and Packet Switches Already in Place Funded byNSF MRI GrantCisco 6509OptIPuter Border Router Source: Phil Papadopoulos, SDSC/Calit2(Quartzite PI, OptIPuter co-PI)
24. 24. Calit2 Sunlight Optical Exchange Contains Quartzite10:45 am Feb. 21, 2008
25. 25. Planned UCSD Production Campus CyberinfrastructureSupporting Data Intensive Biomedical ResearchActive Data ReplicationN x 10 GbitNxEco-Friendly bit 10Gb GStorage and0 it x1ComputeN Wide-Area 10G Network in a box CENIC/HPRng > 200 Connections10 Gigabit NLR Cavewave DWDM or Gray OpticsL2/L3 On-Demand I2 NewNet Switch Sin g CinegridPhysicalle 10 Gb Connections itYour Lab Here Microarray Source: Phil Papadopoulos, SDSC/Calit2;Elazar Harel, UCSD
26. 26. Calit2/SDSC Proposal to Create a UC Cyberinfrastructureof OptIPuter On-Ramps to TeraGrid Resources OptIPuter + CalREN-XD + TeraGrid =OptiGrid UC Davis UC Berkeley UC San Francisco NPSUC MercedUC Santa CruzUC Los AngelesUC RiversideUC Santa BarbaraUC Irvine Creating a Critical Mass of End Users on a Secure LambdaGridUC San Diego Source: Fran Berman, SDSC , Larry Smarr, Calit2
27. 27. Rocks / SAGE OptIPortals Are Being Adopted Globally UZurich KISTI-KoreaCNIC-China AIST-JapanNCHC-Taiwan NCSA & UIC Osaka U-Japan TRECCSIO@UCSDCalit2@UCICalit2@UCSD NCMIR@UCSD
28. 28. Green Initiative:Can Optical Fiber ReplaceAirline Travel for Continuing Collaborations ? Source: Maxine Brown, OptIPuter Project Manager
29. 29. Adding Australia to the OptIPlanet Collaboratoryvia AARNet International Optical Fiber Network
30. 30. Using the Link to Build the Link Calit2 and Univ. Melbourne Technology Teams No Calit2 Person Physically Flew to Australia to Bring This Up! www.calit2.net/newsroom/release.php?id=1219
31. 31. Launch of the 100 Megapixel OzIPortal Over Qvidium Compressed HD on 1 Gbps CENIC/PW/AARNet FiberJanuary 15, 2008www.calit2.net/newsroom/release.php?id=1219
32. 32. Victoria Premier and Australian Deputy Prime MinisterAsking Questions of Calit2 Audiencewww.calit2.net/newsroom/release.php?id=1219
33. 33. Calit2, SDSC, and SIO are Creating Environmental Observatories
34. 34. NSF-Funded ROADnet and HiSeasNet are Prototypes of the Future of In Situ Earth Observing Systems http://roadnet.ucsd.edu
35. 35. Remote Interactive High Definition Videoof Deep Sea Hydrothermal VentsCanadian-U.S. Collaboration Source John Delaney & Deborah Kelley, UWash
36. 36. e-Science Collaboratory Without Walls Enabled by iHDTV Uncompressed HD Telepresence 1500 Mbits/sec Calit2 to UW Research Channel Over NLRMay 23, 2007John Delaney, PI LOOKING, NeptunePhoto: Harry Ammons, SDSC
37. 37. OptIPlanet Collaboratory Persistent Infrastructure Between Calit2 and U Washington Photo Credit: Alan DeckerFeb. 29, 2008 GingerArmbrusts Diatoms: Micrographs,Chromosomes, GeneticAssemblyUWs Research ChannelMichael Wellings
38. 38. International Threats to Coral Reefs and Ocean Biology -- Urgent Need for SensorNetsScience February 15, 2008 Science December 14, 2007 Science May 14, 2007
39. 39. Coral Reef Environmental Observatory Network (CREON) www.coralreefeon.org/NOAATaiwanNSF Collaboration: UCSB and AS/NMMBA UCSB GBRSource: Stuart Kininmonth, AIMSSource : Fang-Pang Lin, NCHC
40. 40. Taiwans Kenting's Underwater Observatory Deployed off Southern Taiwan 2004 Features 10 Underwater Cameras Setup To Monitor Different Habitats on The Coral Reef Currently Used by Taiwans Academia Sinica and NMMBA On-Shore Video Servers are Used to Convert Analog Signals to Digital MJPEG Video Streams Remote Observatory, Low Bandwidth (~1 Mbps) Video Resolution: 320x240 Pixels Effective Transfer Rate: 1 Frame/secSource: Ebbe Strandell, NCHC
41. 41. New Years Challenge: Streaming Underwater VideoFrom Taiwans Kenting Reef to Calit2s OptIPortal My next plan is to stream stable Remote Videos Local Imagesand quality underwaterimages to Calit2, hopefully byPRAGMA 14. -- Fang-Pang to LS Jan. 1, 2008March 6, 2008PlanAccomplished!March 26, 2008 UCSD: Rajvikram Singh, Sameer Tilak, Jurgen Schulze, Tony Fountain, Peter ArzbergerNCHC : Ebbe Strandell, Sun-In Lin, Yao-Tsung Wang, Fang-Pang Lin
42. 42. The KentingBandwidth Bottleneck Currently Limited Bandwidth Access to Underwater Cameras Two ADSL Cables Bandwidth Less Than a Megabit/ Sec Severely Limits Video Resolution and Frame Rate Kenting Would Benefit From Much Higher Bandwidth 1980 High Definition 1240 Video24 Frame/ sec Kenting 1 Frame/ sec240Video320
43. 43. UCSB Ecological Research Programs:CREON Partner to Kenting Coral Reef Moorea Long Term Ecological Santa Barbara Channel Long Term EcologicalResearch (SBC LTER) Program Research (Moorea LTER) Program Goals Goals Understanding processing in coral reef, Focuses on understanding the lagoons and forereef nearshore ecosystems of the west coast Nature of animal and plant community Time/space variation of individual structure and diversity organisms, populations, and ecological Responses to environmental change communities induced either by human activities or natural cycles Source: Russell Schmitt, Sally Holbrook, UCSB
44. 44. Moorea Coral Reef LTER SiteCurrent Bandwidth ~ 128kbps, But Fiber Optic Cable by 2010 LTER Established Sept. 2004 PIs: Russ Schmitt, Sally Holbrook, Pete Edmunds, Bob Carpenter Deputy Director: Andy Brooks 20 Investigators UC Santa Barbara CSU Northridge UC San Diego / Scripps UC Santa Cruz UC Davis / Bodega Marine Lab University of Hawaii Field Operations Based from UC Berkeley Gump Research Station
45. 45. From Flipper Net to High Speed Wireless: The Calit2 ReefPole Above surface equipment: Solar panels WiFi antenna Weather station VideoCam ))))) Navigation light Instrument boxInstruments & SensorsCables and Acoustic Modems
46. 46. AquaNode:Proposed Software Defined Acoustic Modem Under Development at UCSD/UCSB Deploy Ad Hoc Wireless Underwater Networks Around Coral Reef BatterywSoftware Defined Vie tAcoustic Modem Transmit Dataren spa Between ReefPole andran T Underwater Sensors Aquanode Requirements: Low Cost, Low Power Wireless Modems Associated Networking Functionality Plug and Play Interface with Variety of Sensors Transducer Near Real-time Data and Adaptive SamplingRyan has NSF Computer SystemsResearch Grant to Develop aSoftware Defined Acoustic Modem (SDAM) Source: Ronald Iltis, Hua Lee, Grace Chang, UCSBRyan Kastner, Douglas Palmer, UCSD
47. 47. Calit2 ReefBot Design for Digital Reef Mapping WiFi RadioFlotation ball toto Send Data to prevent capsize + ShoreRADAR retro- reflectorVideo camera forforward lookingMast includes: air navigation intake for engine + antenna2.2 KW DieselGenerator setSealed 360 degree azipod propulsioninstrumentation & with weed shedding prop andcontrol modulecomplete guarding. Deck covered with solar photovoltaiccollectorBasic hull: Inflatablepontoons on sides with4 deep-cycle marine rigid aluminum centerbatteries for energy section. storage
48. 48. ReefBot Is a MobileNetworked Sensor platform Potential Reef Sensor Suite Water sampling Computed currents Temperature, turbidity Digital photographic mapping Wave/surf conditions Accurate bathymetry Acoustic monitoring Collected data can be used for multiple studies Population studies (fish, corals etc) Bleaching, crown of thorns monitoring Growth/destruction profiling Post event assessment Profiling for current/turbidity/siltatation
49. 49. Realtime Sensornets on the Davis Reef Australia With High Speed Wireless Link to ShoreDavies ReefGreat Barrier ReefThe Challenges- Tropics- Distance; PowerJCUAIMS QCIF/UQ ~20Mbps on 10.5 GHz Carrier Source: Stuart Kininmonth, Scott Bainbridge, ~ 70km over Water AIMS Australia.
50. 50. NSFs Ocean Observatories Initiative (OOI) Envisions Global, Regional, and Coastal ScalesLEO15 Inset Courtesyof Rutgers University,Institute of Marine andCoastal Sciences
51. 51. Role of Cyberinfrastructure in NSFs Ocean Observatories Initiative (OOI) Source: John Orcutt, Matthew Arrott, SIO/Calit2 OOI CI Team: UCSD SIO, Calit2, SDSC Rutgers WHOI Raytheon JOI Awards, Funded by NSF: Regional Scale Node $150m, UWash Global/Coastal Scale Nodes $120m, Woods Hole Lead Construction Program Cyberinfrastructure5 Year $30m, SIO/Calit2 UCSD
52. 52. OOI-CI IO PRESENTATIONScience Activity ModelSource: John Orcutt- SIO; Matt Arrott, Calit2
53. 53. Ocean Sensing Systems Paradigm ShiftPlatform-centric Net-centric, Distributed Sensing Systems Autonomous Sensing Systems Uncertain,Unknown Environment Uncertain Communication No maps Self-navigating CooperativeNetworkBehavior AdaptiveBehavior Acoustic sensing Uncertainty Similar in Shift to Net-centric Warfighting
54. 54. Towards a Total Knowledge Integration System for the Coastal ZoneSensorNets Linked to Fiber Cable Pilot Project Components Moorings Atul Nayak Frank Vernon Ships Autonomous Vehicles Satellite Remote Sensing Drifters Long Range HF Radar Near-Shore Waves/Currents COAMPS Wind Model Nested ROMS Models Data Assimilation and Modeling Data SystemsYellowProposed Initial OptIPuter Backbone www.sccoos.org/