cloud futures 2011 - microsoft.com · cloud futures 2011 christopher alme, christopher nunu dennis...
TRANSCRIPT
![Page 1: Cloud Futures 2011 - microsoft.com · Cloud Futures 2011 Christopher Alme, Christopher Nunu Dennis Qian, Stanley Roberts Stephen Wong . Uncharted Skies: Streaming Cloud](https://reader033.vdocuments.us/reader033/viewer/2022043008/5f97908f7f465e1e671b1a83/html5/thumbnails/1.jpg)
Cloud Futures 2011
Christopher Alme, Christopher Nunu Dennis Qian, Stanley Roberts
Stephen Wong
![Page 2: Cloud Futures 2011 - microsoft.com · Cloud Futures 2011 Christopher Alme, Christopher Nunu Dennis Qian, Stanley Roberts Stephen Wong . Uncharted Skies: Streaming Cloud](https://reader033.vdocuments.us/reader033/viewer/2022043008/5f97908f7f465e1e671b1a83/html5/thumbnails/2.jpg)
Uncharted Skies: Streaming Cloud
Real time data streams ground cloud
Process data in the cloud
Stream the results back to the ground
Huge parallel processing capability
Elasticity dynamic configurability!
Cloud Futures
2010
![Page 3: Cloud Futures 2011 - microsoft.com · Cloud Futures 2011 Christopher Alme, Christopher Nunu Dennis Qian, Stanley Roberts Stephen Wong . Uncharted Skies: Streaming Cloud](https://reader033.vdocuments.us/reader033/viewer/2022043008/5f97908f7f465e1e671b1a83/html5/thumbnails/3.jpg)
Practical Uses Air/Auto Traffic Control
Environmental Sensors
Inventory Tracking
Surveillance
Home Automation
![Page 4: Cloud Futures 2011 - microsoft.com · Cloud Futures 2011 Christopher Alme, Christopher Nunu Dennis Qian, Stanley Roberts Stephen Wong . Uncharted Skies: Streaming Cloud](https://reader033.vdocuments.us/reader033/viewer/2022043008/5f97908f7f465e1e671b1a83/html5/thumbnails/4.jpg)
Initial Project Motivations
Interactive Art
Dynamically changing inputs, incl. game controllers
Scalable number of users
Multiple, simultaneous results visualizations
![Page 5: Cloud Futures 2011 - microsoft.com · Cloud Futures 2011 Christopher Alme, Christopher Nunu Dennis Qian, Stanley Roberts Stephen Wong . Uncharted Skies: Streaming Cloud](https://reader033.vdocuments.us/reader033/viewer/2022043008/5f97908f7f465e1e671b1a83/html5/thumbnails/5.jpg)
The Team 4 students in semester-long software-
engineering project
No initial experience in C#, .NET, Azure, enterprise systems, etc.
Self-organized and self-directed team created and assigned own tasks.
Discovery process: Make mistakes and learn from them.
![Page 6: Cloud Futures 2011 - microsoft.com · Cloud Futures 2011 Christopher Alme, Christopher Nunu Dennis Qian, Stanley Roberts Stephen Wong . Uncharted Skies: Streaming Cloud](https://reader033.vdocuments.us/reader033/viewer/2022043008/5f97908f7f465e1e671b1a83/html5/thumbnails/6.jpg)
User Experience: The Ground Connect Streams to the Cloud
Manage Processing of Streams
Visual Representation of Results
![Page 7: Cloud Futures 2011 - microsoft.com · Cloud Futures 2011 Christopher Alme, Christopher Nunu Dennis Qian, Stanley Roberts Stephen Wong . Uncharted Skies: Streaming Cloud](https://reader033.vdocuments.us/reader033/viewer/2022043008/5f97908f7f465e1e671b1a83/html5/thumbnails/7.jpg)
Architecture: The Ground
Control Panel
Cloud Settings Options Status
Stream Mgr
Stream
Stream
Stream
Stream Up Stream Mgr
Stream
Stream
Stream
Stream Up Stream Mgr
Stream
Stream
Stream
Stream Up
Display Visualization of Cloud Output
Stream Down Visual
Representation of Cloud Output
Display Visualization of Cloud Output
Stream Down
Stream Manager
• Provides a way for the user to connect streams up into the cloud
• Arbitrary number of running instances
• Dynamically add/remove Streams
• User Friendly
Display • Receives streaming output from the cloud
• Renders the output from the cloud
• Displays the results on a screen
• Arbitrary physical location
Control Panel
• Administration of cloud functionality
• How input streams are used in processing
• Coordinate the creation of processing graph
• Assigns display outputs to processed data.
![Page 8: Cloud Futures 2011 - microsoft.com · Cloud Futures 2011 Christopher Alme, Christopher Nunu Dennis Qian, Stanley Roberts Stephen Wong . Uncharted Skies: Streaming Cloud](https://reader033.vdocuments.us/reader033/viewer/2022043008/5f97908f7f465e1e671b1a83/html5/thumbnails/8.jpg)
Architecture – The Cloud Feature
Extractor Stream
Feature Extractor
Stream
Feature Extractor
Stream
Mixer
Mixer
Mixer
Mixer
Mixer
Stream Display Adapter
Stream Display Adapter
2-way
Mes
sage
Control Process
Stream Entry Processing of Streams
Stream Exit
State Repository
Control Process
• Creates the processing graph structure
• Provides user access to the cloud structure
• Manages fault tolerance
Feature Extractors
• Stream entry into the cloud
• Single Stream Number Crunching
• Converts streams into internal events
• Forwards events to proper Mixer
Mixers
• Given an arbitrary lambda
• Syncs and Processes Streams
• Linked to produce a graph of operations
Display Adapters • Stream exit point, connection to Display
• Converts the processing results to Visualization commands
• Different adapters can be set to produce different results
State Repository • Shared database
• Stores processing graph configuration data
• Allows for re-creation of lost module/connection
![Page 9: Cloud Futures 2011 - microsoft.com · Cloud Futures 2011 Christopher Alme, Christopher Nunu Dennis Qian, Stanley Roberts Stephen Wong . Uncharted Skies: Streaming Cloud](https://reader033.vdocuments.us/reader033/viewer/2022043008/5f97908f7f465e1e671b1a83/html5/thumbnails/9.jpg)
Demo Structure Stock value
Level
Gesture & Button Detect
Buy
Sell
Display Out
Filter
![Page 10: Cloud Futures 2011 - microsoft.com · Cloud Futures 2011 Christopher Alme, Christopher Nunu Dennis Qian, Stanley Roberts Stephen Wong . Uncharted Skies: Streaming Cloud](https://reader033.vdocuments.us/reader033/viewer/2022043008/5f97908f7f465e1e671b1a83/html5/thumbnails/10.jpg)
Real-time challenges in the Cloud
Reconstruction of lost modules
Modules are not identical!
TCP timeout Azure does not assume persistent connections!
Lost Connections Azure load balancer can’t make specific connection.
Dev Fabric Isolation Doesn’t allow outside connections
![Page 11: Cloud Futures 2011 - microsoft.com · Cloud Futures 2011 Christopher Alme, Christopher Nunu Dennis Qian, Stanley Roberts Stephen Wong . Uncharted Skies: Streaming Cloud](https://reader033.vdocuments.us/reader033/viewer/2022043008/5f97908f7f465e1e671b1a83/html5/thumbnails/11.jpg)
Questions?
![Page 12: Cloud Futures 2011 - microsoft.com · Cloud Futures 2011 Christopher Alme, Christopher Nunu Dennis Qian, Stanley Roberts Stephen Wong . Uncharted Skies: Streaming Cloud](https://reader033.vdocuments.us/reader033/viewer/2022043008/5f97908f7f465e1e671b1a83/html5/thumbnails/12.jpg)
Into the Blue was supported by
Thank-you for enabling us to take flight!