clap: cooperative locality-aware data processing in ... · dr.-ing. andreas reinhardt dept....
TRANSCRIPT
![Page 1: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/1.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 1
CLAP: Cooperative Locality-Aware Data Processing in Heterogeneous Fog Environments
Aditya Raj, Andreas Reinhardt
GI/ITG KuVS Fachgespräch “Fog Computing”
8 March 2018
![Page 2: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/2.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 2
§ Introduction and problem statement
§ CLAP: Collaborative Locality-Aware Data Processing§ Design overview§ Implementation§ Evaluation
§ Conclusions and outlook
Overview
![Page 3: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/3.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 3
INTRODUCTIONAND PROBLEM STATEMENT
![Page 4: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/4.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 4
Wireless sensors
Image source: https://www.thermofisher.com.au
§ Diverse sensing modalities§ Temperature§ Humidity§ Brightness§ ...
§ Advantages§ Battery-driven operation – less restrictions for device placement § No central entity required for coordination purposes
§ No single point of failure§ Can be deployed in remote areas
§ Disaster relief, military scenarios
![Page 5: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/5.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 5
§ Multi-hop relaying along a ‘collection tree’§ Each node learns the address of the next hop (its ‘parent’ node)§ Packets are iteratively forwarded to nodes’ parents until they reach the
network edge (a.k.a. the ‘base station’)§ Data processing is prevalently run on the base station
Data forwarding in wireless sensor networks
![Page 6: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/6.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 6
§ Nodes by different manufacturers may use the same communication standard (e.g., IEEE 802.11 or IEEE 802.15.4)
§ But they often differ in terms of:§ Processing power§ Available memory§ Residual energy§ Available sensors/actuators§ Operating system support
Device heterogeneity in the Internet of Things
Image source: T. Baumgartner et al., “Wiselib: A Generic Algorithm Library for Heterogeneous Sensor Networks”, EWSN 2010
So why not use them for processingthe sensor data collected distributedlywithin the wireless sensor network?
![Page 7: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/7.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 7
§ Introduce heterogeneous processing devices (PDs) into the network § Initial consideration: Deployment at arbitrary locations
§ Achieve locality-aware (i.e., in the immediate neighborhood) data processing§ Less traffic to the base station à energy savings§ Shorter distances to the processing device à lower latency
Scenario for collaborative data processing
![Page 8: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/8.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 8
§ Interoperability with existing collection protocols (e.g., CTP)§ Fundamental protocol family for data collection networks
§ Locality-aware node discovery§ To avoid long routes to processing devices, only direct and two-hop
neighbors shall be considered
§ Negotiation of processing requirements (e.g., which function to execute) and temporal duration of the agreement
§ Feasibility must be ensured, i.e., actual savings in terms of energy, bandwidth requirements, or latency be proven
Requirements to collaborative data processing
![Page 9: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/9.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 9
CLAP: DESIGN OVERVIEW
![Page 10: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/10.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 10
§ Data collection handled by the (existing) collection tree protocol CTP
§ PDs send advertisement beacons periodically§ Indicators of their availability to process data§ Relayed once by each neighbor of the PD to reach the two-hop neighborhood§ Selection of PD (and possibly relay node) based on the ETX metric, i.e.,
closeness to the base station (value provided by CTP)
§ Once a SN wants to make use of a PD’s processing services§ Handshake protocol to indicate start and end of the data transmission phase§ Data sources (SNs) are served in a first-come-first-serve manner§ Requests from devices further than two hops away are discarded
CLAP: Design decisions
![Page 11: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/11.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 11
CLAP: Components w.r.t. node architecture
![Page 12: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/12.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 12
CLAP: One hop transmission
![Page 13: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/13.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 13
CLAP: Two-hop transmission
![Page 14: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/14.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 14
EVALUATION
![Page 15: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/15.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 15
§ COOJA simulator for wireless sensor networks§ With hardware emulation for accurate modeling of timing/energy
§ Implementation of CLAP in TinyOS (WSN operating system with CTP support)§ Tmote sky (TelosB) as the sensor node
§ Data generation and processing§ 16-bit random payload every 100 ms§ Processing function: Summation of all received values
Evaluation setup
![Page 16: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/16.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 16
Topologies considered
Direct ConnectivityAdditional Connectivity
![Page 17: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/17.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 17
§ Finding§ Each of the PDs is busy during
more than 60% of simulation run time
§ Reason§ The PDs announce themselves
to neighbors as soon as it becomes available again
Computational allocation to PDs
![Page 18: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/18.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 18
CTP vs CLAP
![Page 19: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/19.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 19
CONCLUSIONSAND OUTLOOK
![Page 20: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/20.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 20
Conclusions and further research§ CLAP is a protocol to exploit heterogeneity for in-network data
processing§ Applicability specifically in resource-constrained scenarios
§ Wireless sensor networks, fog computing, Internet of Things§ Practical demonstration of its efficacy in two simulation settings
§ Future work§ Practical Testbed evaluation of simulation§ Using USB interface to add external ‘co-processors’ to emulate a
heterogeneous processing capability§ Deploying high processing requirements algorithms like Fourier
transform, compressions, etc.
![Page 21: CLAP: Cooperative Locality-Aware Data Processing in ... · Dr.-Ing. Andreas Reinhardt Dept. ofInformatics, TU Clausthal CLAP 8 §Interoperability with existing collection protocols](https://reader034.vdocuments.us/reader034/viewer/2022050505/5f96ec2afd300a426d17e2ce/html5/thumbnails/21.jpg)
Dr.-Ing. Andreas ReinhardtDept. of Informatics, TU Clausthal CLAP 21
Thank you for your attention!
Andreas [email protected]
Image source: djd / Tourismusbetrieb der Stadt Oberharz am Brocken