![Page 1: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/1.jpg)
Wireless Mesh Networks and Cloud Computing for Real Time Environmental Simulations
Dr. Eryk Schiller
CDS Group
Institute of Computer Science and Applied Mathematics
University of Bern
20 October 2014, CDS Group Seminar
![Page 2: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/2.jpg)
OUTLINE
Personal Presentation,
The introduction to the A4-Mesh project,
eA4-Mesh, Swiss Academic Compute Cloud project, what next?
Short summary & results.
2
![Page 3: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/3.jpg)
MY CV
Graduated from the Networking Department, University of Science and Technology, Cracow, Poland, 2006 (MSc).
Graduated from the Theoretical Physics Department of the Jagiellonian University, Cracow, Poland, 2007 (MSc).
PhD in Computer Science from the University of Grenoble, France, 2010.
Post-Doc in the Distributed Computing Group of the University of Neuchatel, 2010 – 2014.
Recently joined the CDS Group in August 2014.
Please remember about the APERO, WED, 22/10/2014, Meeting Room!!
3
![Page 4: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/4.jpg)
CRACOW, POLAND
4
![Page 5: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/5.jpg)
GRENOBLE, FRANCE
5
Grenoble
![Page 6: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/6.jpg)
NEUCHATEL, SWITZERLAND
6
Neuchatel
Switzerland
![Page 7: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/7.jpg)
A4-MESH, EA4-MESH, SWISS ACC
7
The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf at the University of Neuchatel, Switzerland.
Cooperation with CDS on various tasks & subjects.
![Page 8: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/8.jpg)
WIRELESS MESH NETWORKS
8
Application Scenarios
1. Campus Network Extension
2. Environmental Monitoring
![Page 9: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/9.jpg)
ENVIRONMENTAL MONITORING
Support for scientists (hydrology researchers) to collect sensor data from environmental measurements.
Scientists use data for generating and verifying models of the environment.
Specific measurements to cover certain areas or to collect specific sensor data are needed.
9
Requirements :
![Page 10: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/10.jpg)
WMNS FOR ENVIRONMENTAL MONITORING
In remote locations, wired networks are not available,
We have thus to foresee some other access methods,
Cellular telephony has reception problems, equipment may thus not be placed appropriately,
Satellite access is very costly and requires substantial energy resources,
Wireless Mesh Networks (WMN) do not require substantial amounts of energy and therefore may operate solar powered in remote locations.
The installation process of WMNs is cheap, they do not require building expensive infrastructures,
Equipment is recyclable, i.e., we can take equipment from one location and reuse it in another setup.
10
![Page 11: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/11.jpg)
WMNS FOR ENVIRONMENTAL MONITORING
QuiRiNet : Design of the wide area WMN based system for environmental data harvesting
11
Quail Ridge Reserve in Napa County, California, 3x4 km area
QuRiNet: A wide-area wireless mesh test-bed for research and experimental evaluations, D. Wu; D. Gupta and P. Mohapatra,
Ad Hoc Networks, Volume 9, Issue 7, pp. 1221–1237, 2011
![Page 12: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/12.jpg)
WMNS FOR ENVIRONMENTAL MONITORING
Predicting Floods through Ensemble Kalman Filter based Modeling
Heterogeneous Data Harvesting: GSM, IEEE 802.11, IEEE 802.15.4
12
Wrexham County Borough, Wales, UK, 53.10 N, 2.91 W
Towards the provision of site specific flood warnings using wireless sensor networks, P. J. Smith; D. Hughes; K. J. Beven; P.
Cross; W. Tych; G. Coulson and G. Blair, Meteorological Applications, pp. 57–64, 2009
![Page 13: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/13.jpg)
The Emmental
characteristics:
• Watershed: 175 km2
• Abstraction: 640 m3/d
• Precipitation: 1370 mm/year
• Runoff: 8000 m3/d
drinking
water
station
DRINKING WATER SUPPLY FOR CITY OF BERN
13
Graphics provided by D. Käser
![Page 14: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/14.jpg)
RIVER EMME – A DYNAMIC ECOSYSTEM
Groundwater from the valley is used as a water source for the city of Bern,
Sometimes, sections of the river can run completely dry,
Subsequently, water pumping rates of the groundwater wells have to be reduced to comply with the environmental laws of Switzerland, which require minimal flows to be maintained.
14
River Emme, Photos provided by D. Käser
![Page 15: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/15.jpg)
GROUNDWATER-RIVER INTERACTIONS
Problems:
• Groundwater pump
management
• Variations in the river
flow rate
• Large water discharge
changes the river’s
structure
Hydrograph
1999 (m3/s)
15
![Page 16: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/16.jpg)
ENVIRONMENTAL MONITORING SCENARIOS
16
![Page 17: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/17.jpg)
A HARDWARE PLATFORM
ALIX3D2 provided by PCEngines.CH,
Contains an i586 compatible processor at 512 MHz,
256 MB DDR,
On-board CompactFlash card reader,
2 miniPCI slots,
2 USB ports,
1 Ethernet card 100 Mbit/s,
Power: 7 – 20 V.
17
It is powerful enough to run embedded Linux
(e.g., OpenWRT, ADAM, etc.)
![Page 18: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/18.jpg)
SOLAR POWERED NODES
A solar panel which is large enough can provide an uninterrupted operation of the Wireless Station at a remote location. Badaway et al.specify a Linear Program which provides the minimum solar panel size to maintain an uninterruptable operation of a solar-powered node.
18
Alix3
D2Solar Panel Size
Solar Powered WLAN Mesh Network Provisioning for Temporary Deployments, G. H. Badawy; A. A. Sayegh and T. D.
Todd, IEEE WCNC 2008, pp. 2271–2276, 2008
![Page 19: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/19.jpg)
HARVESTING ENERGY
Energy Measurements of battery power; a solar powered node in the A4-Mesh WMN in the Swiss Alps.
19
Real-World Energy Measurements of a Wireless Mesh Network, A. Jamakovic; D. C. Dimitrova; M. Anwander; T. Macicas; T.
Braun; J. Schwanbeck; T. Staub and B. Nyffenegger, European Conference on Energy Efficiency in Large Scale Distributed
Systems, EE-LSDS, 2013
![Page 20: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/20.jpg)
UNINTERRUPTED LONG TERM OPERATION
Energy measurements of battery power – long term operation
20
Towards Enabling Uninterrupted Long-Term Operation of Solar Energy Harvesting Embedded Systems, B. Buchli, F. Sutton,
J. Beutel, and L. Thiele, 11th European Conference, EWSN 2014, Oxford, UK, February 17-19, 2014, Lecture Notes in
Computer Science, vol. 8354.
![Page 21: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/21.jpg)
WIRELESS SETUP
21
ALIX3D2
WNC DNMA-92
IEEE 802.11abgn
MIMO ANTENNA
Top MCS
300 Mbit/s
![Page 22: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/22.jpg)
WMN NETWORK OPERATIONS
Ordinary TCP/IP network stack for transport data,
The WMN requires routing protocols,
There are various routing protocols options for WMNs,
OLSR,
IEEE 802.11s (link layer),
B.A.T.M.A.N. (not tested so far).
IEEE 802.11s based on the AirTime metric used,
IEEE 802.11s is link based, so it does not support nodes with multiple interfaces,
OLSR required to connect IEEE802.11s domains.
22
![Page 23: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/23.jpg)
OLSR + IEEE 802.11S
23
OLSR ZONE
Mesh 2
Mesh 1
Nodes with multiple interfaces cannot reside in one
IEEE 802.11s mesh domain.
![Page 24: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/24.jpg)
THE A4-MESH SETUP IN THE EMMENTAL
Wireless Mesh Networks and Cloud Computing for Real Time Environmental Simulations, Peter Kropf, Eryk Schiller, Philip Brunner , Oliver Schilling, Daniel Hunkeler, Andrei Lapin, Proceedings of the 10th International Conference on Computing and Information Technology (IC2IT2014),
Real-time Environmental Monitoring for Cloud-based Hydrogeological Modeling with HydroGeoSphere, Andrei Lapin, Eryk Schiller, Peter Kropf, Oliver Schilling, Philip Brunner, Almerima Jamakovic-Kapic, TorstenBraun, and Sergio Maffioletti, Proceedings of The APP Workshop associated with the High Performance Computing and Communications Conference, (IEEE HPCC2014).
24
![Page 25: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/25.jpg)
EMMENTAL MESH NETWORK TOPOLOGY
The Gateway is in Aebnitegg,
A multi-hop relay resides at the water pumping station,
Three solar-powered measuring nodes close to the Emme river,
Redundant links to improve reliability of our network.
25
![Page 26: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/26.jpg)
ÄBNITEGG
26
The node is installed on a small chalet which belongs to a farmer in the Emmental,
It has access to the Internet through the ADSL connection,
It uses the electrical grid.
![Page 27: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/27.jpg)
WATER PUMPING STATION
27
Multi-hop relay
![Page 28: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/28.jpg)
MESH NODE IN THE RIVER VALLEY
28
Solar powered station,
It has environmental sensors attached.
![Page 29: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/29.jpg)
Distributed Temperature Sensing (DTS):
GROUNDWATER-SURFACE INTERACTION
850n
m
1064n
m
1300n
m
29
![Page 30: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/30.jpg)
NETWORK MONITORING & MANAGEMENT
Network Monitoring is implemented as a periodical check of the state of a particular resource,
It provides information for management and planning,
There are numerous monitoring systems:
SNMP //RFC3411-3418,
Nagios http://www.nagios.org
Zabbix http://www.zabbix.com
Zabbix used due to the monolithic architecture & easy adaptation to Linux distributions for embedded devices such as ADAM.
30
![Page 31: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/31.jpg)
A4-MESH SENSOR DATA STORAGE
31
Zabbix monitoring agent running on a mesh node to gather scientific sensor data.
Zabbix server running on a lab Linux machine to store sensor data.
Zabbix web interface shows detailed environmental plots.
![Page 32: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/32.jpg)
WMN IN EMMENTAL
Problem :
• Management of groundwater pumping
• Forecast ?
![Page 33: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/33.jpg)
ENVIRONMENTAL FORECASTING
Quantifying the influence of groundwater abstraction on river water levels requires a lot of data and quantitative models,
Adjusting the groundwater pumping rates must be based on good predictions of future water levels,
The quantitative model needs to be calibrated against measurements
With time, conventionally calibrated models deviate from the real system,
Real-Time Modeling can improve environmental predictions by adjusting states and re-calibrating model parameters when the provided predictions deviate from the real system.
33
![Page 34: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/34.jpg)
The HydroGeoSphere is used as the numerical application to simulate and quantify dynamics of the environmental system.(HydroGeoSphere: A Three-dimensional Numerical Model Describing Fully-integrated Subsurface and Surface Flow and Solute Transport, R. Therrien; R. G. Mclaren; E. A. Sudicky and S. M. Panday, 2007)
NUMERICAL MODEL: HYDROGEOSPHERE
34
HydroGeoSphere allows the
numerical simulation of all the
relevant surface water and
groundwater processes that are
important in a pre-alpine valley
like the Emmental
![Page 35: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/35.jpg)
CONVENTIONAL VS REAL-TIME MODELING
35
Time
Variable
Time
Variable
Observation Observation
Model
Model
graphics provided by W. Kinzelbach
![Page 36: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/36.jpg)
ENSEMBLE KALMAN FILTER
Ensemble Kalman Filter (EnKF) is an elegant method for real-time modeling; it is a Monte-Carlo based method running a large number of models with slightly different initial states and model parameters in parallel.(Real-time groundwater flow modeling with the Ensemble Kalman Filter: Joint estimation of states and parameters and the
filter inbreeding problem, H. J. Hendricks Franssen and W. Kinzelbach, J. Water Resources Research, 2008)
The EnKF is used to provide a whole ensemble of predictions, allowing:
the computation of statistical moments
Continuous recalibration whenever new data becomes available.
EnKF is thus highly suited for parallelization!
36
![Page 37: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/37.jpg)
PUTTING IT TOGETHER
Real-time environmental modeling through the EnKF,
Requires: Real-time data harvesting,
EnKF is a Monte Carlo method which requires a large number of independent simulation runs,
Good forecasting is required to steer the water pumping station.
37
Ensemble
Kalman
Filter
water source
pumping
station
gather environmental
data
laun
ch s
imulta
ne
ou
s
insta
nces o
f H
GS
drive pumping
water source for the
city of Bern
![Page 38: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/38.jpg)
RUNTIMES OF THE HGS MODELER
Runtime example for the simplest Emmental model:
About 3.5 hrs on an Intel Xeon, 2.9 GHz, on 2 cores.
Conventional modeling requirements:
10 step optimization requiring 18 parallel model runs per step
6 models can be run in parallel,
Optimization time approx. 100 – 150 hours
Real Time modeling requirements:
Continuous optimization, whenever new data becomes available
Ensemble Kalman Filter forecast requires at least 100 parallel model runs per update step
impossible on a desktop machine… cluster or computing cloud required!
38
![Page 39: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/39.jpg)
CLOUD COMPUTING
Externalisation
Everything is a service
Infrastructure, Platform, Application
Dematerialisation
Minimise physical intervention: virtualisation
Scalability
Compute centers
Numerous ressources(ex. 100’000 CPUs)
![Page 40: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/40.jpg)
CLOUD OPERATING SYSTEMS
OpenNebula, Eucalyptus, OpenStack, HP, Citrix,
Hypervisors: OpenStack, Xen, KVM, VMWare, Hyper-V,
40
![Page 41: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/41.jpg)
AMAZON S3 OBJECT STORE
41
CLOUD
Object Store
BUCKET BUCKET
OBJECT OBJECTCLIENT
![Page 42: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/42.jpg)
GC3PIE
GC3Pie is a Python framework to execute external commands in diverse computing resources,
It can distribute load among cloud-based VMs, clusters, computational Grids, and any Linux based machines with SSH access,
GC3Pie nicely integrates with the OpenStack Clouds,
GC3Pie is implemented by the Grid Computing Competence Center (GC3) of the University of Zurich.
42
GC3Pie: A Python framework for high-throughput computing, S. Maffioletti and R. Murri; EGI Community Forum, Proceedings
of Science (EGICF12-EMITC2), 2012.
![Page 43: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/43.jpg)
CLOUD BASED COMPUTING ARCHITECTURE
43
Integration of WMNs & Cloud-based Infrastructures for computing,
Zabbix for environmental monitoring,
GC3Pie for cloud orchestrating,
Object Store is used for installing states & keeping Input/Output.
![Page 44: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/44.jpg)
WORKFLOW DIAGRAM
A user directly interacts with the web-interface,
The web-interface installs input/output and jobs in the S3-based Object Store,
The Cloud Task Manager periodically checks the Object Store for new tasks,
GC3Pie orchestrates the VMs in the Cloud,
VMs run simultaneous instances of the HydroGeoSphere application simulating different environmental models [EnKF is easily parallelizable]
44
![Page 45: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/45.jpg)
INFORMATION FLOW
The user provides input files,
Dynamic data interfaces to fetch data from external resources (planned),
Assembled data reside in the Object Store,
The Cloud Task Manager takes input from the Object Store and distributes it among HydroGeoSphere workers on VMs.
45
![Page 46: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/46.jpg)
HYDROGEOSPHERE OUTPUT
Saturation of the soil:
46
![Page 47: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/47.jpg)
HYDROGEOSPHERE OUTPUT
River water levels:
47
![Page 48: Wireless Mesh Networks and Cloud Computing for Real Time ... · The following part of the presentation is about my work as a post-doc in the Distributed Computing Group of Peter Kropf](https://reader034.vdocuments.us/reader034/viewer/2022042108/5e879d0baa610c378643d8ba/html5/thumbnails/48.jpg)
FUTURE OF THE A4-MESH SETUP
Integration with laser-based distributed temperature sensors,
Integration of the cloud architecture with the Distributed Kalman Filter currently under development in Nechatel, CH and Jülich, DE.
Hybrid solution with small embedded systems integrated with the A4-Mesh measuring architecture for providing uninterruptable 24/24 operation.
Getting funds for the future operation?
CUS-P2, e.g., Swiss eScience Support Team (becoming a node),
Other ideas?
48