fractally-organized connectionist networks - keynote speech @pewet 2015
TRANSCRIPT
![Page 1: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/1.jpg)
Fractally-organized Connectionist Networks
VincenzoDe FlorioMOSAIC: UniAntwerp iMinds
![Page 2: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/2.jpg)
2
Times, they are a-changin’…
Less resources
Higher peaks, harder
shocks
Higher number
of users…
ICT
Energy product-ion & distribution
Businesses
Transport ofgoods & people
HEALTHCARE
ORGANIZATIONALCRISIS
Understanding & rethinkingour organizations is crucial!
![Page 3: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/3.jpg)
3
With the meter in the red zone…• …organizations that
appeared to work fine reveal their limitations!– lose too much –use up too many resources–do not scale well– intolerable to changes– fail to address new aspects→Traditional approaches are
reaching structural limits.
![Page 4: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/4.jpg)
A little world with big problems• Scale has changed– Data are big; users are many; requests and
needs to be answered are too many• Complexity has arisen and is spreading
through the layers of our interconnected infrastructures
• Interdependence increases fragility• Our design assumptions systematically
introduce yielding points.
![Page 5: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/5.jpg)
Challenges• How do we address pervasive societal
problems such as healthcare & crisis management?• How do we rethink our organizations?
Which tools, which software could help?
1.Examples & ingredients2.A recipe3.Discussion4.Conclusions
This ppt
![Page 6: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/6.jpg)
Example: A LED Lamp• A collective system
made of a largenumber of simple units
• Simple-behavioured "Parts" producinga simple-behavioured"Whole"
• A simple organization!– No need to "connect"– Connection: managed "physically", through
the additive properties of physical light.
![Page 7: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/7.jpg)
Simple Parts, Simple Whole... Complex Emergence!
• Complex emerging properties!– Low power consumption– Higher efficiency– Graceful degradation: "Fuzzy" failure
semantics!
→ Small is (sometimes!) beautiful!
![Page 8: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/8.jpg)
Example: Telemonitoring Servicein Project "Little Sister"
• Low-cost non-intrusivetelemonitoring solution
• Specially designed low-res sensors• Battery powered• All resources wrapped as
manageable web services• Deployed into a smart
house.
![Page 9: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/9.jpg)
Simple Parts, Complex "Glue":Complex Emergence!
• A middleware component manages the WS• Middleware turns on / off the nodes– in function of the context / situation / required
operation / "mode"– Energy vs. Safety trade-offs: Sensors are used
only when needed to guarantee safety→ Prolonging the sensors' "lives"
• Connectionism: small and connected is (sometimes!) even more beautiful.
![Page 10: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/10.jpg)
Connectionism
• Our first "ingredient"!• aka Parallel and distributed processing;
aka ANN• Networks of tiny units• Complexity is in the network rather than in
the units• Units: feature-like entities.
![Page 11: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/11.jpg)
Connectionism
• State of activation: unit is participating / it is in sleep-mode
• Output of the unit: percentage of involvement
• Patterns of activity: how involvement "spreads" through the network
• Activation rule: next configuration, given the current one + context change.
![Page 12: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/12.jpg)
Connectionism
• Modifying patterns of connectivity as a function of experience
• Done in PhD work (outside the scope of LS)– Tracking the performance of individual units– Gradual penalization / rewarding– Enrollment = f( "score" )
→ A learning step!
![Page 13: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/13.jpg)
Connectionism
• Biggest limitations:– absolute simplicity– flat organization.
![Page 14: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/14.jpg)
Example: Little Sister'sFractal Organization
• Idea: moving from absolute simplicity to relative simplicity
• Units are simple w.r.t. their "level"• Hierarchical organization of "fractals"• Each fractal, a WS group of units led by a
coordinator/representative: the MW.
![Page 15: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/15.jpg)
LS Middleware• Based on a fork of Apache MUSE– “a Java-based implementation of the WS-
ResourceFramework (WSRF), WS-BaseNotification (WSN), and WS-DistributedManagement (WSDM) specifications”
• On top of Axis2• Partially implements the WSDM-MOWS
specifications (Web Services Distributed Management: Management of Web Services).
![Page 16: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/16.jpg)
Laye
r 0(R
aw
com
po-
nent
s)
Laye
r 1
(e.g
.,Sm
art
Hou
se)
Laye
r 2
(e.g
, Sm
art
Bui
ldin
g)
Laye
r 3
(e.g
., Sm
art H
ospi
tal)
..Upp
er
laye
rs...
![Page 17: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/17.jpg)
LS' fractal social organization
• Multi-tier distributed architecture• Services structured within hierarchical
federation reflecting structure of deployment environment– rooms; flats; building; external application
• Each level, a "fractal"– Same rules, different units– Service-oriented community.
![Page 18: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/18.jpg)
Bind
Local analysisand coordination Intra-level
processing
Member
Service and feature registry
Servicedescription
Publish PublishCapabilitiesPoliciesAvailabilityLocations…
Roles &situations
Member MemberLS sensors Units MemberMember MemberMember
SoC's…
Inter-levelprocessing
Service-oriented CommunityException → Event propagation
![Page 19: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/19.jpg)
FSO: Fractal organization of SoC's
• "Principle of increasing inclusiveness, so that entities at one level are composed of parts at lower levels and are themselves nested within more extensive entities"
• Nature's way: nested compositional hierarchies.
![Page 20: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/20.jpg)
FSO: Fractal organization of SoC's
• Simplified version in LS– Predefined number of levels– Predefined operations– No semantic description and matching– No definition of new inter-level SoC's.
![Page 21: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/21.jpg)
Fractal connectionism• Our "recipe"!• Connectionism with– relative simplicity– increasing inclusiveness.
![Page 22: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/22.jpg)
Fractal connectionism
• Networks of fractals• Complexity is in the network and in the
units• Units: entities simple w.r.t. the current
level.
![Page 23: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/23.jpg)
Fractal connectionism• State of activation: as in connectionism– unit is participating / it is in sleep-mode
• Output of the unit: percentage of involvement– FSO: all or nothing
• Patterns of activity: how involvement "spreads" through the network– FSO: enrollment and exceptions.
![Page 24: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/24.jpg)
Fractal connectionism• Modifying patterns of connectivity as a
function of experience• Tracking the performance of individual
units and compounds• Permanentification: from transient to
permanent response→ A learning step!
![Page 25: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/25.jpg)
Fractal Social Orgs
• Mathematical model: http://goo.gl/gvVGH5
• Geometrical and audio representations–Modularity–Self-similarity–Fractal dimension!
http://goo.gl/vO8RKj
![Page 26: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/26.jpg)
0011
2222
2222
![Page 27: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/27.jpg)
0123
4567
8
![Page 28: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/28.jpg)
0011
2334
4
![Page 29: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/29.jpg)
Conservation of modularity
![Page 30: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/30.jpg)
• Complex FSOs• With NetLogo
Simulations
![Page 31: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/31.jpg)
Simulations
![Page 32: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/32.jpg)
Preliminary results
![Page 33: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/33.jpg)
Conclusions• Two "Gestalts"– Connectionism, fractal organization
• F → C– relative simplicity; increasing inclusiveness
• C → F–Many gaps are revealed!–More complex states of activation and outputs
of the unit: nature and percentage of involvement.
![Page 34: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/34.jpg)
Conclusions
• Small is beautiful→Small and connected is more beautiful →Relatively small and fractally organized is
even more so!
![Page 35: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/35.jpg)
Thank you for your attention!
Questions?
![Page 36: Fractally-organized Connectionist Networks - Keynote speech @PEWET 2015](https://reader036.vdocuments.us/reader036/viewer/2022062406/55bec048bb61eb1f7b8b46a9/html5/thumbnails/36.jpg)
[email protected] / uantwerpen.be
Blog: eraclios.blogspot.be
LinkedIn group "Computational Antifragility"
ANTIFRAGILE workshop
twitter://@EnzoDeFlorio