Download - Real Time Security Analytics
![Page 1: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/1.jpg)
SecurityAnaly.cs:Real-.mecapabili.esandthepathto‘MinorityReport’
BenjaminTan(A0120523Y)StephenDay(A0120684J)HuSong(A0027392E)YongHow(A0120654N)
MT5009:AnalysingHigh-TechFinalProjectPresenta;on
![Page 2: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/2.jpg)
TheStoryboard
SeSngtheScene(Introduc.on)• SubjectArea&Objec.vesforthePresenta.on• ProblemDefini.on–Real-.meRequirements
Wri.ngtheScript(TheResearchandMarket)• BigDataandAnaly.csMarkets• OverviewofthesecuritymarketforReal-.meSecurityAnaly.cs
OnSetwiththeActors(Today’sSolu.ons)• BigData&CloudThreatIntelligence• Sensorsandstreamingdataforsecurityapplica.ons
PreparingfortheSequel(FutureProjec.onsforTechnology)• AIandmoreintelligentsystemsthatdeliverprescrip.veac.ons• Sensorprolifera.onandnewendpoints
It’saWrap(Summary&Conclusions)
![Page 3: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/3.jpg)
Introduc.on:Technologies&EntrepreneurialOpportuni.es
• DataStreamingArchitectures• Analy.csAlgorithms&Insights• CloudInfrastructureandHyperscale
Compu.ng• Sensors(Video,Voice,Image,
Biological,Chemical,GPS)• Plaeorms(IoT,Drones,HetNets)• SecurityOpera.onsCentres• Prescrip.veAlertResponseteams
MarketFocus:Int’l&Domes.cSecurity&IntelligenceAgencies
![Page 4: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/4.jpg)
Situa.on:22ndMarch2016BrusselsAfacks
7:58am,Airportbomb
~9am,MetroSta.onbomb
3:00pm,surveillancevideo
discoveryofanewexplosivedevicecontainingnails
6:00pm
• Mismatched&SiloedIntelligencecollec.on
• Retrospec.veIntelligenceanalysis
• Dataisbeingcollectedbutstored• Notreal-.meandnoinsight
genera.on
![Page 5: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/5.jpg)
ProblemStatement:PriorIntelligenceFailed
Policeraidsaweekagohitoneoftheterroristsapartmentandkilledagunmanandcapturedonealive(SalahAbdeslam)linkedtoParisafack
“TheBelgiansecurityservices,aswellasotherWesternintelligenceagencies,hadadvanceandpreciseintelligencewarningsregardingtheterroristafacksinBelgiumonTuesday”-Haaretz
“U.S.intelligenceofficialssaytheyweren'tsurprisedthatBrusselswasafacked,becauseofconcernsaboutterrorthreats,par.cularlyaperrecentraidsandthearrestofParisafackssuspectSalahAbdeslamlastweekinBrussels”-CNN
“ThesourcessaidthatKhalidElBakraouiandBrahimElBakraouiwerebothonU.S.governmentcounterterrorismwatchlists”-Reuters
ElBakraoui,wasalreadycaughtinJune2015nearTurkey'sborderwithSyriaandaskedtobedeportedtotheNetherlands.
![Page 6: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/6.jpg)
Solu.onDefini.on:Real-.mePrescrip.veIntelligenceü Real-.meDatacollec.onü Real-.meDataprocessingü Real-.meThreatAnaly.csü Real-.mepredic.ve&prescrip.vealerts
Now Future
![Page 7: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/7.jpg)
ANALYTICSMARKET
![Page 8: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/8.jpg)
Analy.csMarket:UsageProfiles
Source:Forrester’sGlobalBusinessTechnographicsDataAnaly;csSurvey,2015and2014
![Page 9: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/9.jpg)
Analy.csMarket:Patent&VentureFundingSpeaks
Source:CiscoTechnologyRadar(2014)
![Page 10: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/10.jpg)
![Page 11: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/11.jpg)
Analy.csMarket:SecurityAnaly.csToday
In2012,businessintelligence,corporateperformancemanagement,andanaly.csapplica.onsandperformancemanagementsopwarewasworthUS$13.1billionworldwideSource:CiscoTechnologyRadar
Note:Thisdoesnotincludethe‘Black’spendingbyNSA,GCHQandotherIntelligenceagencies.
![Page 12: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/12.jpg)
Analy.csMarket:Analy.csMegaTrend
Source:IBM,Cisco,Frost&SullivanAnalysis
90%ofthedataintheworldhasbeencapturedinthelasttwoyearalone!
![Page 13: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/13.jpg)
Analy.csMarket:SecurityAnaly.csinFigures
Youcannotputa$$$onpeople’slivesandsafety
![Page 14: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/14.jpg)
ANALYTICSTECHNOLOGY&ARCHITECTURES
![Page 15: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/15.jpg)
TechnologyReadiness:BigDataAnaly.csintheHypeCurve
![Page 16: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/16.jpg)
DataArchitectures:TheStateoftheTechnologyToday
Source:ScaleOutSoLwareInc
![Page 17: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/17.jpg)
DataArchitectures:RealTimeandBatchProcessing
Source:CLOUDSECURITYALLIANCE–Bigdataanaly;csforsecurityintelligence
Real-.me(Spark&Beyond)X
![Page 18: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/18.jpg)
DataArchitectures:BigDataEcosystem(MassiveOpenSourced)
• OriginatedfromGoogle’sOpenSourceHadoopSystem• EvolvedintoApacheOpenSourceEcosystem• FuturewillbeHyperscale,HyperstreamingDatacoupledwithAI
![Page 19: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/19.jpg)
DataArchitectures:ComplexDataFlowManagement
• ApacheNifi(FormerlyNiagarafiles)isaDataFlowOrchestra.onTool• DonatedbyNSAinDec2014• Usedforprocessing‘ForeignIntelligence’• Lowlatency,highthroughput• User-friendlyGUIforsecurityoperatorsandanalysts• SupportsIoTinterac.vecommunica.on
![Page 20: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/20.jpg)
DataArchitectures:Real.me(Streaming)DataProcessing
• Real.mebigdatastreamingframework– Harnessesin-memoryandclustercompu.ng– Itera.veinnaturesolendsitselfwelltoMachineLearning
• Sparkperform3Xfasterusing10xfewermachinethanMapReduce(Databricksbenchmark).
StreamProcessinginmicrobatches
TrueStreamingprocessing
?2017 2020
![Page 21: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/21.jpg)
DataArchitectures:StreamingAnaly.cs
• StreamprocessingenableMachineLearningalgorithmsthat‘learn’incrementallyoverthedatainstreamingtoenablereal-.mepredic.on/scoringofthreats.
• Algorithms&UseCases(MachineandDeepLearning)Ø SupportVectorMachine-AnomalyDetec.onØ BaysianNetworks–AnomalyDetec.onØ NeuralNetworks–Imagerecogni.onandpredic.vecapabili.esØ ClusteringTechniques–Similarbehaviours/characteris.csØ NetworkGraphs–Affilia.onsandinforma.onflowsØ TextAnaly.cs–Keywords,sen.ments,categorisa.onofinforma.onØ TimeSeries–Predic.vebehaviourwithoutseasonalitytrends
![Page 22: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/22.jpg)
Analy.csAlgorithms&Insights:AdvancesinDeepLearning,Analy.cs&AI
Source:www.predic;veanaly;cstoday.com
Prescrip;veAnaly;cs
FuzzyTransi;on
ü Con.nuousqueriesonunstructuredandstructurestreamingdata
ü Generateac.onableeventtoallowimmediatecontrolandadvanceddecision
![Page 23: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/23.jpg)
Analy.csAlgorithms&Insights:Real-.meVisualisa.on&DynamicNetworkGraphs
• Machinelearningandalgorithmsgenerateintui.vevisualisa.ons
• Generatehotspotsoftraffic,connec.ongraphsandiden.fieskeythreatnodes
![Page 24: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/24.jpg)
CloudInfrastructure&HyperscaleDataCentresHyperscalecompu.ngandSopwareDefinedNetworkingarethe2maindrivingforcesofCloudInfrastructuregrowth
• IntelBroadwell22corechip• LenovoHXhyperscale
servers• Nutanixsopware
![Page 25: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/25.jpg)
SENSORS&DATACOLLECTION
![Page 26: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/26.jpg)
Sensors&DataCollec.on:SensorNumbers&Cost
Trajectoryisheadinginexactlytheright
direc.onfordisrup.vedeployment
![Page 27: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/27.jpg)
Sensors&DataCollec.on:SensorTechnologies&Types
![Page 28: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/28.jpg)
Sensors&DataCollec.on:VideoSensors+Analy.csNow
• Videoanaly;csareusingthelatestmodellingtodothefollowing:– FacialSurveillancetodetectknownsuspects– DwellandLoiteringTimetohighlightpoten.alerrantbehaviour– PeopleCountsforthroughputflowandcrowdcontrol– Demographicsforsurveillanceandprofiling
• BeTermechanical,op;calandelectronics– Sharperimageswithgrowinglevelofdetail– Sosmallthatitshardlyno.ceablewiththenakedeye
• Integra;onofprivateandpublicmonitoringcameras– Mul.-persontrackingcapabili.esanddynamicimageryanalysis– 3-Dimensionaltechniquestoiden.fyanindividualwithinamobon
themove– Videosarecollatedontothecloud– Nomoreindividualbutcollec.veanalysisofvideossimultaneously
![Page 29: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/29.jpg)
• AppearanceofevensmallerCMOSimagesensorarrays• Developmentofdistributedwirelesssensornetworks• DistributedprocessingofimagedataonaGPU• Analy.csprocessingdoneonthecameraandonlyrelevant
metadatasendbacktotheuser• Datafusionfrommul.pleimagesourcessentbacktouserfor
processingwithloca.onandtargetbasedmetadata• Efficiencyincommunica.onnetworkresources
Sensors&DataCollec.on:VideoSensors+Analy.csinDevelopment
![Page 30: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/30.jpg)
Sensors&DataCollec.on:VideoSensorCost&Performance
![Page 31: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/31.jpg)
Sensors&DataCollec.on:Predic.veBehavioralAnaly.cs
• Baseline:‘Normal’ac.vi.esobservedattheloca.on• Anomalies:Devia.onsfromthatnormthatrequirefurtherexplora.on
– Smartenoughtorecognizeworkdaysandotherrecurringpaferns– Onlypickupsta.s.calrari.esofindividualswithinthearea– Measureagainstthehistoricalpafernsofindividualsinthatarea
• Predic;ve:forecastbehaviourofindividualsbasedontheanalysisofmul.plepafernsofsimilarpastevents
• MetaDataAnnota;on:fully-automatedseman.c-taggingofsurveillancevideorecordingsbasedonmul.plehumanpresencedetec.onandabnormalac.vi.esrecogni.on
• EventDetec;on:automa.csor.ngofvideoandcommunica.onstodetectaggressivehumanbehaviour,publicareasinpar.cular
![Page 32: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/32.jpg)
Sensors&DataCollec.on:IOTandotherSensorProlifera.on
Environmental• Weather-HeatCanpredictcrimewaves• Wind–CyclonesandTyphoonscreatesecurityhazzards
Biological&Biometric• Agentdetec.on–SarinandAnthraxusedbyterrorists• Fingerprints,Odour,Perspira.on&DNA–Personaliden.fica.on
Chemical&Nuclear• Agentdetec.on–DirtyBombs,MustardandChlorineusedbyterrorists• Pollu.on-EnvironmentalandHealthhazards
Voice&Text• NLP&Seman.cSearch(Mul.-lingual)• Speechtotext,real-.metransla.on,voicestressanalysis
MobileSensors• Things(Drones,Cars,Buses,Planes…..)• People(Smartphones&WearableTech)
![Page 33: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/33.jpg)
SensorInfrastructure:HetNets(HeterogeneousNetworks)
• Mul.plewirelessfrequencies• Seamlessconnec.vityevery.meandeverywhere,indoorsandoutdoors• Benefits
– Efficient,PervasiveandHighQualityCoverageinUrbanareas– EnhancedResiliencyandSecurityforcri.calinfrastructureandsensors– Op.misedforsensorcommunica.onrequirements(Lowpower,highspeed,sleep
modes)
![Page 34: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/34.jpg)
ChallengesandEnablers:Deliveringthe‘MinorityReport’
Challenges• Developmentofnewframeworksfora
GlobalSecurityArchitecture• PeopleSkills&Trust• Communica.onvulnerabili.es• PersonalPrivacyRequirements• Cost$$$$$
Enablers• Cheap,fastmemory,storage,compute
andcloudinfrastructure• Network&Sensorubiquity• Streamingtherightdata&metadata• Cheapercloudbasedanaly.cs• Biometricsecuritymeasures
![Page 35: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/35.jpg)
FUTUREPROJECTIONS
![Page 36: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/36.jpg)
FutureProjec.ons:Prescrip.veAnaly.cs
• Ar.ficialIntelligence• Cogni.veLearningNetworks• AugmentedRealityAides• Predic.veGameTheory• Simula.on&ThreatModelling• DecisionRecommenda.on
Vs.
‘Pre-cogni.ves’ IBMWatson
![Page 37: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/37.jpg)
Conclusion&Summary
Requirement–Real.mePrescrip.veAlerts&ThreatIntelligence
Market–Spend,startupsandinvestmentisstrong
Technology–BigDataCloud,HetNet,Sensors,Analy.csetc
CostRed’n–Chips,Servers,Storage,Comms,Sensors,s/w
PerformanceDrivers-Chips,servers,storage,Comms,sensors,s/w
Sopwarealgorithms–Streaming,AR,AI,Text&Language,Recogni.on6
1
2
3
4
5
![Page 38: Real Time Security Analytics](https://reader030.vdocuments.us/reader030/viewer/2022021502/589efe6b1a28ab06368b5dc5/html5/thumbnails/38.jpg)
ThankYou