frederic lavigne and stephen fink - serverless video processing with ibm bluemix openwhisk

Frédéric (Fred)LavigneBluemixDeveloperAdvocate@L2FProd

DarkVisionvideoprocessing

ServerlessConfMay 26 & 27, 2016

withIBMBluemixOpenWhisk

PleaseNote• IBM’sstatementsregardingitsplans, directions, andintentaresubjecttochangeorwithdrawalwithoutnoticeatIBM’ssolediscretion.

• Informationregardingpotentialfutureproducts isintendedtooutlineourgeneralproductdirectionanditshould notberelied oninmakingapurchasingdecision.

• Theinformationmentionedregardingpotentialfutureproductsisnotacommitment,promise, orlegalobligationtodeliveranymaterial,codeorfunctionality. Informationaboutpotentialfutureproductsmaynotbeincorporatedintoanycontract.

• Thedevelopment, release,andtimingofanyfuturefeaturesorfunctionality described forourproductsremainsatoursolediscretion.

• Performanceisbasedonmeasurementsandprojections usingstandardIBMbenchmarks inacontrolledenvironment.Theactualthroughputorperformancethatanyuserwillexperiencewillvarydepending uponmanyfactors,including considerations suchastheamountofmultiprogrammingintheuser’s jobstream,theI/Oconfiguration,thestorageconfiguration, andtheworkloadprocessed.Therefore,noassurancecanbegiventhatanindividual userwillachieveresults similartothosestatedhere.

2

Videowillaccountfor80to90%ofallconsumer Internettrafficby2019

2.5quintillionbytesofdataeveryday

400hoursofvideouploadedeveryminute

Whatalargeamountofdatatoanalyze!

Places,products,objects, faces,people, texts

GuyFieri

Boat

MoulinRouge

Nivea

Usethedatatoimprovesearch,navigation, recommendation, brandresonance

Improvesearchresults

Betternavigation

Makerecommendations

Detectbrands

Agood fitforaserverlessarchitecture

Scalewiththenumberofvideos

Runasynchronously

Severalindependentactions

DarkVision isanapplicationtodiscoverthesedata.Let’sseeitinaction.

DEMO

Usingthedatawediscovered,wecandeliveranimproveduserexperience.

Adeeperlookattheresults.

Moreresultsforothervideos.

ImageAnalysis

BuiltwithIBMBluemix,OpenWhisk,Watson

PUBLIC NETWORK CLOUD NETWORK

OPENWHISK

REST APIMOBILEAPP STORAGE

VideoExtractor

Whathappened:extractingFrameswithaDockeraction

OPENWHISK

REST APIMOBILEAPP STORAGE

VideoExtractor

ImageFrames

1 2

3

4

5

DockerimagestoredonDockerHub

Extractorusesffmpeg, ImageMagick

Whathappened:analyzingframeswithaJavaScriptaction

ImageAnalysis

OPENWHISK

STORAGE

ImageFrame

Watson Visual Recognitionand Alchemy Vision API

12

3

4

5

ImageanalysisusedImageMagick,WatsonVisualRecognitionandAlchemyVision

NewVideoRule

VideoExtractor ImageAnalysis

OpenWhiskartifactsusedbyDarkVision

TR

STORAGE

A

NewVideoTrigger NewImageTrigger

NewImageRuleule

ction

rigger

Contributions welcometoperformaudioanalysis(speechtotext,toneandsentimentanalysis)

Getthecode

https://github.com/IBM-Bluemix/openwhisk-darkvisionapp

TryOpenWhisk

IBMBluemixOpenWhiskofferinghttps://new-console.ng.bluemix.net/openwhisk/

OpenWhiskopensourceprojecthttps://github.com/openwhisk/openwhisk

Variationonthesametheme,Drones!

NoticesandDisclaimers• Copyright ©2016byInternational BusinessMachinesCorporation (IBM).Nopart ofthisdocument maybereproduced ortransmitted inanyformwithout written permissionfromIBM.

• U.S.GovernmentUsersRestrictedRights- Use,duplication ordisclosure restrictedbyGSAADPSchedule Contractwith IBM.

• Information inthesepresentations (including information relatingtoproducts thathavenotyetbeenannounced byIBM)hasbeen reviewedforaccuracyasofthedateofinitial publication andcould includeunintentional technical ortypographical errors.IBMshallhavenoresponsibility toupdatethisinformation. THIS DOCUMENTISDISTRIBUTED"ASIS"WITHOUTANYWARRANTY,EITHEREXPRESSORIMPLIED.INNOEVENTSHALLIBMBELIABLEFORANYDAMAGEARISINGFROMTHEUSEOFTHISINFORMATION,INCLUDINGBUTNOTLIMITEDTO,LOSSOFDATA,BUSINESSINTERRUPTION,LOSSOFPROFITORLOSSOFOPPORTUNITY.IBMproductsandservicesarewarranted according tothetermsandconditions oftheagreementsunder whichtheyareprovided.

• Anystatements regardingIBM'sfuturedirection, intent orproduct plansaresubjecttochangeorwithdrawal without notice.

• Performance datacontained herein wasgenerallyobtained inacontrolled, isolatedenvironments.Customer examplesarepresented asillustrations ofhowthosecustomershaveusedIBMproducts andtheresultstheymayhaveachieved.Actualperformance, cost, savingsorother resultsinother operatingenvironments mayvary.

• References inthisdocument toIBMproducts, programs,orservicesdoesnotimplythatIBMintendstomakesuchproducts, programsorservicesavailableinallcountries inwhichIBMoperatesordoesbusiness.

• Workshops,sessionsandassociatedmaterialsmayhavebeenprepared byindependent sessionspeakers,anddonotnecessarilyreflecttheviewsofIBM.Allmaterialsanddiscussions areprovided forinformational purposesonly,andareneither intended to, norshallconstitute legalorother guidanceoradvice to anyindividualparticipant ortheirspecific situation.

• Itisthecustomerʼs responsibility toinsure itsowncompliance withlegalrequirements andtoobtain adviceofcompetent legalcounselastothe identification andinterpretation ofanyrelevantlawsandregulatoryrequirements thatmayaffectthecustomerʼsbusinessandanyactionsthecustomer mayneedtotaketocomplywithsuchlaws.IBM doesnotprovidelegaladviceorrepresent orwarrant thatitsservicesorproducts willensurethatthecustomer isincompliance withanylaw

NoticesandDisclaimersCon’t.

• Informationconcerningnon-IBMproductswasobtainedfromthesuppliersofthoseproducts,theirpublishedannouncements orotherpubliclyavailablesources.IBMhasnottestedthoseproducts inconnectionwiththispublicationandcannotconfirmtheaccuracyofperformance,compatibilityoranyotherclaimsrelatedtonon-IBMproducts. Questionsonthecapabilitiesofnon-IBMproductsshouldbeaddressedtothesuppliersofthoseproducts. IBMdoesnotwarrantthequalityofanythird-partyproducts,ortheabilityofanysuchthird-partyproductstointeroperatewithIBMʼsproducts. IBMEXPRESSLYDISCLAIMSALLWARRANTIES,EXPRESSEDORIMPLIED,INCLUDINGBUTNOTLIMITEDTO,THEIMPLIEDWARRANTIESOFMERCHANTABILITYANDFITNESSFORAPARTICULARPURPOSE.

• Theprovisionofthe informationcontainedherein isnotintendedto,anddoesnot,grantanyrightorlicenseunderanyIBMpatents,copyrights,trademarksorotherintellectualpropertyright.

• IBM,theIBMlogo,ibm.com,Aspera®,Bluemix,Blueworks Live,CICS,Clearcase,Cognos®,DOORS®,Emptoris®,EnterpriseDocumentManagementSystem™,FASP®,FileNet®,GlobalBusinessServices®,GlobalTechnologyServices®,IBMExperienceOne™,IBMSmartCloud®,IBMSocialBusiness®, InformationonDemand,ILOG,Maximo®,MQIntegrator®,MQSeries®,Netcool®,OMEGAMON,OpenPower,PureAnalytics™,PureApplication®,pureCluster™,PureCoverage®,PureData®,PureExperience®,PureFlex®,pureQuery®,pureScale®,PureSystems®,QRadar®,Rational®,Rhapsody®,SmarterCommerce®,SoDA,SPSS,SterlingCommerce®,StoredIQ,Tealeaf®,Tivoli®,Trusteer®,Unica®,urban{code}®,Watson,WebSphere®,Worklight®,X-Force®andSystemz®Z/OS,aretrademarksofInternationalBusinessMachinesCorporation,registeredinmanyjurisdictionsworldwide.OtherproductandservicenamesmightbetrademarksofIBMorothercompanies.AcurrentlistofIBMtrademarksisavailableontheWebat"Copyrightandtrademarkinformation"at:www.ibm.com/legal/copytrade.shtml.