![Page 1: Concepts and Technologies for Distributed …stg-tud.github.io/ctbd/2017/CTBD_01_organization.pdfConcepts and Technologies for Distributed Systems and Big Data Processing •Provide](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d32e3aef5172d390eeb55/html5/thumbnails/1.jpg)
ConceptsandTechnologiesforDistributedSystemsand
BigDataProcessingGuidoSalvaneschi
1
![Page 2: Concepts and Technologies for Distributed …stg-tud.github.io/ctbd/2017/CTBD_01_organization.pdfConcepts and Technologies for Distributed Systems and Big Data Processing •Provide](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d32e3aef5172d390eeb55/html5/thumbnails/2.jpg)
People
GuidoSalvaneschi
PascalWeisenburgerMatthiasEichholz
2
![Page 3: Concepts and Technologies for Distributed …stg-tud.github.io/ctbd/2017/CTBD_01_organization.pdfConcepts and Technologies for Distributed Systems and Big Data Processing •Provide](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d32e3aef5172d390eeb55/html5/thumbnails/3.jpg)
Motivation
• Distributedsystemsareubiquitous• Emails,WWW,…
• Areaisquicklychanging- sorryforthebuzzwords:)• Bigdataanalytics• Complexeventprocessing/streamprocessing• Cloudcomputing• Newprogrammingmodels(streams,actors)• ...
• Yet,manyconceptsremainthesame• Abstractionoverlow-leveldetails• Faulttolerance• Performance:throughput,latency• Asynchonouscommunication• ...
3
![Page 4: Concepts and Technologies for Distributed …stg-tud.github.io/ctbd/2017/CTBD_01_organization.pdfConcepts and Technologies for Distributed Systems and Big Data Processing •Provide](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d32e3aef5172d390eeb55/html5/thumbnails/4.jpg)
ConceptsandTechnologiesforDistributedSystemsandBigDataProcessing
• ProvideanoverviewofrecentdevelopmentindistributedsystemsandBigDataprocessing
• Focusonconcepts,notontechnology.• Technologywasdifferent5yearsago,willbedifferentin5years• Wewilllookattechnologyonlyasawaytobettergrasptheconcepts
• Selectedtopics• Differenttopics,selectedamongthe“mostinteresting”ones• Guestlectures
4
![Page 5: Concepts and Technologies for Distributed …stg-tud.github.io/ctbd/2017/CTBD_01_organization.pdfConcepts and Technologies for Distributed Systems and Big Data Processing •Provide](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d32e3aef5172d390eeb55/html5/thumbnails/5.jpg)
Aboutthiscourse
WhatthiscourseIS• Anintroductiononselected topics• …ondistributedsystemsandbigdataprocessing• Acourseaboutconcepts…andabitabouttechnologies
WhatitisNOT• Itisnot(only)acourseaboutrecenttrendsinBigData.• Itisnotasystematic courseondistributedsystems
• DistributedSystems:PrinciplesandParadigmsAndrewS.Tanenbaum,MaartenvanSteen
• Itisnotatutorial onhowtoprogrambigdatasystems
5
![Page 6: Concepts and Technologies for Distributed …stg-tud.github.io/ctbd/2017/CTBD_01_organization.pdfConcepts and Technologies for Distributed Systems and Big Data Processing •Provide](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d32e3aef5172d390eeb55/html5/thumbnails/6.jpg)
April21- Intro,motivationApril28- Introtobigdata,mapreduceMay5- hadoop,hdfsMay12- Futures,actors,streamsMay19- Futures,actors,streamsMay26- ComplexEventProcessingJune2- SparkJune9- SparkstreamingJune16- Exampreparation…
JulyTBA- Exam
Tentativecourseschedule
Bigdataandcomplexeventprocessing
Architecturesandprogrammingmodelsfordistr.systems
Subjecttochange!Seecoursewebsiteforupdates
6
![Page 7: Concepts and Technologies for Distributed …stg-tud.github.io/ctbd/2017/CTBD_01_organization.pdfConcepts and Technologies for Distributed Systems and Big Data Processing •Provide](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d32e3aef5172d390eeb55/html5/thumbnails/7.jpg)
Exercises
• Nogradedexercises• Exerciseswillbeprovidedaftersomelectures.• Solutionsdiscussedinthenextlectureifneeded
• Why• Getmoreconfidentonthetopicsofthelectures• Getafeelingthetypeofquestionsthatcancomeupintheexam
• Examples• Readapaper• Answerquestionsbasedonthecontentofthelecture• Discussacasestudy• Smallcodingexercises
7
![Page 8: Concepts and Technologies for Distributed …stg-tud.github.io/ctbd/2017/CTBD_01_organization.pdfConcepts and Technologies for Distributed Systems and Big Data Processing •Provide](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d32e3aef5172d390eeb55/html5/thumbnails/8.jpg)
RegistrationandGrading
• RegisterinTucan forthecourse!
• Writtenexam– July,dateTBA• 90mins
• Questionsaboutthetopicscoveredinthelectures• Simple“programming”tasks• Understandacodesnippetthatisrelevantforoneofthecoveredtopics• Completeacodesnippet
8
![Page 9: Concepts and Technologies for Distributed …stg-tud.github.io/ctbd/2017/CTBD_01_organization.pdfConcepts and Technologies for Distributed Systems and Big Data Processing •Provide](https://reader034.vdocuments.us/reader034/viewer/2022042112/5e8d32e3aef5172d390eeb55/html5/thumbnails/9.jpg)
Resources
• Website(slides,exercises)• http://stg-tud.github.io/ctbd/• Thisistheofficialplaceslides,exercises,updatedschedule,etc.
• Forum• https://www.fachschaft.informatik.tu-darmstadt.de/forum/viewforum.php?f=580• Pleaseusetheforumforyourquestions.Answerswillremainasareferenceforotherpeople.
• Pleaseaskassistantsforquestionsthatcannotbepostedontheforum• Butthinkifthisisreallythecase:)
9