flightcaster_hug
DESCRIPTION
Flightcaster and HadoopHadoop Bay Area User Group, March 24TRANSCRIPT
![Page 1: Flightcaster_HUG](https://reader035.vdocuments.us/reader035/viewer/2022062511/54ba79924a795938568b465d/html5/thumbnails/1.jpg)
![Page 2: Flightcaster_HUG](https://reader035.vdocuments.us/reader035/viewer/2022062511/54ba79924a795938568b465d/html5/thumbnails/2.jpg)
![Page 3: Flightcaster_HUG](https://reader035.vdocuments.us/reader035/viewer/2022062511/54ba79924a795938568b465d/html5/thumbnails/3.jpg)
75% of major delays
less than 30 min. before departure
![Page 4: Flightcaster_HUG](https://reader035.vdocuments.us/reader035/viewer/2022062511/54ba79924a795938568b465d/html5/thumbnails/4.jpg)
![Page 5: Flightcaster_HUG](https://reader035.vdocuments.us/reader035/viewer/2022062511/54ba79924a795938568b465d/html5/thumbnails/5.jpg)
![Page 6: Flightcaster_HUG](https://reader035.vdocuments.us/reader035/viewer/2022062511/54ba79924a795938568b465d/html5/thumbnails/6.jpg)
hadoopcascading -> clojure
infer cascading-clojurecrane
Open Source
![Page 7: Flightcaster_HUG](https://reader035.vdocuments.us/reader035/viewer/2022062511/54ba79924a795938568b465d/html5/thumbnails/7.jpg)
![Page 8: Flightcaster_HUG](https://reader035.vdocuments.us/reader035/viewer/2022062511/54ba79924a795938568b465d/html5/thumbnails/8.jpg)
![Page 9: Flightcaster_HUG](https://reader035.vdocuments.us/reader035/viewer/2022062511/54ba79924a795938568b465d/html5/thumbnails/9.jpg)
Discrete Event Simulation?
Fuzzy Join with funky predicate?
![Page 10: Flightcaster_HUG](https://reader035.vdocuments.us/reader035/viewer/2022062511/54ba79924a795938568b465d/html5/thumbnails/10.jpg)
group-by with secondary sort.
accumulator to simulate a discrete event simultor.
![Page 11: Flightcaster_HUG](https://reader035.vdocuments.us/reader035/viewer/2022062511/54ba79924a795938568b465d/html5/thumbnails/11.jpg)
![Page 12: Flightcaster_HUG](https://reader035.vdocuments.us/reader035/viewer/2022062511/54ba79924a795938568b465d/html5/thumbnails/12.jpg)
cascading-clojure: motivation
FP
dev
deploy
![Page 13: Flightcaster_HUG](https://reader035.vdocuments.us/reader035/viewer/2022062511/54ba79924a795938568b465d/html5/thumbnails/13.jpg)
cascading-clojure: lessons learned
planner
serialization
data structures for wide data
![Page 14: Flightcaster_HUG](https://reader035.vdocuments.us/reader035/viewer/2022062511/54ba79924a795938568b465d/html5/thumbnails/14.jpg)
cascading-clojure: future direction
functions + data structures
abstractions for planner and M/R
![Page 15: Flightcaster_HUG](https://reader035.vdocuments.us/reader035/viewer/2022062511/54ba79924a795938568b465d/html5/thumbnails/15.jpg)