7 fun things to do with mapreduce chris hillman – teradata data
Post on 08-Jan-2018
217 Views
Preview:
DESCRIPTION
TRANSCRIPT
7 Fun Things to do with MapReduce
Chris Hillman – Teradata Data Scientist Christopher.hillman@teradata.com@chillax7
AgendaMap Tasks
Face DetectionCharacter RecognitionSpeech to Text
ShufflingMass Spectrometer processing
ReducersText MiningActual Mining
Cluster Building
Face Detection in ImagesStepStep 1.
Get a good Open Source Library
Step 2.Check the
Example Code
@chillax7
Character RecognitionStepMore Complex Task
than Face DetectionSELECT * FROM RecognizeNumberPlate( ON anpr.vehiclelogs imagecol('recognizedobject'));
@chillax7
Speech to TextStep
Fed up with word count examples?
How about counting words in a recorded wav
file?@chillax7
ProteomicsStepMass Spectrometers
Create a lot of data….In XML format….It’s nasty to work with
@chillax7
Text MiningStepFirst phases are map
tasksText Extraction andParsing
@chillax7
Actual MiningStepComparing Seismic
surveys taken at different points in time??
@chillax7
Cluster BuildingStepWhy Build your own
cluster?• It’s fun• You learn lots• It gets you invited
to parties
Physical or Virtual?
Physical – more fun, looks
impressive, harder to build,
maintain, use, cost of power
Virtual – performance? Easier
to test, try different versions,
configurations@chillax7
Thank youChris HillmanChristopher.hillman@teradata.com@chillax7www.bigdatablog.co.uk
=+ +
top related