Upload File

accelerating innovation with spark-(beth smith, ibm)

11
Beth Smith @BethTSmith General Manager, IBM Analytics Platform

Upload: spark-summit

Post on 12-Aug-2015

1.098 views

Category:

Data & Analytics


0 download

Report

TRANSCRIPT

Page 1: Accelerating Innovation with Spark-(Beth Smith, IBM)

Beth Smith @BethTSmith

General Manager, IBM Analytics Platform

Page 2: Accelerating Innovation with Spark-(Beth Smith, IBM)

100 innovations. 10 days.

Page 3: Accelerating Innovation with Spark-(Beth Smith, IBM)

IBM Spark

90% Passenger predictions

Optimized time tables & routes

Light Rail Forecasting

Page 4: Accelerating Innovation with Spark-(Beth Smith, IBM)

IBM Spark

Single genome is 200GB

1M People per year tested

Human Genome

Page 5: Accelerating Innovation with Spark-(Beth Smith, IBM)

IBM Spark

Innovating in Healthcare

Page 6: Accelerating Innovation with Spark-(Beth Smith, IBM)

IBM Spark

Innovating in Space Exploration

Page 7: Accelerating Innovation with Spark-(Beth Smith, IBM)

IBM Spark

the Analytics operating system

Page 8: Accelerating Innovation with Spark-(Beth Smith, IBM)

IBM Spark

Technology. Skills. Community.

Page 9: Accelerating Innovation with Spark-(Beth Smith, IBM)

IBM Spark

Open Source SystemML Educate One Million Establish Spark Technology Center

Page 10: Accelerating Innovation with Spark-(Beth Smith, IBM)

IBM SPARK

Page 11: Accelerating Innovation with Spark-(Beth Smith, IBM)

You are invited! Spark Community Event, 7:00 pm at Galvanize

Register now: http://sparkinsight.eventbrite.com/


BETH ARARUNA BETH ARARUNA

Accelerating Spark Workloads in a Mesos Environment with Alluxio

Spark & Spark SQL

Spark, spark streaming & tachyon

Accelerating Spark with RDMA for Big Data Processing ... · RDMA for Spark applications on modern HPC clusters? – Can RDMA-based design benefit applications transparently? 12

Pedal to the Metal: Accelerating Spark with Silicon Innovation

Accelerating Machine Learning Applications on Spark Using GPUs

HPC Meets Big Data: Accelerating Hadoop, Spark, and ... Meets Big Data: Accelerating Hadoop, Spark, and Memcached with HPC Technologies Dhabaleswar K. (DK) Panda The Ohio State University

Temple Beth O'r Beth TorahTemple Beth O'r Beth Torah ......2019/07/02  · Temple Beth O’r Beth Torah If you have any questions, please call Howard Silverman, Fern Cammy or Cantor

Accelerating Spark Workloads in an Apache Mesos Environment with Alluxio

HPC Meets BigData: Accelerating Apache Hadoop, Spark, and ... · HPC Meets BigData: Accelerating Apache Hadoop, Spark, and Memcached with HPC Technologies Dhabaleswar K. (DK) Panda

2013 Teacher Academy Presentation by Beth Randolph And Jennifer Spark

High Performance Big Data (HiBD): Accelerating Hadoop, Spark and Memcached …hibd.cse.ohio-state.edu/static/media/talks/slide/dk_day2... · 2017. 7. 18. · middleware (e.g. Hadoop,

High Performance Big Data (HiBD): Accelerating Hadoop ...hibd.cse.ohio-state.edu/static/media/talks/slide/... · High Performance Big Data (HiBD): Accelerating Hadoop, Spark and Memcached

Spark SQL and DataFrames Spark GraphX Spark Mlib Spark ...Spark GraphX! Spark Mlib! Spark Streaming Lightning-fast cluster computing. Chaining transformations 2. ... Covert RDD to

Oracle GraalVM Enterprise Edition Technical Brief · Apache Spark on GraalVM Enterprise 7 Accelerating WebLogic Applications 8 The Ideal Microservices Runtime 9 Microservice Startup,

Accelerating Shuffle: A Tailor-Made RDMA Solution for Apache Spark with Yuval Degani

Accelerating and Scaling R Analytics Using Spark R, In ...files.meetup.com/9505222/Scaling with R Meetup v0.3.pdf · 4. Spark (SparkR) provides another means of scaling R –Can use

Adaptively Accelerating Map-Reduce/Spark with GPUs: A Case ...anshul/icac19_gpu.pdf · We present a case study where we accelerate four iterative machine learning applications –

Accelerating apache spark with rdma

Accelerating Real-time Analytics with Spark 10082015€¦ · 1 ©2015 Talend Inc Accelera’ng*Real,Time*Analy’cs** with*Spark October(8,(2015

Accelerating Spark Workloads using GPUson-demand.gputechconf.com/gtc/...rajesh-bordawekar-accelerating-s… · Accelerating Spark Workloads using GPUs Rajesh Bordawekar, Minsik Cho,

Accelerating Cross-Validation in Spark Using GPU · Apache Spark Overview 4 In-memory engine for large-scale distributed data processing –Used in database, streaming, machine/deep

Accelerating Spark with RDMA for Big Data Processing: Early

Beth Doyle, VivaKi and Kristin Haarlow, Spark | The Future of Multiscreen Video Advertising

Apache Ignite and Apache Spark - GridGain Systems · Ignite and Spark Integration Spark Application Spark Worker Spark Job Spark Job Yarn Mesos Docker HDFS Spark Worker Spark Job

Accelerating Apache Spark-based Analytics on Intel Architecture-(Michael Greene, Intel)

Accelerating Big Data Processing with Hadoop, Spark and ...€¦ · (Cluster Resource Management & Data Processing) (Cluster Resource Management & Job Scheduling) Hadoop Common/Core

Accelerating Hadoop, Spark, and Memcached with HPC Technologies

Adaptively Accelerating Map-Reduce/Spark with GPUs: A Case Study · 2020-02-17 · Adaptively Accelerating Map-Reduce/Spark with GPUs: A Case Study K. R. Jayaram IBM Research Yorktown

Nitin Mathur - Accelerating innovation with Spark and Hadoop – Harnessing the convergence of data and analytics

Accelerating Image Recognition Processing Using Tiered ......Accelerating Image Recognition Processing Using Tiered Storage and Spark Isom Crawford Jr., Ph.D., IBM David Chen, Ph.D.,

JVM and OS Tuning for accelerating Spark application

Accelerating Cross-Validation in Spark Using GPUon-demand.gputechconf.com/gtc/2017/presentation/s7117...Apache Spark Overview 4 In-memory engine for large-scale distributed data processing

Accelerating Apache Arrow and - RainFocus€¦ · projects like – Hbase, Impala, Kudu, Parquet, Phoenix, Spark, Storm etc. •Fast - Take Advantage of SIMD operations with better