oracle nosql db & infinitegraph - trends in big data and graph technology

19
www.Objectivity.com Latest Trends in Big Data and Graph Database technologies Brian Clark, VP Product Management on August 16 th , 2012

Upload: infinitegraph

Post on 14-Jan-2015

1.025 views

Category:

Technology


4 download

DESCRIPTION

Join Oracle NoSQL DB and InfiniteGraph development teams in a discussion of the latest trends in Big Data and Graph Technology. Learn what Oracle’s view of Big Data is and how Oracle NoSQL Database technologies enable you to manage vast amounts of real-time key-value data.

TRANSCRIPT

Page 1: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

www.Objectivity.com

Latest Trends in Big

Data and Graph

Database technologies

Brian Clark, VP Product Management on August 16th, 2012

Page 2: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

Overview

• The Big Data Problem

• Current Big Data Analytics

• NoSQL Technologies

• Relationship Analytics

• InfiniteGraph and NoSQL DB

Page 3: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

The Big Data Problem

Page 4: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

The Big Data Problem

Information Overload!

Making sense of it all takes time and $$$

•Volume - vast amount of data

•Velocity - rate of input, rate of change

•Variety – structured, un-structured, semi-structured

•Value –analytics to gain understanding from the data and relationships

•Veracity – truth or meaning of the data and relationships

Page 5: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

A Typical “Big Data” Analytics Setup

Data Aggregation and Analytics Applications

Commodity Linux Platforms and/or High Performance Computing Clusters

Structured Semi-Structured Unstructured

Graph

DB

Object

DB Doc DB

K-V

Store Hadoop

Column

Store

Data

W/H RDBMS

Page 6: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

Incremental Improvements Aren’t Enough

All current solutions use the same basic architectural model • None of the current solutions have a way to store connections between

entities in different silos • Most analytic technology focuses on the content of the data nodes,

rather than the many kinds of connections between the nodes and the data in those connections

• Why? Because relational and most NoSQL solutions are bad at handling

relationships. • Object and Graph databases can efficiently store, manage and query the

many kinds of relationships hidden in the data.

Page 7: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

NoSQL Technologies

Page 8: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

• Users choose between four different primary technologies for different

purposes: – Key-Value Stores

– “Big Table” Clones

– Document Databases

– Object and Graph databases (including InfiniteGraph)

• Many implementations sacrifice consistency (ACID transactions, CAP

– eventual consistency) for performance.

• Technologies such as Objectivity/DB and InfiniteGraph offer ACID

transactions, with consistency and performance.

Not Only SQL – a group of 4 primary technologies

Page 9: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

The NoSQL Market

Page 10: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

Relationship Analytics

Page 11: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

Example 1 - Market Analysis The 10 companies that control a majority of U.S. consumer goods brands

Page 12: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

Example 2 - Demographics Used in social network analysis, marketing, medical research etc.

Page 13: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

Example 3 - Seed To Consumer Tracking

?

Page 14: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

Example 4 - Ad Placement Networks

Smartphone Ad placement - based on the the user’s profile and location data

captured by opt-in applications. • The location data can be stored and distilled in a key-value and column store

hybrid database, such as Cassandra • The locations are matched with geospatial data to deduce user interests. • As Ad placement orders arrive, an application built on a graph database such

as InfiniteGraph, matches groups of users with Ads: • Maximizes relevance for the user. • Yields maximum value for the advertiser and the placer.

Page 15: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

Example 5 - Healthcare Informatics

Problem: Physicians need better electronic records for managing patient data on a global

basis and match symptoms, causes, treatments and interdependencies to improve

diagnoses and outcomes. • Solution: Create a database capable of leveraging existing architecture using NOSQL tools

such as Objectivity/DB and InfiniteGraph that can handle data capture, symptoms, diagnoses, treatments, reactions to medications, interactions and progress.

• Result: It works: • Diagnosis is faster and more accurate • The knowledge base tracks similar medical cases. • Treatment success rates have improved.

Page 16: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

The Polyglot Approach

Page 17: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

SUMMARY: A Polyglot Approach Works Best...

PROBLEM

LANGUAGE REPOSITORY

ANALYTICS

GRAPH TOOLS BI TOOLS VISUAL ANALYTICS

Page 18: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

...SUMMARY: A Polyglot Approach Works Best

Page 19: Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology

InfiniteGraph

The Big Data Connection Platform