intergalactic data speak_highload++_20131028

Intergalactic Dataspeak

Highload++ 2013/10/28Copyright© 2013David Fetter david.fetter@disqus.comAll rights reserved.

SQL Everywhere!

Virtual Table Interface

Virtual Index Interface

SQL/MED

<DIGRESSION>

EXTENSIONS!

</DIGRESSION>

<PAST>

SQL/MED in PostgreSQL

contrib/dblink

SQL/MED in PostgreSQL

DBI-Link

Time Passes...

PostgreSQL 8.4

Infrastructure Only

PostgreSQL 9.0

More Infrastructure

PostgreSQL 9.2

ReadsANALYZE

</PAST>

<PRESENT>

A Disqus Hour

•50 GB raw log data

•30 GB event data

•100 million embed loads

•...last week.

PostgreSQL 9.3

WRITES!

Wrappers. Lots of Wrappers.

<SQL>

Oracle

MySQL

ODBC

</SQL>

<NoSQL>

CouchDB

Redis

</NoSQL>

<File>

file

file_text_array

</File>

<Creativity>

Twitter

LDAP

S3

</Creativity

>

More!

PGXN

Multicorn

<New_Commands>

{CREATE | ALTER | DROP}

FOREIGN DATA WRAPPER

{CREATE | ALTER | DROP}SERVER

{CREATE | ALTER | DROP}

USER MAPPING

</New_Commands>

<INTROSPECTION>

Remote Partitioning

• Expose information_schema.columns.

• Create view over them.• Create foreign table generator.

</INTROSPECTION>

</PRESENT>

<FUTURE>

<INTROSPECTION>

CREATE FOREIGN TABLE (…LIKE...)

More and better.

</INTROSPECTION>

Full SQL/MED Compliance

The ever-interesting: Stuff I Never Thought Of

</FUTURE>

Большое спасибо!

Highload++ 2013/10/28Copyright© 2013David Fetter david.fetter@disqus.comAll rights reserved.