islands of node in a sea of big data
TRANSCRIPT
Islands of node in a sea of Big Data
Glenn Block
Splunk Dev Platform
CC Image Carlota and Isabel Islands by Storm Crypt Flickr
About me
3
Glenn Block
4
5
Glenn Block
What is Splunk?Any Machine Data
HA Indexes and Storage
Search and Investigation
Proactive Monitoring
Operational Visibility
Real-time Business Insights
CommodityServers
Online Services Web
Services
ServersSecurity GPS
Location
StorageDesktops
Networks
Packaged Applications
CustomApplicationsMessaging
TelecomsOnline
Shopping Cart
Web Clickstreams
Databases
Energy Meters
Call Detail Records
Smartphones and Devices
RFID
7
node in the box
Let's generate some PDFs
9
How we do it
10
node
JSONJSON
pdfchartjsdom
Why node?
11
• We needed an easy way to convert a web page into PDF
Node has modules for rendering web pages on the server (JSDOM)
Node has modules for PDF generation (PDFKIT)
12
13
14
15
Why node?
16
We needed a mobile-friendly façade for our non-mobile friendly API
The server is heavily IO bound / async, which node is perfect for.
It is easy and lightweight to spin up API servers and proxies in node. Great support for Auth as well.
17
node for integration and extensiblity
18
Log directly to Splunk via TCP,
UDP, HTTP
Integrate search results with other applications using
custom visualizations
Create and run searches from
other applications
Splunk SDK
19
VisualizeSearch Manage
Add/Delete Users
Manage Inputs
Index
node inputs
20
Public APIs DevicesOS levelInternal Systems
Generating test data
Input
Ingesting data with Socket.IO
21
Why node?
22
Inputs by their nature are heavily IO bound and async
Inputs are streaming results back to Splunk and node has great support in the box for streams.
It has a great ecosystem of modules
It’s JavaScript!
23
browserify
requirejsjsdom
pdfkit
htmlparser
koa
mocha
grunt
express
node-http-proxy
jshint
Where to go for More Info
• Tutorials, Code Samples, Getting Started, Downloads– http://dev.splunk.com/javascript– https://github.com/glennblock/splunk-socket.io
• Support– https://www.splunk.com/page/submit_issue
• GitHub– https://github.com/splunk/splunk-sdk-javascript
• Twitter– https://twitter.com/splunkdev or follow me:
https://twitter.com/gblock
• Blog– http://blogs.splunk.com/dev/
24
Thank You!