building personalized applications with hbase
DESCRIPTION
TRANSCRIPT
![Page 1: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/1.jpg)
![Page 2: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/2.jpg)
Developed By:
: Building Personalized Applications with HBase
Odiago, Inc.
Aaron Kimball – CTO
Garrett Wu – Director of Engineering
![Page 3: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/3.jpg)
Developed By:
helps you…
![Page 4: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/4.jpg)
Developed By:
Who uses WibiData?
Easy Integration with Existing Analysis / BI Tools
Backend Infrastructure for Web and Mobile Apps
[engineer] [analyst]
[data scientist] part engineer, part analyst
Powerful Libraries for Data Mining Applications
![Page 5: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/5.jpg)
Developed By:
WibiData applies to…
![Page 6: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/6.jpg)
Developed By:
Example App: Mobile
![Page 7: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/7.jpg)
Developed By:
![Page 8: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/8.jpg)
Developed By:
![Page 9: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/9.jpg)
Developed By:
Libraries Device and User Analysis
Workflow and Data Integration
Reporting
Personalized Recommendations
Analysis
![Page 10: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/10.jpg)
Developed By:
www.fonedoktor.com Get FoneDoktor for your Android today!
![Page 11: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/11.jpg)
Developed By:
The rest of this talk…
• Wibi architecture at a glance
• Under the hood
• Integrating with external systems
• Conclusions
![Page 12: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/12.jpg)
Developed By:
architecture
Certified Technology product
![Page 13: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/13.jpg)
Developed By:
Machine learning building blocks
• Production-quality algorithms included in Wibi
– Recommendation
– Classification
– Clustering…
• Helps data teams get started more quickly
• Lowers end-user requirements
![Page 14: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/14.jpg)
Developed By:
WibiData: Technical Dive Garrett Wu, Director of Engineering
![Page 15: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/15.jpg)
Developed By:
An extended data model
• Column families are a logical concept
• Data is physically arranged in locality groups
![Page 16: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/16.jpg)
Developed By:
An extended data model
• Wibi uses 3-d storage
• Data is often sorted by timestamp
![Page 17: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/17.jpg)
Developed By:
An extended data model
• Columns or whole families have common Avro schemas for evolvable storage and retrieval
<column>
<name>email</name>
<description>Email address</description>
<schema>"string"</schema>
</column>
![Page 18: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/18.jpg)
Developed By:
Producers and gatherers
• Producers create derived column values
• Gatherers aggregate data across all rows
– e.g., for classifier training
![Page 19: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/19.jpg)
Developed By:
Interactive access: REST API
• REST API provides interactive access
• Producers can be triggered “on demand” to create fresh recommendations
GET request PUT request
![Page 20: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/20.jpg)
Developed By:
Tools and Integration
![Page 21: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/21.jpg)
Developed By:
Tools for all users
![Page 22: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/22.jpg)
Developed By:
Data integration:
![Page 23: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/23.jpg)
Developed By:
Data integration:
![Page 24: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/24.jpg)
Developed By:
Self-service analyst workflow
Existing databases
![Page 25: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/25.jpg)
Developed By:
Conclusions
• WibiData is a new platform for user data management and analysis
• The WibiData programming model enables rapid application development
• …and its libraries lower the barrier to entry
• Wibi UI and export tools integrate with existing analytic systems
![Page 26: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/26.jpg)
Developed By:
We have some great customers…
![Page 27: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/27.jpg)
Developed By:
And we’d like you to join us!
• Sign up for the private beta today:
www.wibidata.com
• If you have a compelling use case, we’d like to let you try WibiData
![Page 28: Building Personalized Applications with HBase](https://reader034.vdocuments.us/reader034/viewer/2022051513/547cbfe8b379596a2b8b5100/html5/thumbnails/28.jpg)
Developed By:
www.wibidata.com / @wibidata Aaron Kimball – [email protected]
Garrett Wu – [email protected]