big data analytics & cloud services - … data analytics & cloud services . ... • aws...
TRANSCRIPT
TechMileage Confidential – Not for Distribution
BIG DATA ANALYTICS & CLOUD SERVICES
TechMileage Confidential – Not for Distribution
CONTENTS
2
About TechMileage 1
Big Data Services 2
Why TechMileage? 3
Case Studies 4
TechMileage Confidential – Not for Distribution
Strategy Services
• Technology Assessments and Future State Definition
• Analytics Assessment and Planning
• IT Advisory Services and Planning
Ongoing Support
• Application Management • IT Governance and Oversight • Analytics Governance • IT Managed Services • Back Office Support /
Management
ABOUT TECHMILEAGE
• Founded in 2008 / Tempe, Arizona
• Over 100 engagements
• Full range of business & technology services
• Software Development, Big Data, BI, Advanced Analytics, QA and support
• Cost effective and high quality delivery model
3
• Application Development • Big Data and BI Design &
Implementations • Advanced Analytics • Cloud • QA / Testing, Modeling,
Security and Mobility
Technology Enablement
TechMileage Confidential – Not for Distribution
TECHNOLOGY SERVICES & SOLUTIONS
4
Mobile Applications
Application Services
Web Development
Data Services
Big Data
Analytics
Web Services & E-Commerce
Cloud Computing
BI & Data Warehousing
TechMileage Confidential – Not for Distribution
BIG DATA SERVICES
Big Data Development
• High Performance applications with sub-second response time
• Custom development of Hadoop, MapReduce and PIG applications
• Development using frameworks like cascading
• No-SQL databases, such as Cassandra, HBase, MongoDB, etc.
• SOLR, Oozie , Spark
• Data warehousing and BI solutions with Hive, Vertica, MySQL, Pentaho and Datameer
• Messaging mechanisms such as Flume, Kafka and Storm
5
TechMileage knows Big Data. We have extensive experience in developing Big Data solutions, including Cloud infrastructure design and development.
Operations Support
• Big Data deployment and production support
• AWS infrastructure and operations support
• Monitoring mechanisms, such as ZooKeeper, RightScale, EC2, S3Fox Organizer, PagerDuty, Nagios, Splunk, etc.
Cloud Infrastructure Design and Development
• EC2, Elastic MapReduce, S3, SQS, SNS and DynamoDB
• RightScale-based instance templates and custom alerting mechanisms
• Chef-based instance templates
Prototyping Applications for Cloud & Big Data
TechMileage Confidential – Not for Distribution
BIG DATA TECHNOLOGY EXPERTISE
Big Data & BI
Cloud Computing
Data Warehousing
6
Visualization and Analytics
Support & Maintenance
Big Data Architecture & Development
Exploration and Discovery
TechMileage Confidential – Not for Distribution
WHY TECHMILEAGE?
• Proven Competency
– Proven & matured process oriented BigData development competency
• Complete Picture
– End to end coverage across different areas & technologies
– Data Governance
– Support and maintenance
7
• Strong Team
– Strong & experienced development team that can quickly adapt to new environment and technologies
• Flexible Approach & Cost
– Flexible engagement approach customized for your business
– Cost effective global delivery model
CASE STUDIES BIG DATA & HADOOP
8
TechMileage Confidential – Not for Distribution
REAL TIME FRAUD AND RISK PRODUCTS FOR MAJOR BANKS
Challenge
Major financial client with fraud and risk services was struggling with development of important high performance services with sub-second response time, for its clients
Solution
• TechMileage employed expertise in Big Data architecture and application development to expedite the development process with technologies like Cassandra, Hadoop, SOLR, Cascading
• Provided consulting services on model governance and model implementation on Hadoop platform
• Designed major components for search and reporting
• Real-time processing solutions using SPARK and Cassandra
• Maintenance and support
9
TechMileage Confidential – Not for Distribution
SOCIAL MEDIA DATA COLLECTION SUITE
Solution
• Business Metrics Dashboard
• Hive + Amazon S3 + MySQL
• Pentaho Business Intelligence Suite
• AWS Cloud-based Production Support
• EC2/S3/SQS-based Application Support
• RightScale-integrated Monitoring
• EC2 Instance Management
• AWS-based Web Services Support
• EC2-based Hadoop/Hive/ Cassandra Support
Challenge
Design and develop a very complex, high availability data collection system, with multiple input streams of structured and unstructured data
10
TechMileage Confidential – Not for Distribution
DEPARTMENT STORE CHAIN – IMPROVING ANALYTIC PERFORMANCE
Challenge
Major department store chain with innovative rewards program collects enormous amounts of data, but could not turn data into decision-driven reporting in a timely fashion. At best, reports were always at least one day behind; at worst, reports were highly inaccurate
Solution
• TechMileage employed expertise in Big Data architecture solutions to cut over 12 hours of processing time to less than 20 minutes, paving the way for near real-time updates to marketing campaign results
• Provided consulting on defined data definition structure to greatly enhance reporting accuracy
• Decommissioned data from Teradata (traditional data warehouse) and moved processing and storage to Hadoop/HBase/Hive
• Prepared MongoDB/Hadoop-based BI solutions for alerts, fraud and offer management
• Real-time message processing solutions using Storm
• Maintenance and support
11
TechMileage Confidential – Not for Distribution
GAMING COMPANY – REAL TIME LOG PROCESSING
Solution
• High availability system
• MapReduce and Hadoop processes
• Data aggregation
• Cassandra and MongoDB
• Kafka messaging for receiving client logs
• MySQL for reporting
• Long term maintenance and support
Challenge
Design and architecture of real-time game log processing system from thousands of gaming clients.
12
TechMileage Confidential – Not for Distribution
SOCIAL/VISUAL ANALYTICS COMPANY
Solution
• MapReduce processing for identifying patterns in uploaded images and videos
• AWS Cloud-based development and deployment
• Basic image processing application
• Object identification in images and videos
• EC2 auto-scaling
• S3-based object storage
• SQS-based communication and job processing
• AWS Cloud-based production support
Challenge
Real-time pattern matching, tagging and categorizations of images and videos
13