amazon search services - amazon web servicesaws-de-media.s3.amazonaws.com/...search_intro... · aws...
TRANSCRIPT
Christoph [email protected]
Amazon Search Services
What we'll cover
• Overview of Amazon Search Services• Understand the difference between
Cloudsearch and Amazon ElasticSearchService
• Q&A
Amazon Search Services
Amazon CloudSearch
Amazon Elasticsearch
Service
Scenario: Full-text search
• Traditional search
• Your application or website provides search capabilities over diverse documents
• You are tasked with making this knowledge base searchable and accessible
• You need key search features including text matching, faceting, filtering, fuzzy search, auto complete, and highlighting
Scenario: Log data analytics
• Application monitoring and event diagnosis
• You need to monitor the performance of your application, web servers, and hardware
• You need easy to use, yet powerful data visualization tools to detect issues in near real-time
• You want the ability to dig into your logs in an intuitive, fine-grained way
Scenario: Batch data analytics
• Usage Monitoring
• You are a mobile app developer• You have to monitor/manage users
across multiple app versions• You want to analyze and report on
usage and migration between app versions
Search is like a database
SearchValueField
DocumentIndex
Cluster
Queries
DatabaseValueColumnRowTableDatabase
SQL
Search is not like a database
Search• No relational information• No transactions• Eventual consistency• Queries bring the best
matches• Sorting based on relevance• Read-heavy, highly
distributed
Database• Relational information• Transactions• Strong consistency model• Queries bring all matches• Sorting based on field
values
Amazon CloudSearch is a fully managed search service in the cloud for your website or application
Rich search feature set
Source:IDC,Nielsen, Twitterblog
Faceting Highlighting Autocompletesuggestions
Geospatial search
Ease of operation
Auto-scaling
Highavailability
Self-healingclusters
Datadurability
Easy administration
Security built-in integration with
AWS IAM
Monitoringbuilt-in integration withAmazon CloudWatch
Auditingbuilt-in integration with
AWS CloudTrail
Flexible options to build, automate, and experiment
AWS SDK
AWS CLI
AWS Console
Build on your preferred
language: Java, Ruby, Python,
and many more
Automate admin tasks by
scripting via the command-line
interface
Experiment with easy-to-use, interactive console gui
Pay only for the resources you use
Instance hours Index buildsBatch uploads
Amazon CloudSearch is great if…
ü Your application is high-read / low-write, requires fast query performance, but moderate document updates
- Example use cases: website search, e-Commerce search
ü You are looking for a hands-free search platform that takes care of scaling, high availability, data durability, and other administrative tasks
ü You want to focus on your business as opposed to building search expertise
Amazon Elasticsearch Service
The ELK stack for visualization
• Combined with Logstash and Kibana, the ELK stack provides a tool for real-time analytics and data visualization
Scenario: Full-text search
• Traditional search
• Your application or website provides search capabilities over diverse documents
• You are tasked with making this knowledge base searchable and accessible
• You need key search features including text matching, faceting, filtering, fuzzy search, auto complete, and highlighting
Ease of operation
Highavailability
Self-healingclusters
Datadurability
Easy cluster creation and configuration management
Easy administration
Security built-in integration with
AWS IAM
Monitoringbuilt-in integration withAmazon CloudWatch
Auditingbuilt-in integration with
AWS CloudTrail
Logstash
REST
CWL Agent
EC2 Instances
Amazon Kinesis
AmazonRDS
AmazonDynamoDB
AmazonSQS
Queue
LogstashCluster
Amazon Elasticsearch
Service
Amazon CloudWatch
AWSLambda
AWSCloudTrail
Access Logs
Amazon VPC Flow
Logs
Amazon S3 bucket
AWS IoT
Amazon Kinesis Firehose
Integration with the AWS ecosystem
Pay for compute and storage you use
• With Amazon Elasticsearch Service, you pay only for the compute and storage resources you use. AWS Free Tier for qualifying customers.
Amazon Elasticsearch Service• Elk – +Kibana• High volume updates• More storage at lower cost• Multi-tenant workloads• Nested documents• Aggregations
Two Search Technologies? Strengths of each
Amazon CloudSearch• Hands-off operation• Simple API for search• Simple schema changes• Relevance tuning
Q&A
• Christoph Schmitter: [email protected] Architect
• https://run.qwiklab.com/searches/elasticsearch• Building Search into your Applications with
Amazon CloudSearch•
Demo Optional
Kibana