aws webcast - getting started with cloudsearch: add powerful search to your web application
DESCRIPTION
In this webinar we'll show you how you can use Amazon CloudSearch to add search capabilities to your website or app without the administrative burdens of setting up, operating, and scaling a search engine. We'll explain details about using the service, review the key components, and show you how search can be integrated into a sample application. You will learn how to create an Amazon CloudSearch search domain, upload your data, and submit search requests. Additional topics covered include: Getting documents into CloudSearch Tuning and debugging search results Using facets to create a better user experience Personalizing search results by tailoring ranking for each search request Using field weighting to boost results into the best order.TRANSCRIPT
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Getting Started With Amazon CloudSearch:
Add Powerful Search To Your Web Application
Jon Handler
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
What is Search
Shoes
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Do You Want Search With That?
Build your own – database, home-rolled, site search
Open source
Legacy enterprise search
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Search Challenges
Complex, expertise required
Costly, often with up-front expenditure
Long time to market, innovation and experimentation are
slowed
Operational overhead is undifferentiated work
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Amazon CloudSearch
Pay for infrastructure you need when you need it
Low cost
No need to guess capacity
Experiment fast with low risk
We do the undifferentiated heavy lifting
Go global in minutes
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Amazon CloudSearch Architecture
DNS / Load Balancing AWS Query
Search API Console Config
API
Command
Line Tools Console Doc
Svc API
Command
Line Tools Console
SEARCH SERVICE DOCUMENT SERVICE CONFIG SERVICE
Search Domain
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Automatic Scaling
SEARCH INSTANCE Index Partition n
Copy 1
SEARCH INSTANCE Index Partition 2
Copy 2
SEARCH INSTANCE Index Partition n
Copy 2
SEARCH INSTANCE Index Partition 2
Copy n
SEARCH INSTANCE
DATA Document Quantity and Size
TRAFFIC Search Request Volume and Complexity
Index Partition n Copy n
SEARCH INSTANCE Index Partition 1
Copy 1
SEARCH INSTANCE Index Partition 2
Copy 1
SEARCH INSTANCE Index Partition 1
Copy 2
SEARCH INSTANCE Index Partition 1
Copy n
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
SEARCH INSTANCE
Index Partition n Copy 1
SEARCH INSTANCE
Index Partition 2 Copy 2
SEARCH INSTANCE
Index Partition n Copy 2
SEARCH INSTANCE
Index Partition 2 Copy n
SEARCH INSTANCE
Index Partition n Copy n
SEARCH INSTANCE
Index Partition 1 Copy 1
SEARCH INSTANCE
Index Partition 2 Copy 1
SEARCH INSTANCE
Index Partition 1 Copy 2
SEARCH INSTANCE
Index Partition 1 Copy n
Compute
Storage
Load Balancing
Security
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Text Search
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Highly Relevant Results
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Faceted
Drilldown
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Integer Range
Searching
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Complex Queries
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Query
564
726
123
Ranking
564
726
123
Sorting Filtering Matching
Search Query Processing
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Reference Architecture
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Create An Amazon CloudSearch Domain
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Text fields for
matching user terms
Result enabled to
retrieve source data
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Literal fields for
Faceting
Facet enabled to
retrieve facets
Search enabled for
narrowing
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Integer fields for
ranking, narrowing
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Configure the Domain
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Data Preparation and Upload
Search
Documents
SDF
Batch
Amazon
CloudSearch
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
CloudSearch SDF [{"type":"add",
"id": "b007oznzg0",
"version": 1,
"lang": "en",
"fields": {
"title":"Kindle Paperwhite",
"description":"World's most advanced e-reader",
"category": ["Electronics","eBook Readers"],
"price":11900
} }, ...]
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Document Service API
http(s)://< document service endpoint >/2011-02-
01/documents/batch Accept: application/json
Content-Length: 1176
Content-Type: application/json
Host: doc.imdb-movies-rr2f34ofg56xneuemujamut52i.us-east-1.cloudsearch.amazonaws.com
[{ ,"id":"b007oznzg0","version": 1,"lang": "en","fields": {"title":"Kindle
Paperwhite","description":"World's most advanced e-reader","category":["Electronics","eBook
Readers"],"price":11900} },
{ , "id": "tt0434409", "version": 1337648735 } ]
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Search Service API
http(s)://< search service endpoint>/2011-02-01/search?
Simple searches • q= text
Boolean combination of fields • bq= (or field:'value1' (and field:'value2' field:'value3'))
Faceting • facet= comma separated list of facet fields
Pagination • start=, size=
Customized ranking • rank= sort results based on the rank expression provided
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Search Results
{"rank": "-text_relevance",
"match-expr": "(label 'kindle paperwhite')",
"hits": { "found": 204, "start": 0,
"hit": [ { "id": "sontsst12cf5f88b42" },
{ "id": "sopvopr12ab017f082" },
{ "id": "sorzrpw12ac468a13b" },
] },
...
}
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
IMDB DATA DEMO
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Pricing
Get started for just $2.40/day; $75/month
AWS Calculator
http://calculator.s3.amazonaws.com/calc5.html
Free Trial
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Wrap Up
Powerful search is a critical component of today's
applications
Amazon CloudSearch makes adding search easy
Create a domain, POST documents, GET search results
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Resources and Q&A
Amazon CloudSearch Overview Page
http://aws.amazon.com/cloudsearch/
• FAQs
• Community Forum
• Documentation & Getting Started Tutorial (IMDb)
Demos and Tutorials
• What Is Amazon CloudSearch
• Introducing Amazon CloudSearch (Features)
• Building a Search Application Using Amazon CloudSearch
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Thank You
Jon Handler / [email protected]