amazon cloudsearch & future search architectures

19
Amazon CloudSearch & Future Search Architectures Iain Fletcher [email protected] The expert in the search space

Upload: search-technologies

Post on 09-Feb-2015

630 views

Category:

Technology


1 download

DESCRIPTION

Review this webinar given on November 5, 2103 in the UK. Search Technologies' VP of Marketing Iain Fletcher talks about Amazon CloudSearch and Future Search Architectures. For more information, visit http://www.searchtechnologies.com/amazon-cloudsearch-services.html

TRANSCRIPT

Page 1: Amazon CloudSearch & Future Search Architectures

Amazon CloudSearch & Future Search ArchitecturesIain [email protected]

The expert in the search space

Page 2: Amazon CloudSearch & Future Search Architectures

The expert in the search space

Agenda

A brief introduction to Search TechnologiesSearch Application Architectures

Common challenges, emerging architectures

Our thoughts about Amazon CloudSearch

Page 3: Amazon CloudSearch & Future Search Architectures

Search Technologies Overview

San Diego, CA

San Jose, CR

Herndon, VA

Ascot, UK

Cincinnati, OH Karlsruhe, DE

• The leading IT Services company dedicated to Enterprise Search & Search-based Applications

• Implementation, Consulting, Managed Services• 120 employees and growing• Independent, working with all of the leading

software vendors and open source alternatives

Page 5: Amazon CloudSearch & Future Search Architectures

Future Search Architectures

The expert in the search space

Page 6: Amazon CloudSearch & Future Search Architectures

The expert in the search space

A Traditional Integrated Architecture

Integrated Search EngineContentSources

Connectors Index Pipeline SearchIndexEmployee

Directory

CMS

File Share

UI

Etc.

The year is 2013, but we still have:Dissatisfaction with search resultsScalability issues (various)High initial investmentInflexibility in the modelData integration issues…

Page 7: Amazon CloudSearch & Future Search Architectures

The expert in the search space

Reasons for Change

Today’s leading “indexing engines” are very capableThe challenges to success almost always lie in peripheral tasks. On the indexing side of the house, this means:

Gathering and feeding data to the search enginePreparing data for indexing (normalization, metadata enrichment. Etc.)

Page 8: Amazon CloudSearch & Future Search Architectures

The expert in the search space

Reasons for Change

The need to cope with continuous and rapid data growthThings usually break first on the data gathering side of the house

E.g. The Government department and the 7TB File Server

Page 9: Amazon CloudSearch & Future Search Architectures

The expert in the search space

A Traditional Integrated Architecture

Integrated Search EngineContentSources

Connectors Index Pipeline SearchIndexEmployee

Directory

CMS

File Share

UI

Etc.

RE-INDEX

Page 10: Amazon CloudSearch & Future Search Architectures

The expert in the search space

A Better Search Architecture

Search EngineContentSources

ConnectorsIndex

PipelineSearchIndexEmployee

Directory

CMS

Etc.

RE-INDEX

ContentProcessing

Securexml

Cache

IterativeDevelopment

Better operational agility

Page 11: Amazon CloudSearch & Future Search Architectures

The expert in the search space

Amazon CloudSearchContentSources

ConnectorsIndex

PipelineSearchIndexEmployee

Directory

CMS

Etc.

RE-INDEX

ContentProcessing

Securexml

Cache

IterativeDevelopment

Better operational agilityMuch improved cost of ownership

A Better Search Architecture

Page 12: Amazon CloudSearch & Future Search Architectures

The expert in the search space

Let’s take a look at Amazon CloudSearch

If you’ve ever switched on an EC2 server, then you can switch on a CloudSearch server

And of course, switch it off just as easily

Xml or JSON in, for indexingRESTful / xml out, for searchingHas the bases covered in terms of core search functionality

Page 13: Amazon CloudSearch & Future Search Architectures

The expert in the search space

Amazon CloudSearch: Important Search Functions

Full-on Search NavigatorsResults sorting by propertyPlenty of relevancy tuning controlsIndexing speed is impressive

We’ve tested up to 500 docs/sec

Very long results lists can be served

Page 14: Amazon CloudSearch & Future Search Architectures

The expert in the search space

Cost Effective & Flexible

The usual benefits of AWSOnly use what you needElastic scalability

Maintenance inclusiveCompare that to the cost of a Service Level Agreement for an on-premise alternativeThen add the labour costs….

From less than £50 per month

Page 15: Amazon CloudSearch & Future Search Architectures

The expert in the search space

What do you need to get started

Repository ConnectorsCapture contentConvert to xmlXSLT. Etc.

Content ProcessingJava code, Groovy. Etc.A framework product, E.g. AspireCommercial software to suit the purpose

A User Interface

Amazon S3Atlassian ConfluenceDocumentum eRoomSecure File SystemsIBM ConnectionsJIVELotus NotesRDBMSSharePoint 2010, 2013SocialCastTeamForgeWeb Crawling

Page 16: Amazon CloudSearch & Future Search Architectures

The expert in the search space

Search-specific UI/UX builders are available

Page 17: Amazon CloudSearch & Future Search Architectures

The expert in the search space

What Applications Suit Amazon CloudSearch?

In principle anyCloudSearch is an option that everyone should consider for search-based applications

Especially where elastic scalability is an advantageOr where the data already lives in the cloud, including S3 buckets

Page 18: Amazon CloudSearch & Future Search Architectures

The expert in the search space

To conclude

If you like Amazon Web Services, then you’ll like CloudSearch for the same reasonsIt is a full-function indexing engine, ideally suited to agile, flexible search architecturesIf you are looking for a search-based application, it should be on your shortlistFor many applications, CloudSearch will prove to be highly cost effective

Page 19: Amazon CloudSearch & Future Search Architectures

My email: [email protected] Useful URLs: Connectors for Cloudsearchwww.searchtechnologies.com/cloudsearch-data-connectors.htmlAspire Content Processing Frameworkwww.searchtechnologies.com/aspire.html A Java API for Amazon Cloudsearchwww.searchtechnologies.com/java-api-amazon-cloudsearch.htmlEnterprise Search Surveyswww.searchtechnologies.com/enterprise-search-surveys.htmlBlog: Searching Wikipedia with Amazon CloudSearchwww.searchtechnologies.com/cloudsearch-data-connectors.html White Paper: A Big Data Architecture for Searchwww.searchtechnologies.com/big-data-enterprise-search-architecture.html

The expert in the search space