search and discovery - iron mountain · 2019-04-01 · n beyond sharepoint, intranet and ecm...

32
AIIM Market Intelligence Delivering the priorities and opinions of AIIM’s 80,000 community Search and Discovery - exploiting knowledge, minimizing risk aiim.org l 301.587.8202 Industry Watch Underwritten in part by:

Upload: others

Post on 15-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

AIIM Market IntelligenceDelivering the priorities and opinions of AIIMrsquos 80000 community

Search and Discovery- exploiting knowledge minimizing risk

aiimorg l 3015878202

Industry

Watch

Underwritten in part by

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 1

Search and Discovery

- exploiting knowledge m

inimizing risk

About the ResearchAs the non-profit association dedicated to nurturing growing and supporting the information management community AIIM is proud to provide this research at no charge In this way the entire community can leverage the education thought leadership and direction provided by our work We would like these research findings to be as widely distributed as possible Feel free to use individual elements of this research in presentations and publications with the attribution ndash ldquocopy AIIM 2014 wwwaiimorgrdquo

Rather than redistribute a copy of this report to your colleagues or clients we would prefer that you direct them to wwwaiimorgresearch for a download of their own Permission is not given for other aggregators to host this report on their own website

Our ability to deliver such high-quality research is partially made possible by our underwriting companies without whom we would have to return to a paid subscription model For that we hope you will join us in thanking our underwriters who are

Process Used and Survey DemographicsWhile we appreciate the support of these sponsors we also greatly value our objectivity and independence as a non-profit industry association The results of the survey and the market commentary made in this report are independent of any bias from the vendor community

The survey was taken using a web-based tool by 415 individual members of the AIIM community between Jul 11 and Aug 02 2014 Invitations to take the survey were sent via e-mail to a selection of the 80000 AIIM community members

Survey demographics can be found in Appendix 1 Graphs throughout the report exclude responses from organizations with less than 10 employees and suppliers of ECM products and services taking the number of respondents to 353

Iron Mountain745 Atlantic Avenue Boston MA 02111Tel +1 800-899-5766Web wwwironmountaincom

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 2

Search and Discovery

- exploiting knowledge m

inimizing risk

About AIIMAIIM has been an advocate and supporter of information professionals for 70 years The association mission is to ensure that information professionals understand the current and future challenges of managing information assets in an era of social mobile cloud and big data AIIM builds on a strong heritage of research and member service Today AIIM is a global non-profit organization that provides independent research education and certification programs to information professionals AIIM represents the entire information management community practitioners technology suppliers integrators and consultants

About the AuthorDoug Miles is head of the AIIM Market Intelligence Division He has over 30 yearsrsquo experience of working with users and vendors across a broad spectrum of IT applications He was an early pioneer of document management systems for business and engineering applications and has produced many AIIM survey reports on issues and drivers for Capture ECM Records Management SharePoint Mobile Cloud Social Business and Big Data Doug has also worked closely with other enterprise-level IT systems such as ERP BI and CRM Doug has an MSc in Communications Engineering and is a member of the IET in the UK

copy 2014AIIM The Global Community of Information Professionals1100 Wayne Avenue Suite 1100Silver Spring MD 20910+13015878202wwwaiimorg

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 3

Search and Discovery

- exploiting knowledge m

inimizing risk

Table of ContentsAbout the ResearchAbout the Research 1Process Used and Survey Demographics 1About AIIM 2About the Author 2

IntroductionIntroduction 4Key Findings 4

Search Drivers and StrategiesSearch Drivers and Strategies 5Levels of ECM 6Levels of Search 6Search Maturity 7Ownership 7

Search CharacteristicsSearch Characteristics 8Content Types and Repositories 9Security 10

Search CapabilitiesSearch Capabilities 11Search and Big DataContent Analytics 12

Dedicated or Advanced Search ToolsDedicated or Advanced Search Tools 12Have No Dedicated Tools 13Trigger for Search Investment 13Hosting Platform 14

Implementation and SupportImplementation and Support 15Support Staff 16Connectivity 17

Benefits of Enterprise SearchBenefits of Enterprise Search 19

DiscoveryDiscovery 20Hold 21Email Search and Hold 22Workflow 23Predictive Coding 23

Opinions and SpendOpinions and Spend 24Spend 24

Conclusion and RecommendationsConclusion and Recommendations 26Recommendations 26

Appendix 1 Survey DemographicsAppendix 1 Survey Demographics 27Survey Background 27Organizational Size 27Industry Sector 28Job Roles 28

Appendix 2 General CommentsAppendix 2 General Comments 29

UNDERWRITTEN IN PART BYUNDERWRITTEN IN PART BY 30Iron Mountain 30AIIM 31

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 4

Search and Discovery

- exploiting knowledge m

inimizing risk

IntroductionThe popularity of the term ldquoknowledge workerrdquo comes and goes but the single most-important characteristic of such a job-description is the ability to find information process it into knowledge and so add value for the organization Sounds simple and in the age of the internet finding and sifting information from the outside world is relatively simple and very quick However when it comes to information that resides inside the organization the situation can be very different and the effect of search efficiency on knowledge worker productivity can be huge

Of course inside the organizations things can be much messier than a set of websites that can be relatively easily connected and indexed Email archives multiple content systems documents stored in enterprise systems internal social media sound files image fileshellipto provide a comprehensive search these need to be connected indexed and preferably accessible from a single sign-on portal In addition for most users information stored in structured databases will need to be referenced alongside all of the unstructured content Added to that will be the expectation that all of this information can be searched and accessed on mobile devices The concept therefore of ldquoenterprise searchrdquo is an attractive one but one that is not that easy to achieve

There is of course another aspect of search that is more about finding the bad stuff than the good stuff Compliance audits freedom of information inquiries and legal discovery mandates require us to uncover all of the relevant electronically stored information - all of the references to customers suppliers contracts cases disputes etc and all of it preserved in a suitable context Often these exercises come out-of-the-blue and as we will see most organizations are poorly equipped to handle them

In this report we take an in-depth look at the importance of search the level of search tools deployed issues with their use and connection to other systems and mechanisms for legal discovery and hold

Key FindingsSearch Drivers

n For 71 of the organizations polled search is vital or essential yet only 18 have cross-repository search capabilities 58 show little or no sign of search maturity

n 75 of respondents would not disagree that information is easier to find outside of the organization than within 65 agree that employees struggle to access internal information from mobile devices Only 39 have natural language search

n Improved search is a priority over big datacontent analytics for 73 There is some movement (19) towards a unified search and big data strategy (although 59 have no big data strategy)

n The IT Department takes responsibility for search in 52 of organizations although only 25 feel it should be so 44 feel RMComplianceIG would be a better owner although there is also strong support for the concept of a Head of Knowledge Management (34) or Chief Knowledge Officer (29)

Search Tools

n 25 have no advanced or dedicated search tools 13 have five or more

n Those with advanced search tools are most likely (45) to acquire them through their ECM product or provider 42 of users have on-server search products outside of ECM including 14 using Open Source 21 are using a dedicated search appliance and 8 SaaS

n 38 have not tuned or optimized their search tool at all including 8 who have not even switched it on Half of responding organizations allocate less than half an FTE to support search applications Only 12 have used external expertise

n Beyond SharePoint intranet and ECM systems most content is beyond the scope of the search tools Only 19 have advanced search across email with less than 10 extending to other enterprise systems

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 5

Search and Discovery

- exploiting knowledge m

inimizing risk

n 47 feel that universal search and compliant e-discovery is becoming near impossible given the proliferation of cloud share and collaboration apps personal note systems and mobile devices 60 are firmly of the view that automated analytics tools are the only way to improve classification and tagging to make their content more findable

n Better decision-making and faster customer service are given as the top benefits from improved search tools Only 14 were required to make a financial business case for search investment

n 42 consider that they have achieved payback from their investment in search tools within 12 months or less 62 achieved payback within 18 months

Discovery

n 53 of respondents agree that their legal discovery procedures are ldquoad hoc manual disruptive and expensiverdquo 28 have no policy process or precedent for legal discovery and legal hold

n 29 rely on instructions not to delete rather than more robust hold procedures 47 admit that their email retention and hold policies expose them to risk

n 74 rely on manual processes to manage the downstream legal discovery process 10 have dedicated legal-case products and 9 have a discovery workflow as part of ECM

Spending Plans

n On the whole users are likely to increase spend on all aspects of search and discovery in the next 12 months in particular content analytics mobile device apps and consolidation of multiple search tools

Search Drivers and StrategiesAs we suggested in the introduction searching for information is an aspect of most tasks and projects In some organizations it is a key element 37 of our respondents feel that search is ldquovitalrdquo to the productivity and effectiveness of their employees with a further 34 considering it an ldquoessentialrdquo requirement Research design customer response case-work litigation all have searching for information as a fundamental part of the day-to-day task and we all know that the inability to find an existing document within a short space of time will prompt the creation of a new one sapping productivity and inviting potential errors and non-compliance Decision-making in almost all areas of business is driven by the ability to find and assess past knowledge

Figure 1 How important is it in your organization for employees to have an effective way to search internal content and documents in order to carry out their tasks (N=351)

Despite the high importance attached to finding information we will see later (Figure 32) that over half the respondents report that employees can find external information more easily than internal

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 6

Search and Discovery

- exploiting knowledge m

inimizing risk

Levels of ECMThe success of content search is hugely dependent on the degree of content management in place Focusing content into a single repository rather than a scattered set of file shares will improve search targeting A well-defined taxonomy standardized metadata and a consistent classification scheme will improve findability As we will see later ECM systems will come with their own search modules of varying degrees of sophistication and potential connectivity to other repositories

There is a wide range of maturity in content management amongst our respondents As we can see in Figure 2 just over half have ECM systems with 11 using SharePoint exclusively 14 using other ECM systems and 27 using a combination of the two 48 have a mish- mash of file shares and unconnected repositories creating a bigger challenge for search capability

Figure 2 How would you describe your current enterprise content management (ECM) system(s) (N=253)

Levels of SearchAs a consequence despite the high importance attached to search 43 of respondents admit that they have only basic search tools and a further 39 can only search within discrete repositories creating issues of different logins different taxonomies and different presentation of search results Only 11 have enterprise search across the organization with a further 7 having a degree of unified search across departmental content Surprisingly these numbers are very consistent across all sizes of organization although the number of the largest organizations (greater than 5000 employees) with enterprise search drops to 8 It is fair to say that enterprise-wide search is more difficult to achieve across the larger enterprise with more repositories more content and more users

Figure 3 How good is your ability to search across your key content (Pick highest capability) (N=350)

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 7

Search and Discovery

- exploiting knowledge m

inimizing risk

Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4

Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)

While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search

OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 8

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)

For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28

Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents

Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 9

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)

As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy

Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis

Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 10

Search and Discovery

- exploiting knowledge m

inimizing risk

Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26

Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ

Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)

SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors

On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 11

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 9 Are security and permissions concerns for you in search (N=299)

Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability

Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department

Figure 10 Do you have any of the following (N=342 multiple)

We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 12

Search and Discovery

- exploiting knowledge m

inimizing risk

49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices

Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together

Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)

In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all

Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities

Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 13

Search and Discovery

- exploiting knowledge m

inimizing risk

Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below

Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)

Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion

Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)

Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 14

Search and Discovery

- exploiting knowledge m

inimizing risk

Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments

Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)

Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies

Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 2: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 1

Search and Discovery

- exploiting knowledge m

inimizing risk

About the ResearchAs the non-profit association dedicated to nurturing growing and supporting the information management community AIIM is proud to provide this research at no charge In this way the entire community can leverage the education thought leadership and direction provided by our work We would like these research findings to be as widely distributed as possible Feel free to use individual elements of this research in presentations and publications with the attribution ndash ldquocopy AIIM 2014 wwwaiimorgrdquo

Rather than redistribute a copy of this report to your colleagues or clients we would prefer that you direct them to wwwaiimorgresearch for a download of their own Permission is not given for other aggregators to host this report on their own website

Our ability to deliver such high-quality research is partially made possible by our underwriting companies without whom we would have to return to a paid subscription model For that we hope you will join us in thanking our underwriters who are

Process Used and Survey DemographicsWhile we appreciate the support of these sponsors we also greatly value our objectivity and independence as a non-profit industry association The results of the survey and the market commentary made in this report are independent of any bias from the vendor community

The survey was taken using a web-based tool by 415 individual members of the AIIM community between Jul 11 and Aug 02 2014 Invitations to take the survey were sent via e-mail to a selection of the 80000 AIIM community members

Survey demographics can be found in Appendix 1 Graphs throughout the report exclude responses from organizations with less than 10 employees and suppliers of ECM products and services taking the number of respondents to 353

Iron Mountain745 Atlantic Avenue Boston MA 02111Tel +1 800-899-5766Web wwwironmountaincom

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 2

Search and Discovery

- exploiting knowledge m

inimizing risk

About AIIMAIIM has been an advocate and supporter of information professionals for 70 years The association mission is to ensure that information professionals understand the current and future challenges of managing information assets in an era of social mobile cloud and big data AIIM builds on a strong heritage of research and member service Today AIIM is a global non-profit organization that provides independent research education and certification programs to information professionals AIIM represents the entire information management community practitioners technology suppliers integrators and consultants

About the AuthorDoug Miles is head of the AIIM Market Intelligence Division He has over 30 yearsrsquo experience of working with users and vendors across a broad spectrum of IT applications He was an early pioneer of document management systems for business and engineering applications and has produced many AIIM survey reports on issues and drivers for Capture ECM Records Management SharePoint Mobile Cloud Social Business and Big Data Doug has also worked closely with other enterprise-level IT systems such as ERP BI and CRM Doug has an MSc in Communications Engineering and is a member of the IET in the UK

copy 2014AIIM The Global Community of Information Professionals1100 Wayne Avenue Suite 1100Silver Spring MD 20910+13015878202wwwaiimorg

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 3

Search and Discovery

- exploiting knowledge m

inimizing risk

Table of ContentsAbout the ResearchAbout the Research 1Process Used and Survey Demographics 1About AIIM 2About the Author 2

IntroductionIntroduction 4Key Findings 4

Search Drivers and StrategiesSearch Drivers and Strategies 5Levels of ECM 6Levels of Search 6Search Maturity 7Ownership 7

Search CharacteristicsSearch Characteristics 8Content Types and Repositories 9Security 10

Search CapabilitiesSearch Capabilities 11Search and Big DataContent Analytics 12

Dedicated or Advanced Search ToolsDedicated or Advanced Search Tools 12Have No Dedicated Tools 13Trigger for Search Investment 13Hosting Platform 14

Implementation and SupportImplementation and Support 15Support Staff 16Connectivity 17

Benefits of Enterprise SearchBenefits of Enterprise Search 19

DiscoveryDiscovery 20Hold 21Email Search and Hold 22Workflow 23Predictive Coding 23

Opinions and SpendOpinions and Spend 24Spend 24

Conclusion and RecommendationsConclusion and Recommendations 26Recommendations 26

Appendix 1 Survey DemographicsAppendix 1 Survey Demographics 27Survey Background 27Organizational Size 27Industry Sector 28Job Roles 28

Appendix 2 General CommentsAppendix 2 General Comments 29

UNDERWRITTEN IN PART BYUNDERWRITTEN IN PART BY 30Iron Mountain 30AIIM 31

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 4

Search and Discovery

- exploiting knowledge m

inimizing risk

IntroductionThe popularity of the term ldquoknowledge workerrdquo comes and goes but the single most-important characteristic of such a job-description is the ability to find information process it into knowledge and so add value for the organization Sounds simple and in the age of the internet finding and sifting information from the outside world is relatively simple and very quick However when it comes to information that resides inside the organization the situation can be very different and the effect of search efficiency on knowledge worker productivity can be huge

Of course inside the organizations things can be much messier than a set of websites that can be relatively easily connected and indexed Email archives multiple content systems documents stored in enterprise systems internal social media sound files image fileshellipto provide a comprehensive search these need to be connected indexed and preferably accessible from a single sign-on portal In addition for most users information stored in structured databases will need to be referenced alongside all of the unstructured content Added to that will be the expectation that all of this information can be searched and accessed on mobile devices The concept therefore of ldquoenterprise searchrdquo is an attractive one but one that is not that easy to achieve

There is of course another aspect of search that is more about finding the bad stuff than the good stuff Compliance audits freedom of information inquiries and legal discovery mandates require us to uncover all of the relevant electronically stored information - all of the references to customers suppliers contracts cases disputes etc and all of it preserved in a suitable context Often these exercises come out-of-the-blue and as we will see most organizations are poorly equipped to handle them

In this report we take an in-depth look at the importance of search the level of search tools deployed issues with their use and connection to other systems and mechanisms for legal discovery and hold

Key FindingsSearch Drivers

n For 71 of the organizations polled search is vital or essential yet only 18 have cross-repository search capabilities 58 show little or no sign of search maturity

n 75 of respondents would not disagree that information is easier to find outside of the organization than within 65 agree that employees struggle to access internal information from mobile devices Only 39 have natural language search

n Improved search is a priority over big datacontent analytics for 73 There is some movement (19) towards a unified search and big data strategy (although 59 have no big data strategy)

n The IT Department takes responsibility for search in 52 of organizations although only 25 feel it should be so 44 feel RMComplianceIG would be a better owner although there is also strong support for the concept of a Head of Knowledge Management (34) or Chief Knowledge Officer (29)

Search Tools

n 25 have no advanced or dedicated search tools 13 have five or more

n Those with advanced search tools are most likely (45) to acquire them through their ECM product or provider 42 of users have on-server search products outside of ECM including 14 using Open Source 21 are using a dedicated search appliance and 8 SaaS

n 38 have not tuned or optimized their search tool at all including 8 who have not even switched it on Half of responding organizations allocate less than half an FTE to support search applications Only 12 have used external expertise

n Beyond SharePoint intranet and ECM systems most content is beyond the scope of the search tools Only 19 have advanced search across email with less than 10 extending to other enterprise systems

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 5

Search and Discovery

- exploiting knowledge m

inimizing risk

n 47 feel that universal search and compliant e-discovery is becoming near impossible given the proliferation of cloud share and collaboration apps personal note systems and mobile devices 60 are firmly of the view that automated analytics tools are the only way to improve classification and tagging to make their content more findable

n Better decision-making and faster customer service are given as the top benefits from improved search tools Only 14 were required to make a financial business case for search investment

n 42 consider that they have achieved payback from their investment in search tools within 12 months or less 62 achieved payback within 18 months

Discovery

n 53 of respondents agree that their legal discovery procedures are ldquoad hoc manual disruptive and expensiverdquo 28 have no policy process or precedent for legal discovery and legal hold

n 29 rely on instructions not to delete rather than more robust hold procedures 47 admit that their email retention and hold policies expose them to risk

n 74 rely on manual processes to manage the downstream legal discovery process 10 have dedicated legal-case products and 9 have a discovery workflow as part of ECM

Spending Plans

n On the whole users are likely to increase spend on all aspects of search and discovery in the next 12 months in particular content analytics mobile device apps and consolidation of multiple search tools

Search Drivers and StrategiesAs we suggested in the introduction searching for information is an aspect of most tasks and projects In some organizations it is a key element 37 of our respondents feel that search is ldquovitalrdquo to the productivity and effectiveness of their employees with a further 34 considering it an ldquoessentialrdquo requirement Research design customer response case-work litigation all have searching for information as a fundamental part of the day-to-day task and we all know that the inability to find an existing document within a short space of time will prompt the creation of a new one sapping productivity and inviting potential errors and non-compliance Decision-making in almost all areas of business is driven by the ability to find and assess past knowledge

Figure 1 How important is it in your organization for employees to have an effective way to search internal content and documents in order to carry out their tasks (N=351)

Despite the high importance attached to finding information we will see later (Figure 32) that over half the respondents report that employees can find external information more easily than internal

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 6

Search and Discovery

- exploiting knowledge m

inimizing risk

Levels of ECMThe success of content search is hugely dependent on the degree of content management in place Focusing content into a single repository rather than a scattered set of file shares will improve search targeting A well-defined taxonomy standardized metadata and a consistent classification scheme will improve findability As we will see later ECM systems will come with their own search modules of varying degrees of sophistication and potential connectivity to other repositories

There is a wide range of maturity in content management amongst our respondents As we can see in Figure 2 just over half have ECM systems with 11 using SharePoint exclusively 14 using other ECM systems and 27 using a combination of the two 48 have a mish- mash of file shares and unconnected repositories creating a bigger challenge for search capability

Figure 2 How would you describe your current enterprise content management (ECM) system(s) (N=253)

Levels of SearchAs a consequence despite the high importance attached to search 43 of respondents admit that they have only basic search tools and a further 39 can only search within discrete repositories creating issues of different logins different taxonomies and different presentation of search results Only 11 have enterprise search across the organization with a further 7 having a degree of unified search across departmental content Surprisingly these numbers are very consistent across all sizes of organization although the number of the largest organizations (greater than 5000 employees) with enterprise search drops to 8 It is fair to say that enterprise-wide search is more difficult to achieve across the larger enterprise with more repositories more content and more users

Figure 3 How good is your ability to search across your key content (Pick highest capability) (N=350)

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 7

Search and Discovery

- exploiting knowledge m

inimizing risk

Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4

Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)

While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search

OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 8

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)

For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28

Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents

Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 9

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)

As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy

Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis

Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 10

Search and Discovery

- exploiting knowledge m

inimizing risk

Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26

Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ

Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)

SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors

On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 11

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 9 Are security and permissions concerns for you in search (N=299)

Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability

Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department

Figure 10 Do you have any of the following (N=342 multiple)

We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 12

Search and Discovery

- exploiting knowledge m

inimizing risk

49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices

Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together

Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)

In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all

Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities

Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 13

Search and Discovery

- exploiting knowledge m

inimizing risk

Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below

Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)

Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion

Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)

Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 14

Search and Discovery

- exploiting knowledge m

inimizing risk

Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments

Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)

Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies

Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 3: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 2

Search and Discovery

- exploiting knowledge m

inimizing risk

About AIIMAIIM has been an advocate and supporter of information professionals for 70 years The association mission is to ensure that information professionals understand the current and future challenges of managing information assets in an era of social mobile cloud and big data AIIM builds on a strong heritage of research and member service Today AIIM is a global non-profit organization that provides independent research education and certification programs to information professionals AIIM represents the entire information management community practitioners technology suppliers integrators and consultants

About the AuthorDoug Miles is head of the AIIM Market Intelligence Division He has over 30 yearsrsquo experience of working with users and vendors across a broad spectrum of IT applications He was an early pioneer of document management systems for business and engineering applications and has produced many AIIM survey reports on issues and drivers for Capture ECM Records Management SharePoint Mobile Cloud Social Business and Big Data Doug has also worked closely with other enterprise-level IT systems such as ERP BI and CRM Doug has an MSc in Communications Engineering and is a member of the IET in the UK

copy 2014AIIM The Global Community of Information Professionals1100 Wayne Avenue Suite 1100Silver Spring MD 20910+13015878202wwwaiimorg

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 3

Search and Discovery

- exploiting knowledge m

inimizing risk

Table of ContentsAbout the ResearchAbout the Research 1Process Used and Survey Demographics 1About AIIM 2About the Author 2

IntroductionIntroduction 4Key Findings 4

Search Drivers and StrategiesSearch Drivers and Strategies 5Levels of ECM 6Levels of Search 6Search Maturity 7Ownership 7

Search CharacteristicsSearch Characteristics 8Content Types and Repositories 9Security 10

Search CapabilitiesSearch Capabilities 11Search and Big DataContent Analytics 12

Dedicated or Advanced Search ToolsDedicated or Advanced Search Tools 12Have No Dedicated Tools 13Trigger for Search Investment 13Hosting Platform 14

Implementation and SupportImplementation and Support 15Support Staff 16Connectivity 17

Benefits of Enterprise SearchBenefits of Enterprise Search 19

DiscoveryDiscovery 20Hold 21Email Search and Hold 22Workflow 23Predictive Coding 23

Opinions and SpendOpinions and Spend 24Spend 24

Conclusion and RecommendationsConclusion and Recommendations 26Recommendations 26

Appendix 1 Survey DemographicsAppendix 1 Survey Demographics 27Survey Background 27Organizational Size 27Industry Sector 28Job Roles 28

Appendix 2 General CommentsAppendix 2 General Comments 29

UNDERWRITTEN IN PART BYUNDERWRITTEN IN PART BY 30Iron Mountain 30AIIM 31

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 4

Search and Discovery

- exploiting knowledge m

inimizing risk

IntroductionThe popularity of the term ldquoknowledge workerrdquo comes and goes but the single most-important characteristic of such a job-description is the ability to find information process it into knowledge and so add value for the organization Sounds simple and in the age of the internet finding and sifting information from the outside world is relatively simple and very quick However when it comes to information that resides inside the organization the situation can be very different and the effect of search efficiency on knowledge worker productivity can be huge

Of course inside the organizations things can be much messier than a set of websites that can be relatively easily connected and indexed Email archives multiple content systems documents stored in enterprise systems internal social media sound files image fileshellipto provide a comprehensive search these need to be connected indexed and preferably accessible from a single sign-on portal In addition for most users information stored in structured databases will need to be referenced alongside all of the unstructured content Added to that will be the expectation that all of this information can be searched and accessed on mobile devices The concept therefore of ldquoenterprise searchrdquo is an attractive one but one that is not that easy to achieve

There is of course another aspect of search that is more about finding the bad stuff than the good stuff Compliance audits freedom of information inquiries and legal discovery mandates require us to uncover all of the relevant electronically stored information - all of the references to customers suppliers contracts cases disputes etc and all of it preserved in a suitable context Often these exercises come out-of-the-blue and as we will see most organizations are poorly equipped to handle them

In this report we take an in-depth look at the importance of search the level of search tools deployed issues with their use and connection to other systems and mechanisms for legal discovery and hold

Key FindingsSearch Drivers

n For 71 of the organizations polled search is vital or essential yet only 18 have cross-repository search capabilities 58 show little or no sign of search maturity

n 75 of respondents would not disagree that information is easier to find outside of the organization than within 65 agree that employees struggle to access internal information from mobile devices Only 39 have natural language search

n Improved search is a priority over big datacontent analytics for 73 There is some movement (19) towards a unified search and big data strategy (although 59 have no big data strategy)

n The IT Department takes responsibility for search in 52 of organizations although only 25 feel it should be so 44 feel RMComplianceIG would be a better owner although there is also strong support for the concept of a Head of Knowledge Management (34) or Chief Knowledge Officer (29)

Search Tools

n 25 have no advanced or dedicated search tools 13 have five or more

n Those with advanced search tools are most likely (45) to acquire them through their ECM product or provider 42 of users have on-server search products outside of ECM including 14 using Open Source 21 are using a dedicated search appliance and 8 SaaS

n 38 have not tuned or optimized their search tool at all including 8 who have not even switched it on Half of responding organizations allocate less than half an FTE to support search applications Only 12 have used external expertise

n Beyond SharePoint intranet and ECM systems most content is beyond the scope of the search tools Only 19 have advanced search across email with less than 10 extending to other enterprise systems

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 5

Search and Discovery

- exploiting knowledge m

inimizing risk

n 47 feel that universal search and compliant e-discovery is becoming near impossible given the proliferation of cloud share and collaboration apps personal note systems and mobile devices 60 are firmly of the view that automated analytics tools are the only way to improve classification and tagging to make their content more findable

n Better decision-making and faster customer service are given as the top benefits from improved search tools Only 14 were required to make a financial business case for search investment

n 42 consider that they have achieved payback from their investment in search tools within 12 months or less 62 achieved payback within 18 months

Discovery

n 53 of respondents agree that their legal discovery procedures are ldquoad hoc manual disruptive and expensiverdquo 28 have no policy process or precedent for legal discovery and legal hold

n 29 rely on instructions not to delete rather than more robust hold procedures 47 admit that their email retention and hold policies expose them to risk

n 74 rely on manual processes to manage the downstream legal discovery process 10 have dedicated legal-case products and 9 have a discovery workflow as part of ECM

Spending Plans

n On the whole users are likely to increase spend on all aspects of search and discovery in the next 12 months in particular content analytics mobile device apps and consolidation of multiple search tools

Search Drivers and StrategiesAs we suggested in the introduction searching for information is an aspect of most tasks and projects In some organizations it is a key element 37 of our respondents feel that search is ldquovitalrdquo to the productivity and effectiveness of their employees with a further 34 considering it an ldquoessentialrdquo requirement Research design customer response case-work litigation all have searching for information as a fundamental part of the day-to-day task and we all know that the inability to find an existing document within a short space of time will prompt the creation of a new one sapping productivity and inviting potential errors and non-compliance Decision-making in almost all areas of business is driven by the ability to find and assess past knowledge

Figure 1 How important is it in your organization for employees to have an effective way to search internal content and documents in order to carry out their tasks (N=351)

Despite the high importance attached to finding information we will see later (Figure 32) that over half the respondents report that employees can find external information more easily than internal

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 6

Search and Discovery

- exploiting knowledge m

inimizing risk

Levels of ECMThe success of content search is hugely dependent on the degree of content management in place Focusing content into a single repository rather than a scattered set of file shares will improve search targeting A well-defined taxonomy standardized metadata and a consistent classification scheme will improve findability As we will see later ECM systems will come with their own search modules of varying degrees of sophistication and potential connectivity to other repositories

There is a wide range of maturity in content management amongst our respondents As we can see in Figure 2 just over half have ECM systems with 11 using SharePoint exclusively 14 using other ECM systems and 27 using a combination of the two 48 have a mish- mash of file shares and unconnected repositories creating a bigger challenge for search capability

Figure 2 How would you describe your current enterprise content management (ECM) system(s) (N=253)

Levels of SearchAs a consequence despite the high importance attached to search 43 of respondents admit that they have only basic search tools and a further 39 can only search within discrete repositories creating issues of different logins different taxonomies and different presentation of search results Only 11 have enterprise search across the organization with a further 7 having a degree of unified search across departmental content Surprisingly these numbers are very consistent across all sizes of organization although the number of the largest organizations (greater than 5000 employees) with enterprise search drops to 8 It is fair to say that enterprise-wide search is more difficult to achieve across the larger enterprise with more repositories more content and more users

Figure 3 How good is your ability to search across your key content (Pick highest capability) (N=350)

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 7

Search and Discovery

- exploiting knowledge m

inimizing risk

Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4

Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)

While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search

OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 8

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)

For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28

Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents

Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 9

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)

As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy

Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis

Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 10

Search and Discovery

- exploiting knowledge m

inimizing risk

Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26

Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ

Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)

SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors

On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 11

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 9 Are security and permissions concerns for you in search (N=299)

Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability

Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department

Figure 10 Do you have any of the following (N=342 multiple)

We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 12

Search and Discovery

- exploiting knowledge m

inimizing risk

49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices

Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together

Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)

In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all

Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities

Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 13

Search and Discovery

- exploiting knowledge m

inimizing risk

Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below

Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)

Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion

Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)

Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 14

Search and Discovery

- exploiting knowledge m

inimizing risk

Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments

Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)

Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies

Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 4: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 3

Search and Discovery

- exploiting knowledge m

inimizing risk

Table of ContentsAbout the ResearchAbout the Research 1Process Used and Survey Demographics 1About AIIM 2About the Author 2

IntroductionIntroduction 4Key Findings 4

Search Drivers and StrategiesSearch Drivers and Strategies 5Levels of ECM 6Levels of Search 6Search Maturity 7Ownership 7

Search CharacteristicsSearch Characteristics 8Content Types and Repositories 9Security 10

Search CapabilitiesSearch Capabilities 11Search and Big DataContent Analytics 12

Dedicated or Advanced Search ToolsDedicated or Advanced Search Tools 12Have No Dedicated Tools 13Trigger for Search Investment 13Hosting Platform 14

Implementation and SupportImplementation and Support 15Support Staff 16Connectivity 17

Benefits of Enterprise SearchBenefits of Enterprise Search 19

DiscoveryDiscovery 20Hold 21Email Search and Hold 22Workflow 23Predictive Coding 23

Opinions and SpendOpinions and Spend 24Spend 24

Conclusion and RecommendationsConclusion and Recommendations 26Recommendations 26

Appendix 1 Survey DemographicsAppendix 1 Survey Demographics 27Survey Background 27Organizational Size 27Industry Sector 28Job Roles 28

Appendix 2 General CommentsAppendix 2 General Comments 29

UNDERWRITTEN IN PART BYUNDERWRITTEN IN PART BY 30Iron Mountain 30AIIM 31

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 4

Search and Discovery

- exploiting knowledge m

inimizing risk

IntroductionThe popularity of the term ldquoknowledge workerrdquo comes and goes but the single most-important characteristic of such a job-description is the ability to find information process it into knowledge and so add value for the organization Sounds simple and in the age of the internet finding and sifting information from the outside world is relatively simple and very quick However when it comes to information that resides inside the organization the situation can be very different and the effect of search efficiency on knowledge worker productivity can be huge

Of course inside the organizations things can be much messier than a set of websites that can be relatively easily connected and indexed Email archives multiple content systems documents stored in enterprise systems internal social media sound files image fileshellipto provide a comprehensive search these need to be connected indexed and preferably accessible from a single sign-on portal In addition for most users information stored in structured databases will need to be referenced alongside all of the unstructured content Added to that will be the expectation that all of this information can be searched and accessed on mobile devices The concept therefore of ldquoenterprise searchrdquo is an attractive one but one that is not that easy to achieve

There is of course another aspect of search that is more about finding the bad stuff than the good stuff Compliance audits freedom of information inquiries and legal discovery mandates require us to uncover all of the relevant electronically stored information - all of the references to customers suppliers contracts cases disputes etc and all of it preserved in a suitable context Often these exercises come out-of-the-blue and as we will see most organizations are poorly equipped to handle them

In this report we take an in-depth look at the importance of search the level of search tools deployed issues with their use and connection to other systems and mechanisms for legal discovery and hold

Key FindingsSearch Drivers

n For 71 of the organizations polled search is vital or essential yet only 18 have cross-repository search capabilities 58 show little or no sign of search maturity

n 75 of respondents would not disagree that information is easier to find outside of the organization than within 65 agree that employees struggle to access internal information from mobile devices Only 39 have natural language search

n Improved search is a priority over big datacontent analytics for 73 There is some movement (19) towards a unified search and big data strategy (although 59 have no big data strategy)

n The IT Department takes responsibility for search in 52 of organizations although only 25 feel it should be so 44 feel RMComplianceIG would be a better owner although there is also strong support for the concept of a Head of Knowledge Management (34) or Chief Knowledge Officer (29)

Search Tools

n 25 have no advanced or dedicated search tools 13 have five or more

n Those with advanced search tools are most likely (45) to acquire them through their ECM product or provider 42 of users have on-server search products outside of ECM including 14 using Open Source 21 are using a dedicated search appliance and 8 SaaS

n 38 have not tuned or optimized their search tool at all including 8 who have not even switched it on Half of responding organizations allocate less than half an FTE to support search applications Only 12 have used external expertise

n Beyond SharePoint intranet and ECM systems most content is beyond the scope of the search tools Only 19 have advanced search across email with less than 10 extending to other enterprise systems

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 5

Search and Discovery

- exploiting knowledge m

inimizing risk

n 47 feel that universal search and compliant e-discovery is becoming near impossible given the proliferation of cloud share and collaboration apps personal note systems and mobile devices 60 are firmly of the view that automated analytics tools are the only way to improve classification and tagging to make their content more findable

n Better decision-making and faster customer service are given as the top benefits from improved search tools Only 14 were required to make a financial business case for search investment

n 42 consider that they have achieved payback from their investment in search tools within 12 months or less 62 achieved payback within 18 months

Discovery

n 53 of respondents agree that their legal discovery procedures are ldquoad hoc manual disruptive and expensiverdquo 28 have no policy process or precedent for legal discovery and legal hold

n 29 rely on instructions not to delete rather than more robust hold procedures 47 admit that their email retention and hold policies expose them to risk

n 74 rely on manual processes to manage the downstream legal discovery process 10 have dedicated legal-case products and 9 have a discovery workflow as part of ECM

Spending Plans

n On the whole users are likely to increase spend on all aspects of search and discovery in the next 12 months in particular content analytics mobile device apps and consolidation of multiple search tools

Search Drivers and StrategiesAs we suggested in the introduction searching for information is an aspect of most tasks and projects In some organizations it is a key element 37 of our respondents feel that search is ldquovitalrdquo to the productivity and effectiveness of their employees with a further 34 considering it an ldquoessentialrdquo requirement Research design customer response case-work litigation all have searching for information as a fundamental part of the day-to-day task and we all know that the inability to find an existing document within a short space of time will prompt the creation of a new one sapping productivity and inviting potential errors and non-compliance Decision-making in almost all areas of business is driven by the ability to find and assess past knowledge

Figure 1 How important is it in your organization for employees to have an effective way to search internal content and documents in order to carry out their tasks (N=351)

Despite the high importance attached to finding information we will see later (Figure 32) that over half the respondents report that employees can find external information more easily than internal

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 6

Search and Discovery

- exploiting knowledge m

inimizing risk

Levels of ECMThe success of content search is hugely dependent on the degree of content management in place Focusing content into a single repository rather than a scattered set of file shares will improve search targeting A well-defined taxonomy standardized metadata and a consistent classification scheme will improve findability As we will see later ECM systems will come with their own search modules of varying degrees of sophistication and potential connectivity to other repositories

There is a wide range of maturity in content management amongst our respondents As we can see in Figure 2 just over half have ECM systems with 11 using SharePoint exclusively 14 using other ECM systems and 27 using a combination of the two 48 have a mish- mash of file shares and unconnected repositories creating a bigger challenge for search capability

Figure 2 How would you describe your current enterprise content management (ECM) system(s) (N=253)

Levels of SearchAs a consequence despite the high importance attached to search 43 of respondents admit that they have only basic search tools and a further 39 can only search within discrete repositories creating issues of different logins different taxonomies and different presentation of search results Only 11 have enterprise search across the organization with a further 7 having a degree of unified search across departmental content Surprisingly these numbers are very consistent across all sizes of organization although the number of the largest organizations (greater than 5000 employees) with enterprise search drops to 8 It is fair to say that enterprise-wide search is more difficult to achieve across the larger enterprise with more repositories more content and more users

Figure 3 How good is your ability to search across your key content (Pick highest capability) (N=350)

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 7

Search and Discovery

- exploiting knowledge m

inimizing risk

Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4

Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)

While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search

OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 8

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)

For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28

Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents

Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 9

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)

As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy

Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis

Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 10

Search and Discovery

- exploiting knowledge m

inimizing risk

Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26

Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ

Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)

SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors

On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 11

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 9 Are security and permissions concerns for you in search (N=299)

Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability

Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department

Figure 10 Do you have any of the following (N=342 multiple)

We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 12

Search and Discovery

- exploiting knowledge m

inimizing risk

49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices

Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together

Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)

In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all

Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities

Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 13

Search and Discovery

- exploiting knowledge m

inimizing risk

Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below

Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)

Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion

Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)

Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 14

Search and Discovery

- exploiting knowledge m

inimizing risk

Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments

Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)

Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies

Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 5: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 4

Search and Discovery

- exploiting knowledge m

inimizing risk

IntroductionThe popularity of the term ldquoknowledge workerrdquo comes and goes but the single most-important characteristic of such a job-description is the ability to find information process it into knowledge and so add value for the organization Sounds simple and in the age of the internet finding and sifting information from the outside world is relatively simple and very quick However when it comes to information that resides inside the organization the situation can be very different and the effect of search efficiency on knowledge worker productivity can be huge

Of course inside the organizations things can be much messier than a set of websites that can be relatively easily connected and indexed Email archives multiple content systems documents stored in enterprise systems internal social media sound files image fileshellipto provide a comprehensive search these need to be connected indexed and preferably accessible from a single sign-on portal In addition for most users information stored in structured databases will need to be referenced alongside all of the unstructured content Added to that will be the expectation that all of this information can be searched and accessed on mobile devices The concept therefore of ldquoenterprise searchrdquo is an attractive one but one that is not that easy to achieve

There is of course another aspect of search that is more about finding the bad stuff than the good stuff Compliance audits freedom of information inquiries and legal discovery mandates require us to uncover all of the relevant electronically stored information - all of the references to customers suppliers contracts cases disputes etc and all of it preserved in a suitable context Often these exercises come out-of-the-blue and as we will see most organizations are poorly equipped to handle them

In this report we take an in-depth look at the importance of search the level of search tools deployed issues with their use and connection to other systems and mechanisms for legal discovery and hold

Key FindingsSearch Drivers

n For 71 of the organizations polled search is vital or essential yet only 18 have cross-repository search capabilities 58 show little or no sign of search maturity

n 75 of respondents would not disagree that information is easier to find outside of the organization than within 65 agree that employees struggle to access internal information from mobile devices Only 39 have natural language search

n Improved search is a priority over big datacontent analytics for 73 There is some movement (19) towards a unified search and big data strategy (although 59 have no big data strategy)

n The IT Department takes responsibility for search in 52 of organizations although only 25 feel it should be so 44 feel RMComplianceIG would be a better owner although there is also strong support for the concept of a Head of Knowledge Management (34) or Chief Knowledge Officer (29)

Search Tools

n 25 have no advanced or dedicated search tools 13 have five or more

n Those with advanced search tools are most likely (45) to acquire them through their ECM product or provider 42 of users have on-server search products outside of ECM including 14 using Open Source 21 are using a dedicated search appliance and 8 SaaS

n 38 have not tuned or optimized their search tool at all including 8 who have not even switched it on Half of responding organizations allocate less than half an FTE to support search applications Only 12 have used external expertise

n Beyond SharePoint intranet and ECM systems most content is beyond the scope of the search tools Only 19 have advanced search across email with less than 10 extending to other enterprise systems

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 5

Search and Discovery

- exploiting knowledge m

inimizing risk

n 47 feel that universal search and compliant e-discovery is becoming near impossible given the proliferation of cloud share and collaboration apps personal note systems and mobile devices 60 are firmly of the view that automated analytics tools are the only way to improve classification and tagging to make their content more findable

n Better decision-making and faster customer service are given as the top benefits from improved search tools Only 14 were required to make a financial business case for search investment

n 42 consider that they have achieved payback from their investment in search tools within 12 months or less 62 achieved payback within 18 months

Discovery

n 53 of respondents agree that their legal discovery procedures are ldquoad hoc manual disruptive and expensiverdquo 28 have no policy process or precedent for legal discovery and legal hold

n 29 rely on instructions not to delete rather than more robust hold procedures 47 admit that their email retention and hold policies expose them to risk

n 74 rely on manual processes to manage the downstream legal discovery process 10 have dedicated legal-case products and 9 have a discovery workflow as part of ECM

Spending Plans

n On the whole users are likely to increase spend on all aspects of search and discovery in the next 12 months in particular content analytics mobile device apps and consolidation of multiple search tools

Search Drivers and StrategiesAs we suggested in the introduction searching for information is an aspect of most tasks and projects In some organizations it is a key element 37 of our respondents feel that search is ldquovitalrdquo to the productivity and effectiveness of their employees with a further 34 considering it an ldquoessentialrdquo requirement Research design customer response case-work litigation all have searching for information as a fundamental part of the day-to-day task and we all know that the inability to find an existing document within a short space of time will prompt the creation of a new one sapping productivity and inviting potential errors and non-compliance Decision-making in almost all areas of business is driven by the ability to find and assess past knowledge

Figure 1 How important is it in your organization for employees to have an effective way to search internal content and documents in order to carry out their tasks (N=351)

Despite the high importance attached to finding information we will see later (Figure 32) that over half the respondents report that employees can find external information more easily than internal

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 6

Search and Discovery

- exploiting knowledge m

inimizing risk

Levels of ECMThe success of content search is hugely dependent on the degree of content management in place Focusing content into a single repository rather than a scattered set of file shares will improve search targeting A well-defined taxonomy standardized metadata and a consistent classification scheme will improve findability As we will see later ECM systems will come with their own search modules of varying degrees of sophistication and potential connectivity to other repositories

There is a wide range of maturity in content management amongst our respondents As we can see in Figure 2 just over half have ECM systems with 11 using SharePoint exclusively 14 using other ECM systems and 27 using a combination of the two 48 have a mish- mash of file shares and unconnected repositories creating a bigger challenge for search capability

Figure 2 How would you describe your current enterprise content management (ECM) system(s) (N=253)

Levels of SearchAs a consequence despite the high importance attached to search 43 of respondents admit that they have only basic search tools and a further 39 can only search within discrete repositories creating issues of different logins different taxonomies and different presentation of search results Only 11 have enterprise search across the organization with a further 7 having a degree of unified search across departmental content Surprisingly these numbers are very consistent across all sizes of organization although the number of the largest organizations (greater than 5000 employees) with enterprise search drops to 8 It is fair to say that enterprise-wide search is more difficult to achieve across the larger enterprise with more repositories more content and more users

Figure 3 How good is your ability to search across your key content (Pick highest capability) (N=350)

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 7

Search and Discovery

- exploiting knowledge m

inimizing risk

Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4

Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)

While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search

OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 8

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)

For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28

Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents

Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 9

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)

As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy

Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis

Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 10

Search and Discovery

- exploiting knowledge m

inimizing risk

Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26

Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ

Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)

SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors

On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 11

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 9 Are security and permissions concerns for you in search (N=299)

Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability

Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department

Figure 10 Do you have any of the following (N=342 multiple)

We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 12

Search and Discovery

- exploiting knowledge m

inimizing risk

49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices

Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together

Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)

In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all

Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities

Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 13

Search and Discovery

- exploiting knowledge m

inimizing risk

Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below

Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)

Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion

Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)

Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 14

Search and Discovery

- exploiting knowledge m

inimizing risk

Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments

Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)

Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies

Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 6: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 5

Search and Discovery

- exploiting knowledge m

inimizing risk

n 47 feel that universal search and compliant e-discovery is becoming near impossible given the proliferation of cloud share and collaboration apps personal note systems and mobile devices 60 are firmly of the view that automated analytics tools are the only way to improve classification and tagging to make their content more findable

n Better decision-making and faster customer service are given as the top benefits from improved search tools Only 14 were required to make a financial business case for search investment

n 42 consider that they have achieved payback from their investment in search tools within 12 months or less 62 achieved payback within 18 months

Discovery

n 53 of respondents agree that their legal discovery procedures are ldquoad hoc manual disruptive and expensiverdquo 28 have no policy process or precedent for legal discovery and legal hold

n 29 rely on instructions not to delete rather than more robust hold procedures 47 admit that their email retention and hold policies expose them to risk

n 74 rely on manual processes to manage the downstream legal discovery process 10 have dedicated legal-case products and 9 have a discovery workflow as part of ECM

Spending Plans

n On the whole users are likely to increase spend on all aspects of search and discovery in the next 12 months in particular content analytics mobile device apps and consolidation of multiple search tools

Search Drivers and StrategiesAs we suggested in the introduction searching for information is an aspect of most tasks and projects In some organizations it is a key element 37 of our respondents feel that search is ldquovitalrdquo to the productivity and effectiveness of their employees with a further 34 considering it an ldquoessentialrdquo requirement Research design customer response case-work litigation all have searching for information as a fundamental part of the day-to-day task and we all know that the inability to find an existing document within a short space of time will prompt the creation of a new one sapping productivity and inviting potential errors and non-compliance Decision-making in almost all areas of business is driven by the ability to find and assess past knowledge

Figure 1 How important is it in your organization for employees to have an effective way to search internal content and documents in order to carry out their tasks (N=351)

Despite the high importance attached to finding information we will see later (Figure 32) that over half the respondents report that employees can find external information more easily than internal

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 6

Search and Discovery

- exploiting knowledge m

inimizing risk

Levels of ECMThe success of content search is hugely dependent on the degree of content management in place Focusing content into a single repository rather than a scattered set of file shares will improve search targeting A well-defined taxonomy standardized metadata and a consistent classification scheme will improve findability As we will see later ECM systems will come with their own search modules of varying degrees of sophistication and potential connectivity to other repositories

There is a wide range of maturity in content management amongst our respondents As we can see in Figure 2 just over half have ECM systems with 11 using SharePoint exclusively 14 using other ECM systems and 27 using a combination of the two 48 have a mish- mash of file shares and unconnected repositories creating a bigger challenge for search capability

Figure 2 How would you describe your current enterprise content management (ECM) system(s) (N=253)

Levels of SearchAs a consequence despite the high importance attached to search 43 of respondents admit that they have only basic search tools and a further 39 can only search within discrete repositories creating issues of different logins different taxonomies and different presentation of search results Only 11 have enterprise search across the organization with a further 7 having a degree of unified search across departmental content Surprisingly these numbers are very consistent across all sizes of organization although the number of the largest organizations (greater than 5000 employees) with enterprise search drops to 8 It is fair to say that enterprise-wide search is more difficult to achieve across the larger enterprise with more repositories more content and more users

Figure 3 How good is your ability to search across your key content (Pick highest capability) (N=350)

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 7

Search and Discovery

- exploiting knowledge m

inimizing risk

Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4

Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)

While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search

OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 8

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)

For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28

Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents

Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 9

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)

As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy

Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis

Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 10

Search and Discovery

- exploiting knowledge m

inimizing risk

Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26

Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ

Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)

SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors

On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 11

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 9 Are security and permissions concerns for you in search (N=299)

Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability

Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department

Figure 10 Do you have any of the following (N=342 multiple)

We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 12

Search and Discovery

- exploiting knowledge m

inimizing risk

49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices

Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together

Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)

In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all

Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities

Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 13

Search and Discovery

- exploiting knowledge m

inimizing risk

Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below

Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)

Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion

Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)

Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 14

Search and Discovery

- exploiting knowledge m

inimizing risk

Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments

Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)

Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies

Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 7: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 6

Search and Discovery

- exploiting knowledge m

inimizing risk

Levels of ECMThe success of content search is hugely dependent on the degree of content management in place Focusing content into a single repository rather than a scattered set of file shares will improve search targeting A well-defined taxonomy standardized metadata and a consistent classification scheme will improve findability As we will see later ECM systems will come with their own search modules of varying degrees of sophistication and potential connectivity to other repositories

There is a wide range of maturity in content management amongst our respondents As we can see in Figure 2 just over half have ECM systems with 11 using SharePoint exclusively 14 using other ECM systems and 27 using a combination of the two 48 have a mish- mash of file shares and unconnected repositories creating a bigger challenge for search capability

Figure 2 How would you describe your current enterprise content management (ECM) system(s) (N=253)

Levels of SearchAs a consequence despite the high importance attached to search 43 of respondents admit that they have only basic search tools and a further 39 can only search within discrete repositories creating issues of different logins different taxonomies and different presentation of search results Only 11 have enterprise search across the organization with a further 7 having a degree of unified search across departmental content Surprisingly these numbers are very consistent across all sizes of organization although the number of the largest organizations (greater than 5000 employees) with enterprise search drops to 8 It is fair to say that enterprise-wide search is more difficult to achieve across the larger enterprise with more repositories more content and more users

Figure 3 How good is your ability to search across your key content (Pick highest capability) (N=350)

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 7

Search and Discovery

- exploiting knowledge m

inimizing risk

Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4

Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)

While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search

OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 8

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)

For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28

Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents

Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 9

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)

As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy

Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis

Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 10

Search and Discovery

- exploiting knowledge m

inimizing risk

Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26

Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ

Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)

SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors

On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 11

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 9 Are security and permissions concerns for you in search (N=299)

Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability

Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department

Figure 10 Do you have any of the following (N=342 multiple)

We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 12

Search and Discovery

- exploiting knowledge m

inimizing risk

49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices

Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together

Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)

In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all

Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities

Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 13

Search and Discovery

- exploiting knowledge m

inimizing risk

Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below

Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)

Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion

Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)

Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 14

Search and Discovery

- exploiting knowledge m

inimizing risk

Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments

Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)

Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies

Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 8: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 7

Search and Discovery

- exploiting knowledge m

inimizing risk

Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4

Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)

While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search

OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present

Vital to our producvity

effecveness and compliance 37

An essenal requirement 34

Quite important 21

Helpful 7

Not that important 1

We rely solely on file shares and network drives

15

We have a number of

unconnected document

content and scanned-file

repositories 33

SharePoint is our primary content

management system 11

We have a combinaon of SharePoint and other content systems 27

We have a non-SharePoint ECM

system as our primary system

14

We have disparate

content stores and only basic

search tools 43

We have search tools within

discrete repositories 39

We have a unified search

capability across departmental content 7

We have enterprise search capability across the organizaon

11

0 10 20 30 40 50 60

An agreed search strategy across theorganizaon

A specific budget for search

An acknowledged owner of search-relatedissues

Dedicated and trained staff supporngsearch

An agreed corporate taxonomy orvocabulary of terms

A metadata standard across differentrepositories

None of these

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 8

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)

For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28

Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents

Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 9

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)

As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy

Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis

Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 10

Search and Discovery

- exploiting knowledge m

inimizing risk

Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26

Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ

Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)

SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors

On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 11

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 9 Are security and permissions concerns for you in search (N=299)

Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability

Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department

Figure 10 Do you have any of the following (N=342 multiple)

We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 12

Search and Discovery

- exploiting knowledge m

inimizing risk

49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices

Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together

Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)

In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all

Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities

Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 13

Search and Discovery

- exploiting knowledge m

inimizing risk

Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below

Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)

Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion

Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)

Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 14

Search and Discovery

- exploiting knowledge m

inimizing risk

Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments

Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)

Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies

Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 9: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 8

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)

For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28

Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents

Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 9

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)

As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy

Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis

Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 10

Search and Discovery

- exploiting knowledge m

inimizing risk

Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26

Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ

Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)

SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors

On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 11

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 9 Are security and permissions concerns for you in search (N=299)

Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability

Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department

Figure 10 Do you have any of the following (N=342 multiple)

We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 12

Search and Discovery

- exploiting knowledge m

inimizing risk

49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices

Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together

Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)

In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all

Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities

Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 13

Search and Discovery

- exploiting knowledge m

inimizing risk

Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below

Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)

Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion

Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)

Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 14

Search and Discovery

- exploiting knowledge m

inimizing risk

Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments

Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)

Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies

Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 10: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 9

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)

As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy

Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis

Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 10

Search and Discovery

- exploiting knowledge m

inimizing risk

Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26

Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ

Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)

SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors

On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 11

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 9 Are security and permissions concerns for you in search (N=299)

Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability

Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department

Figure 10 Do you have any of the following (N=342 multiple)

We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 12

Search and Discovery

- exploiting knowledge m

inimizing risk

49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices

Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together

Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)

In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all

Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities

Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 13

Search and Discovery

- exploiting knowledge m

inimizing risk

Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below

Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)

Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion

Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)

Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 14

Search and Discovery

- exploiting knowledge m

inimizing risk

Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments

Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)

Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies

Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 11: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 10

Search and Discovery

- exploiting knowledge m

inimizing risk

Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26

Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ

Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)

SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors

On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security

0 10 20 30 40 50 60 70 80 90

IT Department

Records ManagementComplianceIG

CIO

Head of Informa on Management

Legal

Corporate Communica ons

HR

Chief Librarian

Search IM or KM steering group

Head of Knowledge Management

Chief Knowledge Officer (CKO)

Takes Should take Should take if we had one

0 10 20 30 40 50 60 70

Search for recorded rdquoknowledgerdquo or business intelligence

General search across emails

Search for customer-related content

Compliance-related audit searchSearch for data sheets or informaon

resources

Search for legal discoverySearch for freedom of informaon (FOIFOIA)

disclosure

Search for plantasset-related content

Forensic caseclaims-related search

Scienfic or patent-related search

0 20 40 60 80 100

Office documents (eg DOC XLS PPT)

PDF files

Emails

ScannedOCR documents

Structured content in corporate databases

Drawings or maps

Photo images

Video

Social network text

Sound

0 20 40 60 80 100

Email systems

File shares

Docs within enterprise systems (ERP CRM HR etc)

Structured (database) content in enterprise systems

Non-SharePoint ECMDMRM systems

Corporate intranet

SharePoint system(s)

Data warehouses BI reports

Other LOB systems

Cloud-based content stores or SaaS systems

Staff directoriesprofiles

Outsourced contentrecords stores

Messaging systemschat

Blogs and communies

Internal social streams (Yammer Chaer Jive etc)

Vital Important Not so important

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 11

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 9 Are security and permissions concerns for you in search (N=299)

Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability

Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department

Figure 10 Do you have any of the following (N=342 multiple)

We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 12

Search and Discovery

- exploiting knowledge m

inimizing risk

49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices

Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together

Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)

In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all

Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities

Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 13

Search and Discovery

- exploiting knowledge m

inimizing risk

Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below

Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)

Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion

Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)

Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 14

Search and Discovery

- exploiting knowledge m

inimizing risk

Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments

Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)

Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies

Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 12: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 11

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 9 Are security and permissions concerns for you in search (N=299)

Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability

Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department

Figure 10 Do you have any of the following (N=342 multiple)

We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 12

Search and Discovery

- exploiting knowledge m

inimizing risk

49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices

Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together

Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)

In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all

Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities

Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 13

Search and Discovery

- exploiting knowledge m

inimizing risk

Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below

Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)

Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion

Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)

Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 14

Search and Discovery

- exploiting knowledge m

inimizing risk

Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments

Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)

Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies

Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 13: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 12

Search and Discovery

- exploiting knowledge m

inimizing risk

49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices

Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together

Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)

In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all

Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities

Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 13

Search and Discovery

- exploiting knowledge m

inimizing risk

Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below

Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)

Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion

Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)

Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 14

Search and Discovery

- exploiting knowledge m

inimizing risk

Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments

Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)

Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies

Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 14: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 13

Search and Discovery

- exploiting knowledge m

inimizing risk

Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below

Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)

Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion

Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)

Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making

Not really an issue 3

Need to take account 25

Major concern 41

Show-stopper 31

0 10 20 30 40 50

SharePoint connected to mulplerepositories as an accesssearch portal

Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal

A stand-alone search portal connected tomulple repositories

App-based search of on-premise contentfrom mobile devices

On-premise search of cloud-basedrepositories

Cloud-basedSaaS search of on-premisecloud repositories

None of these

We need search first then wersquoll

look at analycs 49

We have search and are

looking at analycs 13

We are looking to build-out our search tools to analycs 11

We are moving ahead with

both together 12

We are priorizing

analycs over search 11

We already have both 5

0 5 10 15 20 25 30

None

One

Two

Three

Four

Five or more

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 14

Search and Discovery

- exploiting knowledge m

inimizing risk

Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments

Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)

Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies

Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 15: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 14

Search and Discovery

- exploiting knowledge m

inimizing risk

Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments

Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)

Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies

Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 16: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 15

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)

Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively

Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure

It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 17: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 16

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)

Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees

Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)

Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries

Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on

0 5 10 15 20 25 30 35 40

We are invesgang right now

It needs support resource to get the bestresults and we have higher priories

Itrsquos something wersquove never really made a careful evaluaon of

It would be hard to jusfy spending the moneyneeded to get something more effecve

Hard to know which department wouldsponsor this

Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)

Dont know

0 10 20 30 40 50 60

As part of an ECMDMRM project

Iniave from above to improve quality ofdecision-making

Compliance failure

General evaluaon of infrastructure

Major ligaon case

Failure to meet mescales under FOI enquiry

Reorganizaon of scienfic or engineeringprocesses

Exercise to reduce costs in legal department

HR iniave to improve skills sourcing

Increased patent acvity (proacve ordefense)

0 20 40 60

Advanced search capability fromour ECM vendor

On-server search applicaonoutside of ECM

On-server product based on OpenSource

Locally developed Open Sourcesearch capability

Dedicated search appliance or box

Cloud-basedSaaS search tools

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

No one takes much interest in it

We have a number of tools each used bysmall groups

We have advanced capability but we havenrsquot turned it on as yet

We use it prey much as suppliedout-of-the-box

We set parameters and populatedtaxonomies at the start but not since

We consulted users across the organizaon toassess needs

We have connuous monitoring andopmizaon in place

We useused external service partners to help

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 18: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 17

Search and Discovery

- exploiting knowledge m

inimizing risk

It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations

Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)

Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products

Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)

ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 19: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 18

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)

Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard

Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)

0 5 10 15 20 25 30 35 40

None

Less than 05 FTE

One FTE

Two FTEs

Three FTEs

More than 3 FTEs

10-500 emps500-5000 emps5000+ emps

0 5 10 15 20 25 30 35

Server deployment and maintenance

Taxonomy management

User training on the tool

Correcng updang or standardizing metadata

Connecon interfaces to other repositories

Improving user interface

Tuning for relevancy

Protecng against security breaches

Monitoring search logs

Language issues

Itrsquos not an issue for us 6

Only a problem if results are inconsistent

16

We need to know in general

terms 29

We need full transparency

21

We need to be able to see it and

tune it ourselves 28

0 10 20 30 40

Only the one nave systemSharePoint system

IntranetNon-SharePoint ECM system(s)

Email serverRM system

Imaging systemOther line of business system(s)

Internal social system(s)ERPFinanceManufacturing

Help desksupport systemHR system

Project Management systemCloudSaaS system(s)

CRM systemBIReportsData warehouse

Instant messaging server

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 20: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 19

Search and Discovery

- exploiting knowledge m

inimizing risk

Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure

Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)

In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI

Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 21: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 20

Search and Discovery

- exploiting knowledge m

inimizing risk

As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report

Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits

(N=69 Excl 114 Donrsquot Know or Too Early to Say)

62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers

DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)

However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe

Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government

0 10 20 30 40

Purchase standard connectors from vendor

Purchase customized connectors from vendor

Have customized connectors developed by3rd party

Develop connectors in-house using APIs

Develop connectors in-house using OpenSourceCMIS

Acquire connectors as part of big datacontent analycs tools

0 5 10 15 20 25 30 35

Yes a financial case

Yes in general business benefits

Yes specifically for legal discovery

Yes specifically for Freedom of Informaonprocessing

Yes as part of a Big Data project

No - it is considered to be part of theinfrastructure

No - included in our ECM product

0 5 10 15 20 25 30 35 40 45 50

Beer decision-making

Faster and more accurate customer serviceresponse

Fewer complaints from knowledge workers

Faster and more efficient legal discovery

Improved research project and case outcomes

Simpler more natural querying

Faster compliance and financial audits

Turned our email archives from a liability to anasset

Faster and more compliant FOI process

6 months 22

12 months 20

18 months 20

2 years 22

3 years 7

More than 3 years 9

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 22: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 21

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)

Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records

Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products

Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)

HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 23: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 22

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)

Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings

Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)

For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

0 10 20 30 40 50 60

Internal compliance audits

Pre-trial legal discovery

Financial audits

Regulatory invesgaons

Court requests for documents

Freedom of Informaon requests

Patent cases

None of these

0 10 20 30 40 50

We have no declared policy or precedentfor this

We have a long-standing policy but it isntup-to-date with electronic content

Manual search across a mixture of paperand electronic content

Individual search within each repository

One-stop enterprise search acrossmulple repositories

Specialized e-discovery product

Custom-built e-discoveryhold mechanism

0 5 10 15 20 25 30 35

No policy or process

We instruct content owners not to delete

We manually move them to a secure area

We manually flag them in-place for non-deleon

Our ECMRM system has manage-in-placeacross mulple repositories

Custom built e-discoveryhold mechanism

Our searchdiscovery tool has the ability toput them on hold

0 5 10 15 20 25 30 35 40

Our email retenon is somewhat ad hocso results are unreliable

Search within the mail client but withmanual holds

Search within a dedicated email archivebut search and hold is limited

Search and hold in our dedicated emailarchive

We archive our important emails to ourECMRM system and can hold there

Dedicated searche-discovery system thatconnects to our email repositories

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 24: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 23

Search and Discovery

- exploiting knowledge m

inimizing risk

WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery

Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)

Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging

Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages

(N=190 Excl 73 Donrsquot Know 76 No)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 25: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 24

Search and Discovery

- exploiting knowledge m

inimizing risk

Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk

Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree

A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging

Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)

SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 26: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 25

Search and Discovery

- exploiting knowledge m

inimizing risk

Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)

In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application

Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last

12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Yes as a dedicated e-discoverylegalcase-process product 10

Yes as part of our ECMRM system 9

Yes as part of our FOI case processing

system 2

Yes as part of our search product

3

Yes as an in-house custom

development 3

No Manual process 74

0 2 4 6 8 10

Yes ndash very successfully

Yes ndash itrsquos helping

Yes ndash early days

Planning in 12-18 months

Early Assesment

Targeted Collecons

-40 -20 0 20 40 60 80

The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making

universal search and compliant e-discovery nearimpossible

Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk

Our employees can find informaon from outside ofthe organisaon far more easily than the informaon

we own

Most of our employees struggle to search and accessinternal informaon from mobile devices

Our legal discovery procedures are ad hoc manualdisrupve and expensive

The only way to make our content more findable is touse automated analycs tools to improve classificaon

and tagging

Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree

Advanced search capability from our ECM vendor

On-server search applicaon outside of ECM

Consolidang mulple tools to a single enterprisesearch

Dedicated search-server box

Locally developed Open Source search capability

CloudSaaS search

Mobile device search apps

Connector purchasedevelopment

Visual discoveryimage search

Big Datacontent analycs tools

Less Same More

-5 0 5 10 15 20 25

Big Datacontent analycs tools

Mobile device search apps

Consolidang mulple tools to a singleenterprise search

Advanced search capability from our ECMvendor

CloudSaaS search

Connector purchasedevelopment

On-server search applicaon outside of ECM

Visual discoveryimage search

Dedicated search-server box

Locally developed Open Source searchcapability

-40 -30 -20 -10 0 10 20 30 40

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 27: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 26

Search and Discovery

- exploiting knowledge m

inimizing risk

Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data

Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet

The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe

Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo

Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review

Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and

information governance

n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management

n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met

n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results

n Look to connect your ECM system search to other repositories to provide a single-point search portal

n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product

n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy

n Include end-user training in search techniques in order to maximize the benefits from your search tools

n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email

n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process

n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 28: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 27

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 1 Survey Demographics

Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members

Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents

Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 29: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 28

Search and Discovery

- exploiting knowledge m

inimizing risk

Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split

Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

11-100 emps 14

101-500 emps 21

501-1000 emps 11

1001-5000 emps 24

5001-10000 emps 10

over 10000 emps 20

US 55

Canada 12

UK Ireland 10

Mainland Europe 8

Australasia 7

Middle East Africa SAfrica

4

Asia Far East 3 Central

SAmerica 2

Government amp Public Services -LocalState 18

Government amp Public Agencies - NaonalInternaonal 11

Finance Banking Insurance 15

Energy Oil amp Gas Mining 8IT amp High Tech -

not ECM 6

Telecoms Water Ulies 6

Consultants 6

Manufacturing Aerospace Food

Process 5

Educaon 4

Retail Transport Real Estate 4

Document Services Provider 3

Healthcare 3

Legal and Prof Services 3

Engineering amp Construcon 2

Life Science Pharmaceucal 2

Non-Profit Charity 2

Media Entertainment Publishing 1 Other 4

IT staff 15

Head of IT 2

IT Consultant or Project Manager

12

Records or document management staff

24

Head of records compliance info

management 19

Line-of-business execuve

department head or process owner

8

Business Consultant 7

Intranet Manager Internal PR

Comms Director 3

President CEO Managing

Director 2

Legal Corp Counsel Corp Compliance 2 Other 5

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 30: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 29

Search and Discovery

- exploiting knowledge m

inimizing risk

Appendix 2 General Comments

Do you have any general comments to make about your enterprise search and discovery experiences (Selective)

n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it

n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities

n We donrsquot want to spend time for manual classification or indexing

n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else

n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories

n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy

n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support

n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 31: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 30

Search and Discovery

- exploiting knowledge m

inimizing risk

UNDERWRITTEN IN PART BY

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to

Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats

Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible

Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations

wwwironmountaincom

About Iron Mountain

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu

Page 32: Search and Discovery - Iron Mountain · 2019-04-01 · n Beyond SharePoint, intranet and ECM systems, most content is beyond the scope of the search tools. Only 19% have advanced

Industry

Watch

copy2014 AIIM - The Global Community of Information Professionals 31

Search and Discovery

- exploiting knowledge m

inimizing risk

Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees

AIIM Enterpise Content Management (ECM) Resource Centre

wwwaiimorgResource-CentersEnterprise-Content-Management

AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data

copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu