search and discovery - iron mountain · 2019-04-01 · n beyond sharepoint, intranet and ecm...
Post on 15-Jul-2020
0 Views
Preview:
TRANSCRIPT
AIIM Market IntelligenceDelivering the priorities and opinions of AIIMrsquos 80000 community
Search and Discovery- exploiting knowledge minimizing risk
aiimorg l 3015878202
Industry
Watch
Underwritten in part by
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 1
Search and Discovery
- exploiting knowledge m
inimizing risk
About the ResearchAs the non-profit association dedicated to nurturing growing and supporting the information management community AIIM is proud to provide this research at no charge In this way the entire community can leverage the education thought leadership and direction provided by our work We would like these research findings to be as widely distributed as possible Feel free to use individual elements of this research in presentations and publications with the attribution ndash ldquocopy AIIM 2014 wwwaiimorgrdquo
Rather than redistribute a copy of this report to your colleagues or clients we would prefer that you direct them to wwwaiimorgresearch for a download of their own Permission is not given for other aggregators to host this report on their own website
Our ability to deliver such high-quality research is partially made possible by our underwriting companies without whom we would have to return to a paid subscription model For that we hope you will join us in thanking our underwriters who are
Process Used and Survey DemographicsWhile we appreciate the support of these sponsors we also greatly value our objectivity and independence as a non-profit industry association The results of the survey and the market commentary made in this report are independent of any bias from the vendor community
The survey was taken using a web-based tool by 415 individual members of the AIIM community between Jul 11 and Aug 02 2014 Invitations to take the survey were sent via e-mail to a selection of the 80000 AIIM community members
Survey demographics can be found in Appendix 1 Graphs throughout the report exclude responses from organizations with less than 10 employees and suppliers of ECM products and services taking the number of respondents to 353
Iron Mountain745 Atlantic Avenue Boston MA 02111Tel +1 800-899-5766Web wwwironmountaincom
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 2
Search and Discovery
- exploiting knowledge m
inimizing risk
About AIIMAIIM has been an advocate and supporter of information professionals for 70 years The association mission is to ensure that information professionals understand the current and future challenges of managing information assets in an era of social mobile cloud and big data AIIM builds on a strong heritage of research and member service Today AIIM is a global non-profit organization that provides independent research education and certification programs to information professionals AIIM represents the entire information management community practitioners technology suppliers integrators and consultants
About the AuthorDoug Miles is head of the AIIM Market Intelligence Division He has over 30 yearsrsquo experience of working with users and vendors across a broad spectrum of IT applications He was an early pioneer of document management systems for business and engineering applications and has produced many AIIM survey reports on issues and drivers for Capture ECM Records Management SharePoint Mobile Cloud Social Business and Big Data Doug has also worked closely with other enterprise-level IT systems such as ERP BI and CRM Doug has an MSc in Communications Engineering and is a member of the IET in the UK
copy 2014AIIM The Global Community of Information Professionals1100 Wayne Avenue Suite 1100Silver Spring MD 20910+13015878202wwwaiimorg
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 3
Search and Discovery
- exploiting knowledge m
inimizing risk
Table of ContentsAbout the ResearchAbout the Research 1Process Used and Survey Demographics 1About AIIM 2About the Author 2
IntroductionIntroduction 4Key Findings 4
Search Drivers and StrategiesSearch Drivers and Strategies 5Levels of ECM 6Levels of Search 6Search Maturity 7Ownership 7
Search CharacteristicsSearch Characteristics 8Content Types and Repositories 9Security 10
Search CapabilitiesSearch Capabilities 11Search and Big DataContent Analytics 12
Dedicated or Advanced Search ToolsDedicated or Advanced Search Tools 12Have No Dedicated Tools 13Trigger for Search Investment 13Hosting Platform 14
Implementation and SupportImplementation and Support 15Support Staff 16Connectivity 17
Benefits of Enterprise SearchBenefits of Enterprise Search 19
DiscoveryDiscovery 20Hold 21Email Search and Hold 22Workflow 23Predictive Coding 23
Opinions and SpendOpinions and Spend 24Spend 24
Conclusion and RecommendationsConclusion and Recommendations 26Recommendations 26
Appendix 1 Survey DemographicsAppendix 1 Survey Demographics 27Survey Background 27Organizational Size 27Industry Sector 28Job Roles 28
Appendix 2 General CommentsAppendix 2 General Comments 29
UNDERWRITTEN IN PART BYUNDERWRITTEN IN PART BY 30Iron Mountain 30AIIM 31
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 4
Search and Discovery
- exploiting knowledge m
inimizing risk
IntroductionThe popularity of the term ldquoknowledge workerrdquo comes and goes but the single most-important characteristic of such a job-description is the ability to find information process it into knowledge and so add value for the organization Sounds simple and in the age of the internet finding and sifting information from the outside world is relatively simple and very quick However when it comes to information that resides inside the organization the situation can be very different and the effect of search efficiency on knowledge worker productivity can be huge
Of course inside the organizations things can be much messier than a set of websites that can be relatively easily connected and indexed Email archives multiple content systems documents stored in enterprise systems internal social media sound files image fileshellipto provide a comprehensive search these need to be connected indexed and preferably accessible from a single sign-on portal In addition for most users information stored in structured databases will need to be referenced alongside all of the unstructured content Added to that will be the expectation that all of this information can be searched and accessed on mobile devices The concept therefore of ldquoenterprise searchrdquo is an attractive one but one that is not that easy to achieve
There is of course another aspect of search that is more about finding the bad stuff than the good stuff Compliance audits freedom of information inquiries and legal discovery mandates require us to uncover all of the relevant electronically stored information - all of the references to customers suppliers contracts cases disputes etc and all of it preserved in a suitable context Often these exercises come out-of-the-blue and as we will see most organizations are poorly equipped to handle them
In this report we take an in-depth look at the importance of search the level of search tools deployed issues with their use and connection to other systems and mechanisms for legal discovery and hold
Key FindingsSearch Drivers
n For 71 of the organizations polled search is vital or essential yet only 18 have cross-repository search capabilities 58 show little or no sign of search maturity
n 75 of respondents would not disagree that information is easier to find outside of the organization than within 65 agree that employees struggle to access internal information from mobile devices Only 39 have natural language search
n Improved search is a priority over big datacontent analytics for 73 There is some movement (19) towards a unified search and big data strategy (although 59 have no big data strategy)
n The IT Department takes responsibility for search in 52 of organizations although only 25 feel it should be so 44 feel RMComplianceIG would be a better owner although there is also strong support for the concept of a Head of Knowledge Management (34) or Chief Knowledge Officer (29)
Search Tools
n 25 have no advanced or dedicated search tools 13 have five or more
n Those with advanced search tools are most likely (45) to acquire them through their ECM product or provider 42 of users have on-server search products outside of ECM including 14 using Open Source 21 are using a dedicated search appliance and 8 SaaS
n 38 have not tuned or optimized their search tool at all including 8 who have not even switched it on Half of responding organizations allocate less than half an FTE to support search applications Only 12 have used external expertise
n Beyond SharePoint intranet and ECM systems most content is beyond the scope of the search tools Only 19 have advanced search across email with less than 10 extending to other enterprise systems
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 5
Search and Discovery
- exploiting knowledge m
inimizing risk
n 47 feel that universal search and compliant e-discovery is becoming near impossible given the proliferation of cloud share and collaboration apps personal note systems and mobile devices 60 are firmly of the view that automated analytics tools are the only way to improve classification and tagging to make their content more findable
n Better decision-making and faster customer service are given as the top benefits from improved search tools Only 14 were required to make a financial business case for search investment
n 42 consider that they have achieved payback from their investment in search tools within 12 months or less 62 achieved payback within 18 months
Discovery
n 53 of respondents agree that their legal discovery procedures are ldquoad hoc manual disruptive and expensiverdquo 28 have no policy process or precedent for legal discovery and legal hold
n 29 rely on instructions not to delete rather than more robust hold procedures 47 admit that their email retention and hold policies expose them to risk
n 74 rely on manual processes to manage the downstream legal discovery process 10 have dedicated legal-case products and 9 have a discovery workflow as part of ECM
Spending Plans
n On the whole users are likely to increase spend on all aspects of search and discovery in the next 12 months in particular content analytics mobile device apps and consolidation of multiple search tools
Search Drivers and StrategiesAs we suggested in the introduction searching for information is an aspect of most tasks and projects In some organizations it is a key element 37 of our respondents feel that search is ldquovitalrdquo to the productivity and effectiveness of their employees with a further 34 considering it an ldquoessentialrdquo requirement Research design customer response case-work litigation all have searching for information as a fundamental part of the day-to-day task and we all know that the inability to find an existing document within a short space of time will prompt the creation of a new one sapping productivity and inviting potential errors and non-compliance Decision-making in almost all areas of business is driven by the ability to find and assess past knowledge
Figure 1 How important is it in your organization for employees to have an effective way to search internal content and documents in order to carry out their tasks (N=351)
Despite the high importance attached to finding information we will see later (Figure 32) that over half the respondents report that employees can find external information more easily than internal
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 6
Search and Discovery
- exploiting knowledge m
inimizing risk
Levels of ECMThe success of content search is hugely dependent on the degree of content management in place Focusing content into a single repository rather than a scattered set of file shares will improve search targeting A well-defined taxonomy standardized metadata and a consistent classification scheme will improve findability As we will see later ECM systems will come with their own search modules of varying degrees of sophistication and potential connectivity to other repositories
There is a wide range of maturity in content management amongst our respondents As we can see in Figure 2 just over half have ECM systems with 11 using SharePoint exclusively 14 using other ECM systems and 27 using a combination of the two 48 have a mish- mash of file shares and unconnected repositories creating a bigger challenge for search capability
Figure 2 How would you describe your current enterprise content management (ECM) system(s) (N=253)
Levels of SearchAs a consequence despite the high importance attached to search 43 of respondents admit that they have only basic search tools and a further 39 can only search within discrete repositories creating issues of different logins different taxonomies and different presentation of search results Only 11 have enterprise search across the organization with a further 7 having a degree of unified search across departmental content Surprisingly these numbers are very consistent across all sizes of organization although the number of the largest organizations (greater than 5000 employees) with enterprise search drops to 8 It is fair to say that enterprise-wide search is more difficult to achieve across the larger enterprise with more repositories more content and more users
Figure 3 How good is your ability to search across your key content (Pick highest capability) (N=350)
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 7
Search and Discovery
- exploiting knowledge m
inimizing risk
Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4
Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)
While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search
OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 8
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)
For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28
Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents
Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 9
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)
As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy
Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis
Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 10
Search and Discovery
- exploiting knowledge m
inimizing risk
Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26
Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ
Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)
SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors
On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 11
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 9 Are security and permissions concerns for you in search (N=299)
Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability
Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department
Figure 10 Do you have any of the following (N=342 multiple)
We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 12
Search and Discovery
- exploiting knowledge m
inimizing risk
49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices
Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together
Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)
In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all
Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities
Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 13
Search and Discovery
- exploiting knowledge m
inimizing risk
Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below
Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)
Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion
Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)
Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 14
Search and Discovery
- exploiting knowledge m
inimizing risk
Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments
Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)
Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies
Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 1
Search and Discovery
- exploiting knowledge m
inimizing risk
About the ResearchAs the non-profit association dedicated to nurturing growing and supporting the information management community AIIM is proud to provide this research at no charge In this way the entire community can leverage the education thought leadership and direction provided by our work We would like these research findings to be as widely distributed as possible Feel free to use individual elements of this research in presentations and publications with the attribution ndash ldquocopy AIIM 2014 wwwaiimorgrdquo
Rather than redistribute a copy of this report to your colleagues or clients we would prefer that you direct them to wwwaiimorgresearch for a download of their own Permission is not given for other aggregators to host this report on their own website
Our ability to deliver such high-quality research is partially made possible by our underwriting companies without whom we would have to return to a paid subscription model For that we hope you will join us in thanking our underwriters who are
Process Used and Survey DemographicsWhile we appreciate the support of these sponsors we also greatly value our objectivity and independence as a non-profit industry association The results of the survey and the market commentary made in this report are independent of any bias from the vendor community
The survey was taken using a web-based tool by 415 individual members of the AIIM community between Jul 11 and Aug 02 2014 Invitations to take the survey were sent via e-mail to a selection of the 80000 AIIM community members
Survey demographics can be found in Appendix 1 Graphs throughout the report exclude responses from organizations with less than 10 employees and suppliers of ECM products and services taking the number of respondents to 353
Iron Mountain745 Atlantic Avenue Boston MA 02111Tel +1 800-899-5766Web wwwironmountaincom
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 2
Search and Discovery
- exploiting knowledge m
inimizing risk
About AIIMAIIM has been an advocate and supporter of information professionals for 70 years The association mission is to ensure that information professionals understand the current and future challenges of managing information assets in an era of social mobile cloud and big data AIIM builds on a strong heritage of research and member service Today AIIM is a global non-profit organization that provides independent research education and certification programs to information professionals AIIM represents the entire information management community practitioners technology suppliers integrators and consultants
About the AuthorDoug Miles is head of the AIIM Market Intelligence Division He has over 30 yearsrsquo experience of working with users and vendors across a broad spectrum of IT applications He was an early pioneer of document management systems for business and engineering applications and has produced many AIIM survey reports on issues and drivers for Capture ECM Records Management SharePoint Mobile Cloud Social Business and Big Data Doug has also worked closely with other enterprise-level IT systems such as ERP BI and CRM Doug has an MSc in Communications Engineering and is a member of the IET in the UK
copy 2014AIIM The Global Community of Information Professionals1100 Wayne Avenue Suite 1100Silver Spring MD 20910+13015878202wwwaiimorg
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 3
Search and Discovery
- exploiting knowledge m
inimizing risk
Table of ContentsAbout the ResearchAbout the Research 1Process Used and Survey Demographics 1About AIIM 2About the Author 2
IntroductionIntroduction 4Key Findings 4
Search Drivers and StrategiesSearch Drivers and Strategies 5Levels of ECM 6Levels of Search 6Search Maturity 7Ownership 7
Search CharacteristicsSearch Characteristics 8Content Types and Repositories 9Security 10
Search CapabilitiesSearch Capabilities 11Search and Big DataContent Analytics 12
Dedicated or Advanced Search ToolsDedicated or Advanced Search Tools 12Have No Dedicated Tools 13Trigger for Search Investment 13Hosting Platform 14
Implementation and SupportImplementation and Support 15Support Staff 16Connectivity 17
Benefits of Enterprise SearchBenefits of Enterprise Search 19
DiscoveryDiscovery 20Hold 21Email Search and Hold 22Workflow 23Predictive Coding 23
Opinions and SpendOpinions and Spend 24Spend 24
Conclusion and RecommendationsConclusion and Recommendations 26Recommendations 26
Appendix 1 Survey DemographicsAppendix 1 Survey Demographics 27Survey Background 27Organizational Size 27Industry Sector 28Job Roles 28
Appendix 2 General CommentsAppendix 2 General Comments 29
UNDERWRITTEN IN PART BYUNDERWRITTEN IN PART BY 30Iron Mountain 30AIIM 31
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 4
Search and Discovery
- exploiting knowledge m
inimizing risk
IntroductionThe popularity of the term ldquoknowledge workerrdquo comes and goes but the single most-important characteristic of such a job-description is the ability to find information process it into knowledge and so add value for the organization Sounds simple and in the age of the internet finding and sifting information from the outside world is relatively simple and very quick However when it comes to information that resides inside the organization the situation can be very different and the effect of search efficiency on knowledge worker productivity can be huge
Of course inside the organizations things can be much messier than a set of websites that can be relatively easily connected and indexed Email archives multiple content systems documents stored in enterprise systems internal social media sound files image fileshellipto provide a comprehensive search these need to be connected indexed and preferably accessible from a single sign-on portal In addition for most users information stored in structured databases will need to be referenced alongside all of the unstructured content Added to that will be the expectation that all of this information can be searched and accessed on mobile devices The concept therefore of ldquoenterprise searchrdquo is an attractive one but one that is not that easy to achieve
There is of course another aspect of search that is more about finding the bad stuff than the good stuff Compliance audits freedom of information inquiries and legal discovery mandates require us to uncover all of the relevant electronically stored information - all of the references to customers suppliers contracts cases disputes etc and all of it preserved in a suitable context Often these exercises come out-of-the-blue and as we will see most organizations are poorly equipped to handle them
In this report we take an in-depth look at the importance of search the level of search tools deployed issues with their use and connection to other systems and mechanisms for legal discovery and hold
Key FindingsSearch Drivers
n For 71 of the organizations polled search is vital or essential yet only 18 have cross-repository search capabilities 58 show little or no sign of search maturity
n 75 of respondents would not disagree that information is easier to find outside of the organization than within 65 agree that employees struggle to access internal information from mobile devices Only 39 have natural language search
n Improved search is a priority over big datacontent analytics for 73 There is some movement (19) towards a unified search and big data strategy (although 59 have no big data strategy)
n The IT Department takes responsibility for search in 52 of organizations although only 25 feel it should be so 44 feel RMComplianceIG would be a better owner although there is also strong support for the concept of a Head of Knowledge Management (34) or Chief Knowledge Officer (29)
Search Tools
n 25 have no advanced or dedicated search tools 13 have five or more
n Those with advanced search tools are most likely (45) to acquire them through their ECM product or provider 42 of users have on-server search products outside of ECM including 14 using Open Source 21 are using a dedicated search appliance and 8 SaaS
n 38 have not tuned or optimized their search tool at all including 8 who have not even switched it on Half of responding organizations allocate less than half an FTE to support search applications Only 12 have used external expertise
n Beyond SharePoint intranet and ECM systems most content is beyond the scope of the search tools Only 19 have advanced search across email with less than 10 extending to other enterprise systems
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 5
Search and Discovery
- exploiting knowledge m
inimizing risk
n 47 feel that universal search and compliant e-discovery is becoming near impossible given the proliferation of cloud share and collaboration apps personal note systems and mobile devices 60 are firmly of the view that automated analytics tools are the only way to improve classification and tagging to make their content more findable
n Better decision-making and faster customer service are given as the top benefits from improved search tools Only 14 were required to make a financial business case for search investment
n 42 consider that they have achieved payback from their investment in search tools within 12 months or less 62 achieved payback within 18 months
Discovery
n 53 of respondents agree that their legal discovery procedures are ldquoad hoc manual disruptive and expensiverdquo 28 have no policy process or precedent for legal discovery and legal hold
n 29 rely on instructions not to delete rather than more robust hold procedures 47 admit that their email retention and hold policies expose them to risk
n 74 rely on manual processes to manage the downstream legal discovery process 10 have dedicated legal-case products and 9 have a discovery workflow as part of ECM
Spending Plans
n On the whole users are likely to increase spend on all aspects of search and discovery in the next 12 months in particular content analytics mobile device apps and consolidation of multiple search tools
Search Drivers and StrategiesAs we suggested in the introduction searching for information is an aspect of most tasks and projects In some organizations it is a key element 37 of our respondents feel that search is ldquovitalrdquo to the productivity and effectiveness of their employees with a further 34 considering it an ldquoessentialrdquo requirement Research design customer response case-work litigation all have searching for information as a fundamental part of the day-to-day task and we all know that the inability to find an existing document within a short space of time will prompt the creation of a new one sapping productivity and inviting potential errors and non-compliance Decision-making in almost all areas of business is driven by the ability to find and assess past knowledge
Figure 1 How important is it in your organization for employees to have an effective way to search internal content and documents in order to carry out their tasks (N=351)
Despite the high importance attached to finding information we will see later (Figure 32) that over half the respondents report that employees can find external information more easily than internal
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 6
Search and Discovery
- exploiting knowledge m
inimizing risk
Levels of ECMThe success of content search is hugely dependent on the degree of content management in place Focusing content into a single repository rather than a scattered set of file shares will improve search targeting A well-defined taxonomy standardized metadata and a consistent classification scheme will improve findability As we will see later ECM systems will come with their own search modules of varying degrees of sophistication and potential connectivity to other repositories
There is a wide range of maturity in content management amongst our respondents As we can see in Figure 2 just over half have ECM systems with 11 using SharePoint exclusively 14 using other ECM systems and 27 using a combination of the two 48 have a mish- mash of file shares and unconnected repositories creating a bigger challenge for search capability
Figure 2 How would you describe your current enterprise content management (ECM) system(s) (N=253)
Levels of SearchAs a consequence despite the high importance attached to search 43 of respondents admit that they have only basic search tools and a further 39 can only search within discrete repositories creating issues of different logins different taxonomies and different presentation of search results Only 11 have enterprise search across the organization with a further 7 having a degree of unified search across departmental content Surprisingly these numbers are very consistent across all sizes of organization although the number of the largest organizations (greater than 5000 employees) with enterprise search drops to 8 It is fair to say that enterprise-wide search is more difficult to achieve across the larger enterprise with more repositories more content and more users
Figure 3 How good is your ability to search across your key content (Pick highest capability) (N=350)
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 7
Search and Discovery
- exploiting knowledge m
inimizing risk
Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4
Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)
While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search
OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 8
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)
For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28
Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents
Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 9
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)
As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy
Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis
Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 10
Search and Discovery
- exploiting knowledge m
inimizing risk
Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26
Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ
Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)
SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors
On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 11
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 9 Are security and permissions concerns for you in search (N=299)
Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability
Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department
Figure 10 Do you have any of the following (N=342 multiple)
We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 12
Search and Discovery
- exploiting knowledge m
inimizing risk
49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices
Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together
Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)
In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all
Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities
Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 13
Search and Discovery
- exploiting knowledge m
inimizing risk
Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below
Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)
Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion
Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)
Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 14
Search and Discovery
- exploiting knowledge m
inimizing risk
Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments
Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)
Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies
Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 2
Search and Discovery
- exploiting knowledge m
inimizing risk
About AIIMAIIM has been an advocate and supporter of information professionals for 70 years The association mission is to ensure that information professionals understand the current and future challenges of managing information assets in an era of social mobile cloud and big data AIIM builds on a strong heritage of research and member service Today AIIM is a global non-profit organization that provides independent research education and certification programs to information professionals AIIM represents the entire information management community practitioners technology suppliers integrators and consultants
About the AuthorDoug Miles is head of the AIIM Market Intelligence Division He has over 30 yearsrsquo experience of working with users and vendors across a broad spectrum of IT applications He was an early pioneer of document management systems for business and engineering applications and has produced many AIIM survey reports on issues and drivers for Capture ECM Records Management SharePoint Mobile Cloud Social Business and Big Data Doug has also worked closely with other enterprise-level IT systems such as ERP BI and CRM Doug has an MSc in Communications Engineering and is a member of the IET in the UK
copy 2014AIIM The Global Community of Information Professionals1100 Wayne Avenue Suite 1100Silver Spring MD 20910+13015878202wwwaiimorg
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 3
Search and Discovery
- exploiting knowledge m
inimizing risk
Table of ContentsAbout the ResearchAbout the Research 1Process Used and Survey Demographics 1About AIIM 2About the Author 2
IntroductionIntroduction 4Key Findings 4
Search Drivers and StrategiesSearch Drivers and Strategies 5Levels of ECM 6Levels of Search 6Search Maturity 7Ownership 7
Search CharacteristicsSearch Characteristics 8Content Types and Repositories 9Security 10
Search CapabilitiesSearch Capabilities 11Search and Big DataContent Analytics 12
Dedicated or Advanced Search ToolsDedicated or Advanced Search Tools 12Have No Dedicated Tools 13Trigger for Search Investment 13Hosting Platform 14
Implementation and SupportImplementation and Support 15Support Staff 16Connectivity 17
Benefits of Enterprise SearchBenefits of Enterprise Search 19
DiscoveryDiscovery 20Hold 21Email Search and Hold 22Workflow 23Predictive Coding 23
Opinions and SpendOpinions and Spend 24Spend 24
Conclusion and RecommendationsConclusion and Recommendations 26Recommendations 26
Appendix 1 Survey DemographicsAppendix 1 Survey Demographics 27Survey Background 27Organizational Size 27Industry Sector 28Job Roles 28
Appendix 2 General CommentsAppendix 2 General Comments 29
UNDERWRITTEN IN PART BYUNDERWRITTEN IN PART BY 30Iron Mountain 30AIIM 31
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 4
Search and Discovery
- exploiting knowledge m
inimizing risk
IntroductionThe popularity of the term ldquoknowledge workerrdquo comes and goes but the single most-important characteristic of such a job-description is the ability to find information process it into knowledge and so add value for the organization Sounds simple and in the age of the internet finding and sifting information from the outside world is relatively simple and very quick However when it comes to information that resides inside the organization the situation can be very different and the effect of search efficiency on knowledge worker productivity can be huge
Of course inside the organizations things can be much messier than a set of websites that can be relatively easily connected and indexed Email archives multiple content systems documents stored in enterprise systems internal social media sound files image fileshellipto provide a comprehensive search these need to be connected indexed and preferably accessible from a single sign-on portal In addition for most users information stored in structured databases will need to be referenced alongside all of the unstructured content Added to that will be the expectation that all of this information can be searched and accessed on mobile devices The concept therefore of ldquoenterprise searchrdquo is an attractive one but one that is not that easy to achieve
There is of course another aspect of search that is more about finding the bad stuff than the good stuff Compliance audits freedom of information inquiries and legal discovery mandates require us to uncover all of the relevant electronically stored information - all of the references to customers suppliers contracts cases disputes etc and all of it preserved in a suitable context Often these exercises come out-of-the-blue and as we will see most organizations are poorly equipped to handle them
In this report we take an in-depth look at the importance of search the level of search tools deployed issues with their use and connection to other systems and mechanisms for legal discovery and hold
Key FindingsSearch Drivers
n For 71 of the organizations polled search is vital or essential yet only 18 have cross-repository search capabilities 58 show little or no sign of search maturity
n 75 of respondents would not disagree that information is easier to find outside of the organization than within 65 agree that employees struggle to access internal information from mobile devices Only 39 have natural language search
n Improved search is a priority over big datacontent analytics for 73 There is some movement (19) towards a unified search and big data strategy (although 59 have no big data strategy)
n The IT Department takes responsibility for search in 52 of organizations although only 25 feel it should be so 44 feel RMComplianceIG would be a better owner although there is also strong support for the concept of a Head of Knowledge Management (34) or Chief Knowledge Officer (29)
Search Tools
n 25 have no advanced or dedicated search tools 13 have five or more
n Those with advanced search tools are most likely (45) to acquire them through their ECM product or provider 42 of users have on-server search products outside of ECM including 14 using Open Source 21 are using a dedicated search appliance and 8 SaaS
n 38 have not tuned or optimized their search tool at all including 8 who have not even switched it on Half of responding organizations allocate less than half an FTE to support search applications Only 12 have used external expertise
n Beyond SharePoint intranet and ECM systems most content is beyond the scope of the search tools Only 19 have advanced search across email with less than 10 extending to other enterprise systems
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 5
Search and Discovery
- exploiting knowledge m
inimizing risk
n 47 feel that universal search and compliant e-discovery is becoming near impossible given the proliferation of cloud share and collaboration apps personal note systems and mobile devices 60 are firmly of the view that automated analytics tools are the only way to improve classification and tagging to make their content more findable
n Better decision-making and faster customer service are given as the top benefits from improved search tools Only 14 were required to make a financial business case for search investment
n 42 consider that they have achieved payback from their investment in search tools within 12 months or less 62 achieved payback within 18 months
Discovery
n 53 of respondents agree that their legal discovery procedures are ldquoad hoc manual disruptive and expensiverdquo 28 have no policy process or precedent for legal discovery and legal hold
n 29 rely on instructions not to delete rather than more robust hold procedures 47 admit that their email retention and hold policies expose them to risk
n 74 rely on manual processes to manage the downstream legal discovery process 10 have dedicated legal-case products and 9 have a discovery workflow as part of ECM
Spending Plans
n On the whole users are likely to increase spend on all aspects of search and discovery in the next 12 months in particular content analytics mobile device apps and consolidation of multiple search tools
Search Drivers and StrategiesAs we suggested in the introduction searching for information is an aspect of most tasks and projects In some organizations it is a key element 37 of our respondents feel that search is ldquovitalrdquo to the productivity and effectiveness of their employees with a further 34 considering it an ldquoessentialrdquo requirement Research design customer response case-work litigation all have searching for information as a fundamental part of the day-to-day task and we all know that the inability to find an existing document within a short space of time will prompt the creation of a new one sapping productivity and inviting potential errors and non-compliance Decision-making in almost all areas of business is driven by the ability to find and assess past knowledge
Figure 1 How important is it in your organization for employees to have an effective way to search internal content and documents in order to carry out their tasks (N=351)
Despite the high importance attached to finding information we will see later (Figure 32) that over half the respondents report that employees can find external information more easily than internal
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 6
Search and Discovery
- exploiting knowledge m
inimizing risk
Levels of ECMThe success of content search is hugely dependent on the degree of content management in place Focusing content into a single repository rather than a scattered set of file shares will improve search targeting A well-defined taxonomy standardized metadata and a consistent classification scheme will improve findability As we will see later ECM systems will come with their own search modules of varying degrees of sophistication and potential connectivity to other repositories
There is a wide range of maturity in content management amongst our respondents As we can see in Figure 2 just over half have ECM systems with 11 using SharePoint exclusively 14 using other ECM systems and 27 using a combination of the two 48 have a mish- mash of file shares and unconnected repositories creating a bigger challenge for search capability
Figure 2 How would you describe your current enterprise content management (ECM) system(s) (N=253)
Levels of SearchAs a consequence despite the high importance attached to search 43 of respondents admit that they have only basic search tools and a further 39 can only search within discrete repositories creating issues of different logins different taxonomies and different presentation of search results Only 11 have enterprise search across the organization with a further 7 having a degree of unified search across departmental content Surprisingly these numbers are very consistent across all sizes of organization although the number of the largest organizations (greater than 5000 employees) with enterprise search drops to 8 It is fair to say that enterprise-wide search is more difficult to achieve across the larger enterprise with more repositories more content and more users
Figure 3 How good is your ability to search across your key content (Pick highest capability) (N=350)
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 7
Search and Discovery
- exploiting knowledge m
inimizing risk
Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4
Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)
While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search
OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 8
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)
For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28
Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents
Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 9
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)
As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy
Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis
Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 10
Search and Discovery
- exploiting knowledge m
inimizing risk
Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26
Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ
Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)
SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors
On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 11
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 9 Are security and permissions concerns for you in search (N=299)
Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability
Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department
Figure 10 Do you have any of the following (N=342 multiple)
We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 12
Search and Discovery
- exploiting knowledge m
inimizing risk
49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices
Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together
Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)
In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all
Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities
Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 13
Search and Discovery
- exploiting knowledge m
inimizing risk
Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below
Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)
Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion
Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)
Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 14
Search and Discovery
- exploiting knowledge m
inimizing risk
Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments
Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)
Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies
Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 3
Search and Discovery
- exploiting knowledge m
inimizing risk
Table of ContentsAbout the ResearchAbout the Research 1Process Used and Survey Demographics 1About AIIM 2About the Author 2
IntroductionIntroduction 4Key Findings 4
Search Drivers and StrategiesSearch Drivers and Strategies 5Levels of ECM 6Levels of Search 6Search Maturity 7Ownership 7
Search CharacteristicsSearch Characteristics 8Content Types and Repositories 9Security 10
Search CapabilitiesSearch Capabilities 11Search and Big DataContent Analytics 12
Dedicated or Advanced Search ToolsDedicated or Advanced Search Tools 12Have No Dedicated Tools 13Trigger for Search Investment 13Hosting Platform 14
Implementation and SupportImplementation and Support 15Support Staff 16Connectivity 17
Benefits of Enterprise SearchBenefits of Enterprise Search 19
DiscoveryDiscovery 20Hold 21Email Search and Hold 22Workflow 23Predictive Coding 23
Opinions and SpendOpinions and Spend 24Spend 24
Conclusion and RecommendationsConclusion and Recommendations 26Recommendations 26
Appendix 1 Survey DemographicsAppendix 1 Survey Demographics 27Survey Background 27Organizational Size 27Industry Sector 28Job Roles 28
Appendix 2 General CommentsAppendix 2 General Comments 29
UNDERWRITTEN IN PART BYUNDERWRITTEN IN PART BY 30Iron Mountain 30AIIM 31
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 4
Search and Discovery
- exploiting knowledge m
inimizing risk
IntroductionThe popularity of the term ldquoknowledge workerrdquo comes and goes but the single most-important characteristic of such a job-description is the ability to find information process it into knowledge and so add value for the organization Sounds simple and in the age of the internet finding and sifting information from the outside world is relatively simple and very quick However when it comes to information that resides inside the organization the situation can be very different and the effect of search efficiency on knowledge worker productivity can be huge
Of course inside the organizations things can be much messier than a set of websites that can be relatively easily connected and indexed Email archives multiple content systems documents stored in enterprise systems internal social media sound files image fileshellipto provide a comprehensive search these need to be connected indexed and preferably accessible from a single sign-on portal In addition for most users information stored in structured databases will need to be referenced alongside all of the unstructured content Added to that will be the expectation that all of this information can be searched and accessed on mobile devices The concept therefore of ldquoenterprise searchrdquo is an attractive one but one that is not that easy to achieve
There is of course another aspect of search that is more about finding the bad stuff than the good stuff Compliance audits freedom of information inquiries and legal discovery mandates require us to uncover all of the relevant electronically stored information - all of the references to customers suppliers contracts cases disputes etc and all of it preserved in a suitable context Often these exercises come out-of-the-blue and as we will see most organizations are poorly equipped to handle them
In this report we take an in-depth look at the importance of search the level of search tools deployed issues with their use and connection to other systems and mechanisms for legal discovery and hold
Key FindingsSearch Drivers
n For 71 of the organizations polled search is vital or essential yet only 18 have cross-repository search capabilities 58 show little or no sign of search maturity
n 75 of respondents would not disagree that information is easier to find outside of the organization than within 65 agree that employees struggle to access internal information from mobile devices Only 39 have natural language search
n Improved search is a priority over big datacontent analytics for 73 There is some movement (19) towards a unified search and big data strategy (although 59 have no big data strategy)
n The IT Department takes responsibility for search in 52 of organizations although only 25 feel it should be so 44 feel RMComplianceIG would be a better owner although there is also strong support for the concept of a Head of Knowledge Management (34) or Chief Knowledge Officer (29)
Search Tools
n 25 have no advanced or dedicated search tools 13 have five or more
n Those with advanced search tools are most likely (45) to acquire them through their ECM product or provider 42 of users have on-server search products outside of ECM including 14 using Open Source 21 are using a dedicated search appliance and 8 SaaS
n 38 have not tuned or optimized their search tool at all including 8 who have not even switched it on Half of responding organizations allocate less than half an FTE to support search applications Only 12 have used external expertise
n Beyond SharePoint intranet and ECM systems most content is beyond the scope of the search tools Only 19 have advanced search across email with less than 10 extending to other enterprise systems
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 5
Search and Discovery
- exploiting knowledge m
inimizing risk
n 47 feel that universal search and compliant e-discovery is becoming near impossible given the proliferation of cloud share and collaboration apps personal note systems and mobile devices 60 are firmly of the view that automated analytics tools are the only way to improve classification and tagging to make their content more findable
n Better decision-making and faster customer service are given as the top benefits from improved search tools Only 14 were required to make a financial business case for search investment
n 42 consider that they have achieved payback from their investment in search tools within 12 months or less 62 achieved payback within 18 months
Discovery
n 53 of respondents agree that their legal discovery procedures are ldquoad hoc manual disruptive and expensiverdquo 28 have no policy process or precedent for legal discovery and legal hold
n 29 rely on instructions not to delete rather than more robust hold procedures 47 admit that their email retention and hold policies expose them to risk
n 74 rely on manual processes to manage the downstream legal discovery process 10 have dedicated legal-case products and 9 have a discovery workflow as part of ECM
Spending Plans
n On the whole users are likely to increase spend on all aspects of search and discovery in the next 12 months in particular content analytics mobile device apps and consolidation of multiple search tools
Search Drivers and StrategiesAs we suggested in the introduction searching for information is an aspect of most tasks and projects In some organizations it is a key element 37 of our respondents feel that search is ldquovitalrdquo to the productivity and effectiveness of their employees with a further 34 considering it an ldquoessentialrdquo requirement Research design customer response case-work litigation all have searching for information as a fundamental part of the day-to-day task and we all know that the inability to find an existing document within a short space of time will prompt the creation of a new one sapping productivity and inviting potential errors and non-compliance Decision-making in almost all areas of business is driven by the ability to find and assess past knowledge
Figure 1 How important is it in your organization for employees to have an effective way to search internal content and documents in order to carry out their tasks (N=351)
Despite the high importance attached to finding information we will see later (Figure 32) that over half the respondents report that employees can find external information more easily than internal
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 6
Search and Discovery
- exploiting knowledge m
inimizing risk
Levels of ECMThe success of content search is hugely dependent on the degree of content management in place Focusing content into a single repository rather than a scattered set of file shares will improve search targeting A well-defined taxonomy standardized metadata and a consistent classification scheme will improve findability As we will see later ECM systems will come with their own search modules of varying degrees of sophistication and potential connectivity to other repositories
There is a wide range of maturity in content management amongst our respondents As we can see in Figure 2 just over half have ECM systems with 11 using SharePoint exclusively 14 using other ECM systems and 27 using a combination of the two 48 have a mish- mash of file shares and unconnected repositories creating a bigger challenge for search capability
Figure 2 How would you describe your current enterprise content management (ECM) system(s) (N=253)
Levels of SearchAs a consequence despite the high importance attached to search 43 of respondents admit that they have only basic search tools and a further 39 can only search within discrete repositories creating issues of different logins different taxonomies and different presentation of search results Only 11 have enterprise search across the organization with a further 7 having a degree of unified search across departmental content Surprisingly these numbers are very consistent across all sizes of organization although the number of the largest organizations (greater than 5000 employees) with enterprise search drops to 8 It is fair to say that enterprise-wide search is more difficult to achieve across the larger enterprise with more repositories more content and more users
Figure 3 How good is your ability to search across your key content (Pick highest capability) (N=350)
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 7
Search and Discovery
- exploiting knowledge m
inimizing risk
Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4
Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)
While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search
OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 8
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)
For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28
Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents
Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 9
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)
As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy
Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis
Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 10
Search and Discovery
- exploiting knowledge m
inimizing risk
Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26
Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ
Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)
SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors
On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 11
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 9 Are security and permissions concerns for you in search (N=299)
Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability
Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department
Figure 10 Do you have any of the following (N=342 multiple)
We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 12
Search and Discovery
- exploiting knowledge m
inimizing risk
49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices
Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together
Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)
In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all
Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities
Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 13
Search and Discovery
- exploiting knowledge m
inimizing risk
Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below
Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)
Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion
Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)
Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 14
Search and Discovery
- exploiting knowledge m
inimizing risk
Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments
Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)
Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies
Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 4
Search and Discovery
- exploiting knowledge m
inimizing risk
IntroductionThe popularity of the term ldquoknowledge workerrdquo comes and goes but the single most-important characteristic of such a job-description is the ability to find information process it into knowledge and so add value for the organization Sounds simple and in the age of the internet finding and sifting information from the outside world is relatively simple and very quick However when it comes to information that resides inside the organization the situation can be very different and the effect of search efficiency on knowledge worker productivity can be huge
Of course inside the organizations things can be much messier than a set of websites that can be relatively easily connected and indexed Email archives multiple content systems documents stored in enterprise systems internal social media sound files image fileshellipto provide a comprehensive search these need to be connected indexed and preferably accessible from a single sign-on portal In addition for most users information stored in structured databases will need to be referenced alongside all of the unstructured content Added to that will be the expectation that all of this information can be searched and accessed on mobile devices The concept therefore of ldquoenterprise searchrdquo is an attractive one but one that is not that easy to achieve
There is of course another aspect of search that is more about finding the bad stuff than the good stuff Compliance audits freedom of information inquiries and legal discovery mandates require us to uncover all of the relevant electronically stored information - all of the references to customers suppliers contracts cases disputes etc and all of it preserved in a suitable context Often these exercises come out-of-the-blue and as we will see most organizations are poorly equipped to handle them
In this report we take an in-depth look at the importance of search the level of search tools deployed issues with their use and connection to other systems and mechanisms for legal discovery and hold
Key FindingsSearch Drivers
n For 71 of the organizations polled search is vital or essential yet only 18 have cross-repository search capabilities 58 show little or no sign of search maturity
n 75 of respondents would not disagree that information is easier to find outside of the organization than within 65 agree that employees struggle to access internal information from mobile devices Only 39 have natural language search
n Improved search is a priority over big datacontent analytics for 73 There is some movement (19) towards a unified search and big data strategy (although 59 have no big data strategy)
n The IT Department takes responsibility for search in 52 of organizations although only 25 feel it should be so 44 feel RMComplianceIG would be a better owner although there is also strong support for the concept of a Head of Knowledge Management (34) or Chief Knowledge Officer (29)
Search Tools
n 25 have no advanced or dedicated search tools 13 have five or more
n Those with advanced search tools are most likely (45) to acquire them through their ECM product or provider 42 of users have on-server search products outside of ECM including 14 using Open Source 21 are using a dedicated search appliance and 8 SaaS
n 38 have not tuned or optimized their search tool at all including 8 who have not even switched it on Half of responding organizations allocate less than half an FTE to support search applications Only 12 have used external expertise
n Beyond SharePoint intranet and ECM systems most content is beyond the scope of the search tools Only 19 have advanced search across email with less than 10 extending to other enterprise systems
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 5
Search and Discovery
- exploiting knowledge m
inimizing risk
n 47 feel that universal search and compliant e-discovery is becoming near impossible given the proliferation of cloud share and collaboration apps personal note systems and mobile devices 60 are firmly of the view that automated analytics tools are the only way to improve classification and tagging to make their content more findable
n Better decision-making and faster customer service are given as the top benefits from improved search tools Only 14 were required to make a financial business case for search investment
n 42 consider that they have achieved payback from their investment in search tools within 12 months or less 62 achieved payback within 18 months
Discovery
n 53 of respondents agree that their legal discovery procedures are ldquoad hoc manual disruptive and expensiverdquo 28 have no policy process or precedent for legal discovery and legal hold
n 29 rely on instructions not to delete rather than more robust hold procedures 47 admit that their email retention and hold policies expose them to risk
n 74 rely on manual processes to manage the downstream legal discovery process 10 have dedicated legal-case products and 9 have a discovery workflow as part of ECM
Spending Plans
n On the whole users are likely to increase spend on all aspects of search and discovery in the next 12 months in particular content analytics mobile device apps and consolidation of multiple search tools
Search Drivers and StrategiesAs we suggested in the introduction searching for information is an aspect of most tasks and projects In some organizations it is a key element 37 of our respondents feel that search is ldquovitalrdquo to the productivity and effectiveness of their employees with a further 34 considering it an ldquoessentialrdquo requirement Research design customer response case-work litigation all have searching for information as a fundamental part of the day-to-day task and we all know that the inability to find an existing document within a short space of time will prompt the creation of a new one sapping productivity and inviting potential errors and non-compliance Decision-making in almost all areas of business is driven by the ability to find and assess past knowledge
Figure 1 How important is it in your organization for employees to have an effective way to search internal content and documents in order to carry out their tasks (N=351)
Despite the high importance attached to finding information we will see later (Figure 32) that over half the respondents report that employees can find external information more easily than internal
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 6
Search and Discovery
- exploiting knowledge m
inimizing risk
Levels of ECMThe success of content search is hugely dependent on the degree of content management in place Focusing content into a single repository rather than a scattered set of file shares will improve search targeting A well-defined taxonomy standardized metadata and a consistent classification scheme will improve findability As we will see later ECM systems will come with their own search modules of varying degrees of sophistication and potential connectivity to other repositories
There is a wide range of maturity in content management amongst our respondents As we can see in Figure 2 just over half have ECM systems with 11 using SharePoint exclusively 14 using other ECM systems and 27 using a combination of the two 48 have a mish- mash of file shares and unconnected repositories creating a bigger challenge for search capability
Figure 2 How would you describe your current enterprise content management (ECM) system(s) (N=253)
Levels of SearchAs a consequence despite the high importance attached to search 43 of respondents admit that they have only basic search tools and a further 39 can only search within discrete repositories creating issues of different logins different taxonomies and different presentation of search results Only 11 have enterprise search across the organization with a further 7 having a degree of unified search across departmental content Surprisingly these numbers are very consistent across all sizes of organization although the number of the largest organizations (greater than 5000 employees) with enterprise search drops to 8 It is fair to say that enterprise-wide search is more difficult to achieve across the larger enterprise with more repositories more content and more users
Figure 3 How good is your ability to search across your key content (Pick highest capability) (N=350)
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 7
Search and Discovery
- exploiting knowledge m
inimizing risk
Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4
Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)
While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search
OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 8
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)
For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28
Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents
Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 9
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)
As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy
Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis
Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 10
Search and Discovery
- exploiting knowledge m
inimizing risk
Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26
Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ
Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)
SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors
On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 11
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 9 Are security and permissions concerns for you in search (N=299)
Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability
Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department
Figure 10 Do you have any of the following (N=342 multiple)
We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 12
Search and Discovery
- exploiting knowledge m
inimizing risk
49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices
Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together
Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)
In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all
Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities
Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 13
Search and Discovery
- exploiting knowledge m
inimizing risk
Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below
Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)
Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion
Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)
Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 14
Search and Discovery
- exploiting knowledge m
inimizing risk
Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments
Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)
Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies
Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 5
Search and Discovery
- exploiting knowledge m
inimizing risk
n 47 feel that universal search and compliant e-discovery is becoming near impossible given the proliferation of cloud share and collaboration apps personal note systems and mobile devices 60 are firmly of the view that automated analytics tools are the only way to improve classification and tagging to make their content more findable
n Better decision-making and faster customer service are given as the top benefits from improved search tools Only 14 were required to make a financial business case for search investment
n 42 consider that they have achieved payback from their investment in search tools within 12 months or less 62 achieved payback within 18 months
Discovery
n 53 of respondents agree that their legal discovery procedures are ldquoad hoc manual disruptive and expensiverdquo 28 have no policy process or precedent for legal discovery and legal hold
n 29 rely on instructions not to delete rather than more robust hold procedures 47 admit that their email retention and hold policies expose them to risk
n 74 rely on manual processes to manage the downstream legal discovery process 10 have dedicated legal-case products and 9 have a discovery workflow as part of ECM
Spending Plans
n On the whole users are likely to increase spend on all aspects of search and discovery in the next 12 months in particular content analytics mobile device apps and consolidation of multiple search tools
Search Drivers and StrategiesAs we suggested in the introduction searching for information is an aspect of most tasks and projects In some organizations it is a key element 37 of our respondents feel that search is ldquovitalrdquo to the productivity and effectiveness of their employees with a further 34 considering it an ldquoessentialrdquo requirement Research design customer response case-work litigation all have searching for information as a fundamental part of the day-to-day task and we all know that the inability to find an existing document within a short space of time will prompt the creation of a new one sapping productivity and inviting potential errors and non-compliance Decision-making in almost all areas of business is driven by the ability to find and assess past knowledge
Figure 1 How important is it in your organization for employees to have an effective way to search internal content and documents in order to carry out their tasks (N=351)
Despite the high importance attached to finding information we will see later (Figure 32) that over half the respondents report that employees can find external information more easily than internal
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 6
Search and Discovery
- exploiting knowledge m
inimizing risk
Levels of ECMThe success of content search is hugely dependent on the degree of content management in place Focusing content into a single repository rather than a scattered set of file shares will improve search targeting A well-defined taxonomy standardized metadata and a consistent classification scheme will improve findability As we will see later ECM systems will come with their own search modules of varying degrees of sophistication and potential connectivity to other repositories
There is a wide range of maturity in content management amongst our respondents As we can see in Figure 2 just over half have ECM systems with 11 using SharePoint exclusively 14 using other ECM systems and 27 using a combination of the two 48 have a mish- mash of file shares and unconnected repositories creating a bigger challenge for search capability
Figure 2 How would you describe your current enterprise content management (ECM) system(s) (N=253)
Levels of SearchAs a consequence despite the high importance attached to search 43 of respondents admit that they have only basic search tools and a further 39 can only search within discrete repositories creating issues of different logins different taxonomies and different presentation of search results Only 11 have enterprise search across the organization with a further 7 having a degree of unified search across departmental content Surprisingly these numbers are very consistent across all sizes of organization although the number of the largest organizations (greater than 5000 employees) with enterprise search drops to 8 It is fair to say that enterprise-wide search is more difficult to achieve across the larger enterprise with more repositories more content and more users
Figure 3 How good is your ability to search across your key content (Pick highest capability) (N=350)
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 7
Search and Discovery
- exploiting knowledge m
inimizing risk
Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4
Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)
While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search
OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 8
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)
For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28
Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents
Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 9
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)
As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy
Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis
Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 10
Search and Discovery
- exploiting knowledge m
inimizing risk
Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26
Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ
Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)
SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors
On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 11
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 9 Are security and permissions concerns for you in search (N=299)
Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability
Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department
Figure 10 Do you have any of the following (N=342 multiple)
We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 12
Search and Discovery
- exploiting knowledge m
inimizing risk
49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices
Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together
Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)
In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all
Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities
Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 13
Search and Discovery
- exploiting knowledge m
inimizing risk
Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below
Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)
Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion
Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)
Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 14
Search and Discovery
- exploiting knowledge m
inimizing risk
Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments
Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)
Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies
Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 6
Search and Discovery
- exploiting knowledge m
inimizing risk
Levels of ECMThe success of content search is hugely dependent on the degree of content management in place Focusing content into a single repository rather than a scattered set of file shares will improve search targeting A well-defined taxonomy standardized metadata and a consistent classification scheme will improve findability As we will see later ECM systems will come with their own search modules of varying degrees of sophistication and potential connectivity to other repositories
There is a wide range of maturity in content management amongst our respondents As we can see in Figure 2 just over half have ECM systems with 11 using SharePoint exclusively 14 using other ECM systems and 27 using a combination of the two 48 have a mish- mash of file shares and unconnected repositories creating a bigger challenge for search capability
Figure 2 How would you describe your current enterprise content management (ECM) system(s) (N=253)
Levels of SearchAs a consequence despite the high importance attached to search 43 of respondents admit that they have only basic search tools and a further 39 can only search within discrete repositories creating issues of different logins different taxonomies and different presentation of search results Only 11 have enterprise search across the organization with a further 7 having a degree of unified search across departmental content Surprisingly these numbers are very consistent across all sizes of organization although the number of the largest organizations (greater than 5000 employees) with enterprise search drops to 8 It is fair to say that enterprise-wide search is more difficult to achieve across the larger enterprise with more repositories more content and more users
Figure 3 How good is your ability to search across your key content (Pick highest capability) (N=350)
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 7
Search and Discovery
- exploiting knowledge m
inimizing risk
Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4
Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)
While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search
OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 8
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)
For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28
Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents
Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 9
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)
As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy
Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis
Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 10
Search and Discovery
- exploiting knowledge m
inimizing risk
Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26
Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ
Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)
SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors
On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 11
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 9 Are security and permissions concerns for you in search (N=299)
Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability
Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department
Figure 10 Do you have any of the following (N=342 multiple)
We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 12
Search and Discovery
- exploiting knowledge m
inimizing risk
49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices
Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together
Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)
In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all
Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities
Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 13
Search and Discovery
- exploiting knowledge m
inimizing risk
Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below
Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)
Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion
Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)
Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 14
Search and Discovery
- exploiting knowledge m
inimizing risk
Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments
Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)
Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies
Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 7
Search and Discovery
- exploiting knowledge m
inimizing risk
Search MaturityBroadening this view to include policies and strategies that can move the business towards an effective enterprise search capability we asked about a number of aspects that would demonstrate a level of search maturity Only 12 have an agreed search strategy and only half of those have a specific budget There is a distinct lack of dedicated and trained staff (17) and as a likely result little in the way of agreed taxonomies or vocabularies or metadata standards Even amongst the largest organizations 52 have none of the items listed in Figure 4
Figure 4 Thinking of the maturity of your approach to search which of the following do you have (N=266 multiple)
While 71 of organizations consider search to be vital or essential to productivity and effectiveness 58 show little or no signs of maturity in search
OwnershipOwnership is a crucial issue for search The need is felt across multiple departments some with specialist requirements others more general There are multiple IT systems involved and the most likely source of trained expertise is in the records management department In Figure 5 we wanted to establish who is currently assumed to have the responsibility who the respondent feels should have responsibility and what role do they think could be created in the organization to much better take on the responsibility - and remembering that in Figure 4 only 15 felt that there is an acknowledged owner at present
Vital to our producvity
effecveness and compliance 37
An essenal requirement 34
Quite important 21
Helpful 7
Not that important 1
We rely solely on file shares and network drives
15
We have a number of
unconnected document
content and scanned-file
repositories 33
SharePoint is our primary content
management system 11
We have a combinaon of SharePoint and other content systems 27
We have a non-SharePoint ECM
system as our primary system
14
We have disparate
content stores and only basic
search tools 43
We have search tools within
discrete repositories 39
We have a unified search
capability across departmental content 7
We have enterprise search capability across the organizaon
11
0 10 20 30 40 50 60
An agreed search strategy across theorganizaon
A specific budget for search
An acknowledged owner of search-relatedissues
Dedicated and trained staff supporngsearch
An agreed corporate taxonomy orvocabulary of terms
A metadata standard across differentrepositories
None of these
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 8
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)
For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28
Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents
Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 9
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)
As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy
Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis
Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 10
Search and Discovery
- exploiting knowledge m
inimizing risk
Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26
Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ
Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)
SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors
On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 11
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 9 Are security and permissions concerns for you in search (N=299)
Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability
Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department
Figure 10 Do you have any of the following (N=342 multiple)
We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 12
Search and Discovery
- exploiting knowledge m
inimizing risk
49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices
Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together
Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)
In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all
Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities
Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 13
Search and Discovery
- exploiting knowledge m
inimizing risk
Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below
Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)
Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion
Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)
Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 14
Search and Discovery
- exploiting knowledge m
inimizing risk
Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments
Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)
Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies
Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 8
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 5 Who would you say takes and who do you feel should take primary responsibility for search in your organization (N=308 multiple)
For 52 the IT department currently own responsibility for search but only half of our respondents are happy that this should be so On the other hand the records management department are in charge in 24 of cases but 54 of respondents would like to see them take charge Most interestingly 23 would like there to be a Head of Information Management and 25 would like to have a Head of Knowledge Management or even a Chief Knowledge Officer (CKO) at board level ndash albeit that almost no one has one of these already The compromise is a search IM or KM steering group in place in 4 of organizations but suggested by 28
Search CharacteristicsMoving up a gear from general search requirements to advanced search applications we set out to find out which are the most prevalent applications Obviously some of these are industry-specific such as freedom of information requests (FOIA) in government and plant or asset-related content in energy and utilities Business knowledge or intelligence tops them all as a generic requirement followed by the two most pressing needs search across emails and search for customer-related content It is worthy of note that most vendors concentrate their advanced search proposition on litigation search yet everyday business requirements are considered the most important aspect for our respondents
Next comes compliance-related audit search an interesting application generally internal which helps to police the business against such infringements as anti-competition behavior insider-trading money laundering bribery and corruption employee fraud etc This category of self-investigation comes higher than legal discovery
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 9
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)
As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy
Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis
Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 10
Search and Discovery
- exploiting knowledge m
inimizing risk
Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26
Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ
Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)
SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors
On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 11
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 9 Are security and permissions concerns for you in search (N=299)
Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability
Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department
Figure 10 Do you have any of the following (N=342 multiple)
We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 12
Search and Discovery
- exploiting knowledge m
inimizing risk
49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices
Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together
Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)
In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all
Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities
Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 13
Search and Discovery
- exploiting knowledge m
inimizing risk
Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below
Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)
Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion
Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)
Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 14
Search and Discovery
- exploiting knowledge m
inimizing risk
Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments
Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)
Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies
Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 9
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 6 Which are the most important application areas for advanced search within your business unit (N=344)
As we mentioned in some vertical sectors priorities are quite different Freedom of Information (FOIFOIA) requests comes number two on the list (60) for government organizations and public services especially at local and state level and scientific or patent-related search rises to 50 for life sciences and 15 for manufacturing and energy
Content Types and RepositoriesWhen it comes to content types the most obvious ones are office files and PDFs and of course emails 60 consider it important to be able to search structured content in corporate databases such as ERP CRM and HR and here the concept of a unified or enterprise search portal helps pick up search results from wherever a match is found Next come drawings and maps needed by a surprisingly large 51 photo images (46) and video (35) Obviously there is a big difference in the search technology needed for searching within a drawing image video or sound file as opposed to picking up on external metadata tags but such technologies do exist and can be very effective albeit that currently their use is often confined to forensic applications such as copyright infringement or CCTV analysis
Figure 7 Which of the following content types is it important for your employees to be able to search (Check those that are important) (N=306)
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 10
Search and Discovery
- exploiting knowledge m
inimizing risk
Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26
Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ
Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)
SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors
On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 11
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 9 Are security and permissions concerns for you in search (N=299)
Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability
Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department
Figure 10 Do you have any of the following (N=342 multiple)
We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 12
Search and Discovery
- exploiting knowledge m
inimizing risk
49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices
Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together
Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)
In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all
Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities
Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 13
Search and Discovery
- exploiting knowledge m
inimizing risk
Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below
Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)
Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion
Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)
Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 14
Search and Discovery
- exploiting knowledge m
inimizing risk
Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments
Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)
Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies
Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 10
Search and Discovery
- exploiting knowledge m
inimizing risk
Email servers and file shares top the list of the most important repositories to search despite the fact that more than half of the responding organizations have ECM systems ndash or perhaps itrsquos because content in these other systems is the most likely to be chaotic poorly tagged and massively duplicated BI reports and staff directories figure quite highly for 55 Searching messaging systems and blogs is not considered vital as yet although important for 26
Searching internal social streams lags further at 20 although as companies take up these tools for knowledge-sharing knowledge-requests and expertise-sourcing the historical exchanges will provide a rich source of corporate knowledge ndash along the lines of a company-wide FAQ
Figure 8 Which of the following places or repositories is it important for your employees to be able to easily search (N=304 line length reflects ldquoNot Relevantrdquo)
SecurityAn ongoing fear with enterprise search is that unauthorized users will find content that they shouldnrsquot see ndash that job offer letter to a new colleague or strategic plans for rationalizing the business More recently there is a fear of ldquodata-harvestingrdquo for bank details identity numbers and even targetable email addresses Not surprisingly 41 of our respondents cited this as a ldquomajor concernrdquo but this was in addition to the 31 who consider security and permissions to be a ldquoshow-stopperrdquo Now if we are to understand that these organizations would rather not give their employees powerful search tools in case they uncover sensitive data we have to ask what kind of information governance they have in place to protect this content in the first instance Of course it could be that they donrsquot trust the assurance of the search tool provider that all security settings on each connected repository will be respected And indeed this could be a reflection on the choice of some IT departments to develop their own Open Source adaptations and their own repository connectors
On the other hand although specific personal or HR information may be protected by folder rights or file passwords security for operational matters are often defined by a restricted email circulation list something that a search algorithm would struggle to interpret It would also be unfortunate if the search security issue drove some users towards disconnected repositories and devices Pre-testing and a little imagination should of course quickly uncover loopholes in security
0 10 20 30 40 50 60 70 80 90
IT Department
Records ManagementComplianceIG
CIO
Head of Informa on Management
Legal
Corporate Communica ons
HR
Chief Librarian
Search IM or KM steering group
Head of Knowledge Management
Chief Knowledge Officer (CKO)
Takes Should take Should take if we had one
0 10 20 30 40 50 60 70
Search for recorded rdquoknowledgerdquo or business intelligence
General search across emails
Search for customer-related content
Compliance-related audit searchSearch for data sheets or informaon
resources
Search for legal discoverySearch for freedom of informaon (FOIFOIA)
disclosure
Search for plantasset-related content
Forensic caseclaims-related search
Scienfic or patent-related search
0 20 40 60 80 100
Office documents (eg DOC XLS PPT)
PDF files
Emails
ScannedOCR documents
Structured content in corporate databases
Drawings or maps
Photo images
Video
Social network text
Sound
0 20 40 60 80 100
Email systems
File shares
Docs within enterprise systems (ERP CRM HR etc)
Structured (database) content in enterprise systems
Non-SharePoint ECMDMRM systems
Corporate intranet
SharePoint system(s)
Data warehouses BI reports
Other LOB systems
Cloud-based content stores or SaaS systems
Staff directoriesprofiles
Outsourced contentrecords stores
Messaging systemschat
Blogs and communies
Internal social streams (Yammer Chaer Jive etc)
Vital Important Not so important
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 11
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 9 Are security and permissions concerns for you in search (N=299)
Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability
Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department
Figure 10 Do you have any of the following (N=342 multiple)
We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 12
Search and Discovery
- exploiting knowledge m
inimizing risk
49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices
Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together
Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)
In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all
Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities
Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 13
Search and Discovery
- exploiting knowledge m
inimizing risk
Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below
Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)
Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion
Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)
Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 14
Search and Discovery
- exploiting knowledge m
inimizing risk
Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments
Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)
Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies
Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 11
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 9 Are security and permissions concerns for you in search (N=299)
Search CapabilitiesAs discussed previously most ECM systems have a native search function to find content stored within that system and in some cases this can be extended to other repositories to form a search portal SharePoint in particular has often been adopted for this purpose partly from its background as a replacement for corporate intranets and partly because it is generally made available to all staff within the business 31 of organizations in our survey use SharePoint this way and a further 17 extend other ECM systems as search portals 12 choose to have a stand-alone portal or search tool connected across multiple repositories 49 have no search portal capability
Of those that have an enterprise search tool or portal 42 make it available to all staff For 26 it is only available to a fifth of the office workforce including some situations where it may only be available to a limited number of staff for example in the legal department
Figure 10 Do you have any of the following (N=342 multiple)
We also asked in this question about app-based search of on-premise content from mobile devices and only a very low 3 have this capability Less than the 4 are able to search cloud-based content from on-premise search tools and 5 are using cloud or SaaS search tools
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 12
Search and Discovery
- exploiting knowledge m
inimizing risk
49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices
Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together
Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)
In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all
Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities
Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 13
Search and Discovery
- exploiting knowledge m
inimizing risk
Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below
Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)
Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion
Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)
Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 14
Search and Discovery
- exploiting knowledge m
inimizing risk
Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments
Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)
Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies
Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 12
Search and Discovery
- exploiting knowledge m
inimizing risk
49 have no ability to search across multiple repositories from a single interface Only 3 have an app-capability for searching on-premise content from mobile devices
Search and Big DataContent AnalyticsMany aspects of enterprise search have an overlap with content analytics or big data Certainly connectivity to multiple repositories is important along with context sensitivity within document content Presentation of the results will be quite different and when it comes to priorities there is a philosophical view in that search is of benefit to the everyday jobs of most users whereas content analytics and big data is likely to be a corporate initiative to extract very specific information For our survey respondents there is no doubt that the priority should be search and analytics can be looked at later 11 are going down the analytics route first and a further 23 are likely to develop both together
Figure 11 In your organization how are you prioritizing enterprise search projects and big datacontent analyticsvisualization projects (N=332)
In an additional question 19 said they are moving to a unified big data and search strategy but only 2 say they are already there 21 have separate strategies and 59 have no big data strategy at all
Half of our respondents feel that search projects should take priority over big data projects Only 5 already have both capabilities
Dedicated or Advanced Search ToolsAs we have already discussed most content repositories will have a search function but its capabilities could range from basic keyword search to highly advanced context-sensitive statistical or rules-based search Similarly some stand-alone search products can be very simple Therefore when we asked how many ldquodedicated or advancedrdquo search tools our users have in place the answers depend a little on their interpretation of advanced With that caveat 25 have no tools of this kind rising to 35 of the smallest organizations
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 13
Search and Discovery
- exploiting knowledge m
inimizing risk
Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below
Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)
Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion
Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)
Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 14
Search and Discovery
- exploiting knowledge m
inimizing risk
Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments
Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)
Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies
Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 13
Search and Discovery
- exploiting knowledge m
inimizing risk
Overall 13 have five or more rising to 22 of the largest This suggests a number of isolated line-of-business implementations that could usefully be consolidated Alternatively it could be that specific tools have been purchased in response to immediate legal or compliance issues ndash see below
Figure 12 How many different dedicated or advanced search tools are you using in your organization (N=292)
Have No Dedicated ToolsOf those currently having no dedicated or advanced tools an encouraging 29 have a project underway 38 acknowledge that search tools need dedicated support resource that they currently have allocated to other things 23 feel it would be hard to justify the cost although as we will see later these tools can produce ROI within 12-18 months There is of course a wide range of price points for these tools and there may be misapprehension about the potential cost As we saw before 18 have no sponsoring department or champion
Figure 13 Which two of the following best describe why your organization has not invested in a dedicated search tool (Max TWO) (N=82 No search tools)
Trigger for Search InvestmentThose who currently do not have any search tools are most likely to acquire them as part of an ECMDMRM project (42) but a major litigation case (37) or a compliance issue (34) would be the next most likely to trigger an evaluation (potentially too late) For 19 an investment would most likely be triggered by an initiative from senior management to improve the quality of decision-making
Not really an issue 3
Need to take account 25
Major concern 41
Show-stopper 31
0 10 20 30 40 50
SharePoint connected to mulplerepositories as an accesssearch portal
Non-SharePoint ECM connected to mulplerepositories as an accesssearch portal
A stand-alone search portal connected tomulple repositories
App-based search of on-premise contentfrom mobile devices
On-premise search of cloud-basedrepositories
Cloud-basedSaaS search of on-premisecloud repositories
None of these
We need search first then wersquoll
look at analycs 49
We have search and are
looking at analycs 13
We are looking to build-out our search tools to analycs 11
We are moving ahead with
both together 12
We are priorizing
analycs over search 11
We already have both 5
0 5 10 15 20 25 30
None
One
Two
Three
Four
Five or more
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 14
Search and Discovery
- exploiting knowledge m
inimizing risk
Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments
Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)
Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies
Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 14
Search and Discovery
- exploiting knowledge m
inimizing risk
Comparing this with those who already made an investment 56 acquired better tools as part of an ECMDMRM project but senior management initiative jumps from number five to number two (29) However there is hard evidence of the potential for compliance failure or major litigation issues as these were the actual triggers for 26 and 23 respectively In the government sector failure to meet FOI timescales triggered 28 of search investments
Figure 14 What triggered the evaluation (or would trigger a re-evaluation) of search tools for your organization (Max TWO) (N=195 With search tools)
Hosting PlatformDedicated search tools can take a variety of forms inside ECM outside of ECM but on-server as a dedicated search appliance or search box or as a cloud-based or SaaS tool Larger organizations are more likely to opt for dedicated applications outside of ECM whereas the smallest organizations are much more likely to be using cloud or SaaS tools (18) The dedicated search appliance is epitomized by the Google product and as one might expect from the pricing model is more easily justified by the larger companies
Search is also an application that has been particularly successful in the Open Source arena either as a core engine such as Lucene or Solr or as a productized version 14 of our respondents have based their advanced search around Open Source with smaller organizations in particular adapting it via in-house development (9) In a separate question 55 overall would be happy to use Open Source although 8 say they would not use it ldquoon principlerdquo
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 15
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 15 How would you best describe the hosting platform of your main dedicated search tool(s) (N=185 With search tools)
Advanced search has been offered for a number of years as part of SharePoint moving from the additionally priced FAST module in the 2010 version to a standard subset of those features in the 2013 product 64 of our survey are using this although not exclusively
Implementation and SupportWe talked earlier in the report about the comparison between internal network search and external internet search using Google Bing or Yahoo An interesting perspective on this is that if an external search fails to surface some of the relevant content that could match the search conditions we will generally be unaware of it and not seeing it may not be an issue If an internal search especially for discovery purposes or to find a set of known records fails to find all the matching content then we might consider that to be a failure
It is therefore an important part of search evaluation and implementation that the search tool needs to be set-up and optimized for local taxonomies presentation preferences and decision thresholds and it should be monitored evaluated and tuned This should be contingent on a needs assessment or consultation with users across the organization prior to or soon after implementation As we can see from Figure 16 38 have not tuned their advanced search tool at all (including 8 who have not even switched it on) and a further 12 set it up on day one but have not adjusted it since Only 27 ran a needs assessment and only 18 monitor ongoing results
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 16
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 16 Which of the following would describe the way you have deployed your search tools (N=169 Multiple excl 23 Donrsquot Know)
Support StaffA quarter of those with advanced search tools have no dedicated and trained support staff and a further 22 allocate less than 05 FTEs (Full Time Equivalent staff) 21 allocate three or more staff rising to 35 of organizations with over 5000 employees
Figure 17 How many dedicated (and trained) support staff do you have for your search application(s) (N=192 Excl 30 Donrsquot Know)
Many organizations will struggle to provide or justify in-house expertise to carry out implementation and tuning and they should consider bringing in outside consultants or service partners especially where the partners have experience of particular vertical industries
Taxonomy management and metadata standards are two key areas that can cause support problems along with connection interfaces to other repositories User training and the user interface are also areas that need careful attention ndash the needs of power workers can often be quite different from those of office users Only 39 have search tools that support natural language queries or query pre-processing (eg ldquoHow do Ihelliprdquo ldquoWhere ishellip) including 7 using an additional product add-on
0 5 10 15 20 25 30 35 40
We are invesgang right now
It needs support resource to get the bestresults and we have higher priories
Itrsquos something wersquove never really made a careful evaluaon of
It would be hard to jusfy spending the moneyneeded to get something more effecve
Hard to know which department wouldsponsor this
Wersquore happy with the simple search that comes as standard with our ECMDMRM system(s)
Dont know
0 10 20 30 40 50 60
As part of an ECMDMRM project
Iniave from above to improve quality ofdecision-making
Compliance failure
General evaluaon of infrastructure
Major ligaon case
Failure to meet mescales under FOI enquiry
Reorganizaon of scienfic or engineeringprocesses
Exercise to reduce costs in legal department
HR iniave to improve skills sourcing
Increased patent acvity (proacve ordefense)
0 20 40 60
Advanced search capability fromour ECM vendor
On-server search applicaonoutside of ECM
On-server product based on OpenSource
Locally developed Open Sourcesearch capability
Dedicated search appliance or box
Cloud-basedSaaS search tools
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
No one takes much interest in it
We have a number of tools each used bysmall groups
We have advanced capability but we havenrsquot turned it on as yet
We use it prey much as suppliedout-of-the-box
We set parameters and populatedtaxonomies at the start but not since
We consulted users across the organizaon toassess needs
We have connuous monitoring andopmizaon in place
We useused external service partners to help
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 17
Search and Discovery
- exploiting knowledge m
inimizing risk
It is worthy of note that taking out server deployment and connection interfaces all the other issues need non-IT related skills from library or information science professionals ndash often in short supply within most organizations
Figure 18 What aspects of support have needed the most resource (Max TWO) (N=150 Excl 33 Donrsquot Know)
Beyond taxonomies and basic settings many organizations are happy to allow the search tool to provide results on an out-of-the-box basis but 28 would like be able to tune the search algorithms as well as 21 who as a minimum need full transparency as to how results are achieved This is often an argument in favor of Open Source products
Figure 19 How important is it for you to know how a search engine would come up with the results-listranking (Algorithm transparencyflexibility) (N=303)
ConnectivityAs we saw earlier most users are looking to a single point search across a number of repositories 40 have not extended their search capability beyond the native ECM or SharePoint system Beyond SharePoint 34 still maintain a dedicated intranet - and would like to be able to search it - as would 27 who have non-SharePoint ECM systems Next come email servers RM systems imaging systems and LOB systems Internal social systems come in here ahead of a long tail that includes ERP CRM and HR systems
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 18
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 20 Which of the following repositories are connected to your single search portal (N=184 Excl CAD system 2 Digital Assets 2)
Of those that have connected their search to other systems 52 have purchased standard connectors or custom connectors from the vendor 45 have developed their own connectors or used third party developers (8) These can prove difficult to maintain across different system upgrades particularly from the security point of view Only 9 have followed the CMIS interoperability services standard
Figure 21 What is your preferred waymost likely way of connecting your dedicated search tool to your content repositories (N=78 Have extended Excl 61 Donrsquot Know)
0 5 10 15 20 25 30 35 40
None
Less than 05 FTE
One FTE
Two FTEs
Three FTEs
More than 3 FTEs
10-500 emps500-5000 emps5000+ emps
0 5 10 15 20 25 30 35
Server deployment and maintenance
Taxonomy management
User training on the tool
Correcng updang or standardizing metadata
Connecon interfaces to other repositories
Improving user interface
Tuning for relevancy
Protecng against security breaches
Monitoring search logs
Language issues
Itrsquos not an issue for us 6
Only a problem if results are inconsistent
16
We need to know in general
terms 29
We need full transparency
21
We need to be able to see it and
tune it ourselves 28
0 10 20 30 40
Only the one nave systemSharePoint system
IntranetNon-SharePoint ECM system(s)
Email serverRM system
Imaging systemOther line of business system(s)
Internal social system(s)ERPFinanceManufacturing
Help desksupport systemHR system
Project Management systemCloudSaaS system(s)
CRM systemBIReportsData warehouse
Instant messaging server
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 19
Search and Discovery
- exploiting knowledge m
inimizing risk
Benefits of Enterprise SearchGiven that many search projects are triggered by a senior management initiative to improve decision-making it is no real surprise that only 14 needed to make a financial business case compared to 31 who made a case from general benefits For 45 there was no need to make a specific case ndash either the tools were included as part of an ECM product or they are considered to be part of the IT infrastructure
Figure 22 Were you required to make a business case for your investment in dedicated search (N=141 Excl 41 Donrsquot Know)
In support of those executives who took the initiative improvement in the quality of decision-making comes out as the top benefit from users of advanced or dedicated search products This is closely followed by faster and more accurate customer service a key attribute of success in these days of multi-channel customer engagement Helping knowledge workers do their jobs is evidenced by a reduction in complaints about findability across the IT estate and as we will see in the next section improving productivity in the legal department can make a substantial contribution to ROI
Figure 23 What would you say have been the three biggest benefits from your investment in search technologies (N=150 users)
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 20
Search and Discovery
- exploiting knowledge m
inimizing risk
As we have seen search tools can vary in price depending on their capability and the extent to which they are bundled with ECM systems They also need a certain amount of resource to install and tune When asked how long it has taken to recoup the initial investment 42 of respondents considered they had payback within 12 months ndash a single budgeting period Nearly two-thirds balanced their initial outlay within 18 months These results indicate a relatively fast and assured return on investment although the 9 posting more than 3 years indicates that not all projects are a success ndash as might be predicted by the lack of planning support and optimization we have seen earlier in the report
Figure 24 How long would you say has it taken you or is likely to take you to recoup your investment on enterprise search based on the overall benefits
(N=69 Excl 114 Donrsquot Know or Too Early to Say)
62 are seeing ROI in 18 months or less The biggest benefits are quality of decision-making response to customers and productivity of knowledge workers
DiscoveryldquoDiscoveryrdquo suggests a formal search to identify content and documents that relate to a particular incident case customer contract or intellectual property It can be much broader than ldquolegal discoveryrdquo and can also be part of an audit procedure to identify any non-compliant behavior confidentiality breaches or fraud Indeed internal compliance audits for things such as money laundering price-fixing mis-selling etc are slightly more prevalent overall (50) than pre-trial legal discovery (44)
However given the differences in the legal systems it is no surprise that in the US pre-trial discovery tops the list at 52 followed by internal audits at 49 In the UK which has a similar legal regime pre-trial is equal share with internal compliance and regulatory (all at 30) whereas in continental Europe regulatory investigations tops out at 45 then internal audit (41) and then pre-trial (32) Court requests for documents is also much higher in the US at 40 more than twice as much as in Europe
Discovery for freedom of information requests tops the list for local and national government organizations although surprisingly litigation requests also feature quite strongly especially for local and state government
0 10 20 30 40
Purchase standard connectors from vendor
Purchase customized connectors from vendor
Have customized connectors developed by3rd party
Develop connectors in-house using APIs
Develop connectors in-house using OpenSourceCMIS
Acquire connectors as part of big datacontent analycs tools
0 5 10 15 20 25 30 35
Yes a financial case
Yes in general business benefits
Yes specifically for legal discovery
Yes specifically for Freedom of Informaonprocessing
Yes as part of a Big Data project
No - it is considered to be part of theinfrastructure
No - included in our ECM product
0 5 10 15 20 25 30 35 40 45 50
Beer decision-making
Faster and more accurate customer serviceresponse
Fewer complaints from knowledge workers
Faster and more efficient legal discovery
Improved research project and case outcomes
Simpler more natural querying
Faster compliance and financial audits
Turned our email archives from a liability to anasset
Faster and more compliant FOI process
6 months 22
12 months 20
18 months 20
2 years 22
3 years 7
More than 3 years 9
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 21
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 25 Do you deal with discovery requests for any of the following situations (N=239 Excl 25 Donrsquot Know)
Picking up specifically on legal discovery and using the terminology of the US FRCP ruling for ldquoElectronically Stored Informationrdquo or ESI we asked how our respondents would identify potentially relevant documents A worrying 28 have no policy or precedent for discovery requests (including 19 of US organizations) and a further 13 (12 US) have a policy that does not cover electronic documents or records
Only 23 are set up for any degree of efficient discovery through one-stop enterprise search or specialized e-discovery products
Figure 26 How do you (or would you) identify potentially relevant documents ESI (N=225 Multiple Excl 35 Donrsquot Know)
HoldThe next step in the discovery process after the initial trawl is to set a hold on those items found to prevent them being deleted or changed during the review process Perhaps even worse than those 28 who admit to having no policy or process for hold are the 29 who rely on instruction to the content owners not to delete ndash not exactly a robust and defensible policy Even amongst the largest organizations 16 have no policy and 39 rely on non-delete instructions 24 have a manage-in-place or dedicated hold mechanism and this is consistent across all sizes
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 22
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 27 How do youwould you set legal-hold (deletion-prevention) on the results of your discovery search (N=225 Multiple Excl 35 Donrsquot Know)
Email Search and HoldEvidence derived from email is now ubiquitous across both civil and criminal cases but there are three big issues retention search and contextual hold Too many organizations ndash 35 in our survey ndash admit that their email retention policies and practice are insufficient to ensure reliable discovery and hold This even holds true for 30 of the largest organizations And 28 are reliant on manual search and hold within the email client which would likely need to be done on an employee-by-employee basis Only 44 have hold in their email archive RM system or e-discovery system and even then great care is needed to preserve the metadata the attachments and the context of conversation strings
Figure 28 How do youwould you run discovery search-and-hold across your email systems (N=282 Multiple)
For legal hold 29 are reliant on users obeying instructions not to delete 35 admit their email management is so ad hoc that discovery and hold is likely to be unreliable
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
0 10 20 30 40 50 60
Internal compliance audits
Pre-trial legal discovery
Financial audits
Regulatory invesgaons
Court requests for documents
Freedom of Informaon requests
Patent cases
None of these
0 10 20 30 40 50
We have no declared policy or precedentfor this
We have a long-standing policy but it isntup-to-date with electronic content
Manual search across a mixture of paperand electronic content
Individual search within each repository
One-stop enterprise search acrossmulple repositories
Specialized e-discovery product
Custom-built e-discoveryhold mechanism
0 5 10 15 20 25 30 35
No policy or process
We instruct content owners not to delete
We manually move them to a secure area
We manually flag them in-place for non-deleon
Our ECMRM system has manage-in-placeacross mulple repositories
Custom built e-discoveryhold mechanism
Our searchdiscovery tool has the ability toput them on hold
0 5 10 15 20 25 30 35 40
Our email retenon is somewhat ad hocso results are unreliable
Search within the mail client but withmanual holds
Search within a dedicated email archivebut search and hold is limited
Search and hold in our dedicated emailarchive
We archive our important emails to ourECMRM system and can hold there
Dedicated searche-discovery system thatconnects to our email repositories
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 23
Search and Discovery
- exploiting knowledge m
inimizing risk
WorkflowBeyond search and hold the legal discovery process will require a number of distillation and review processes This is the province of dedicated e-discovery products and inevitably these are more popular with large organizations (22) with almost no adoption by under 500-employee companies Some ECMRM systems offer specific modules to address this workflow as do some enterprise search products but overall 74 of organizations rely on a manual process to manage discovery
Figure 29 Do you have an e-discovery or litigation module or product to manage the downstream process (N=186 Excl 75 Donrsquot Know)
Predictive CodingThe latest automation technique that is attracting much interest in the legal profession is predictive coding also known as technology assisted review or simply content analytics This is where seed documents are used to train the search or analytics engine in order to automate the early assessment stages in the legal review process As long as performance is acceptable ndash procedurally andor by results - this can be a huge productivity improvement for legal case management This is obviously early days with only 18 using and 7 planning an investment in these tools but the results are encouraging
Figure 30 Do you use technology-assisted review predictive coding or content analytics to speed up the early assessment review or targeted collection stages
(N=190 Excl 73 Donrsquot Know 76 No)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 24
Search and Discovery
- exploiting knowledge m
inimizing risk
Opinions and SpendThere is a considerable degree of concern amongst our respondents that the content explosion is threatening the whole concept of compliant e-discovery with 47 feeling that it is becoming near impossible due to the proliferation of cloud and mobile content repositories For email in particular 47 feel that their policies and mechanisms are putting their organizations at risk
Given that those who responded to our survey have by implication an interest in search 53 agree that their employees can find external information more easily than information that the organization owns although 25 disagreed with that Much more unanimous was the 65 who agree that employees struggle to search and access information from mobile devices compared to 13 who disagree
A startling 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo and 60 feel that the only way to make content more findable is by using automated analytics tools to improve classification and tagging
Figure 31 How do you feel about the following statements (N=239 neutrals aligned around zero Balance of pink and blue reflects breadth of opinions)
SpendFigure 32 shows a healthy view of spend intentions with growth in all areas except dedicated search-server boxes and locally developed Open Source (albeit that the actual spend on Open Source licenses will be very low) The overall biggest spend area is ldquoadvanced search capability from our ECM vendorrdquo with a net 12 planning increased spend here and Cloud SaaS applications is a growing area for a net 9 of organizations
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 25
Search and Discovery
- exploiting knowledge m
inimizing risk
Figure 32 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last 12 months (N=239 line length indicates ldquoWe donrsquot spend anything on thisrdquo Balance of pink and blue reflects disparity)
In Figure 33 we show the net of organizations planning to spend more less those planning to spend less Here big data and content analytics tools are high on the shopping list (net 19) followed by mobile device applications (net 16) As we saw earlier many organizations have plenty of isolated search tools but are looking to consolidate them into a single enterprise search portal or application
Figure 33 How do you think your organizationrsquos spending on the following products and applications in the next 12 months will compare with what was actually spent in the last
12 months NET (N=239 net of ldquoMorerdquo minus ldquoLessrdquo)
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Yes as a dedicated e-discoverylegalcase-process product 10
Yes as part of our ECMRM system 9
Yes as part of our FOI case processing
system 2
Yes as part of our search product
3
Yes as an in-house custom
development 3
No Manual process 74
0 2 4 6 8 10
Yes ndash very successfully
Yes ndash itrsquos helping
Yes ndash early days
Planning in 12-18 months
Early Assesment
Targeted Collecons
-40 -20 0 20 40 60 80
The proliferaon of cloud share and collaboraon appspersonal note systems and mobile devices is making
universal search and compliant e-discovery nearimpossible
Search e-discovery and legal hold across our emailarchives is unreliable and exposes us to risk
Our employees can find informaon from outside ofthe organisaon far more easily than the informaon
we own
Most of our employees struggle to search and accessinternal informaon from mobile devices
Our legal discovery procedures are ad hoc manualdisrupve and expensive
The only way to make our content more findable is touse automated analycs tools to improve classificaon
and tagging
Strongly disagree Disagree Neither agree nor disagree Agree Strongly Agree
Advanced search capability from our ECM vendor
On-server search applicaon outside of ECM
Consolidang mulple tools to a single enterprisesearch
Dedicated search-server box
Locally developed Open Source search capability
CloudSaaS search
Mobile device search apps
Connector purchasedevelopment
Visual discoveryimage search
Big Datacontent analycs tools
Less Same More
-5 0 5 10 15 20 25
Big Datacontent analycs tools
Mobile device search apps
Consolidang mulple tools to a singleenterprise search
Advanced search capability from our ECMvendor
CloudSaaS search
Connector purchasedevelopment
On-server search applicaon outside of ECM
Visual discoveryimage search
Dedicated search-server box
Locally developed Open Source searchcapability
-40 -30 -20 -10 0 10 20 30 40
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 26
Search and Discovery
- exploiting knowledge m
inimizing risk
Conclusion and RecommendationsDespite the acknowledged importance of search to knowledge worker productivity more than half of the organizations surveyed show little maturity in their approach with no strategy no allocated budget and no identified owner Although search is often provided as part of an ECM system (including SharePoint) 40 have not extended their search beyond the native repository In addition many organizations have multiple search products dedicated to specific applications or departments These could usefully be consolidated into a single dedicated search tool Only 11 consider they have an enterprise search capability There is some support for a combined approach to search and content analyticsbig data
Of those who have advanced or dedicated search half have either not tuned or optimized it at all or set it up on installation but havenrsquot optimized it since A quarter have no dedicated or trained staff and a further quarter allocate less than half an FTE to search support despite the fact that for many the tool is available for all staff across the business and is the main knowledge access tool Very few businesses have extended search access to mobile devices as yet
The biggest benefits from search tools are better decision making and faster and more accurate response to customers Knowledge worker satisfaction and productivity is also much improved Overall ROIs are in the 12 to 18 month timeframe
Search across emails is one of the biggest requirements often driven by legal discovery and yet very few organizations have a reliable search and hold capability within email Provision of legal discovery tools is sparse and is confined to the largest companies Manual methods prevail and 52 agree that their discovery procedures are ldquoad hoc manual disruptive and expensiverdquo
Automation using content analytics is attracting much interest in legal departments with 25 using or planning to use predictive coding or technology-assisted review
Recommendationsn Set out a strategy for search that recognizes its importance for both information exploitation and
information governance
n Agree where responsibility for search should lie If you have an Information Governance Committee or Chief Information Officer ensure that search is on their agenda perhaps by creating a Knowledge Management Steering Group ndash or consider creating a Head of Knowledge Management
n Audit existing search tools within the organization Establish what specific search needs there are within each department and how well they are being met
n Evaluate the search capability of your ECM system(s) and whether they can be optimized or tuned for better results
n Look to connect your ECM system search to other repositories to provide a single-point search portal
n If your ECM system does not provide a strong search tool is not readily extensible to other repositories cannot support mobile access or does not provide the transparency and tunability you need make the business case for a dedicated search product
n If you do not have the in-house expertise to support and tune your chosen search tool(s) consider specific training or help from a specialist consultancy
n Include end-user training in search techniques in order to maximize the benefits from your search tools
n Evaluate your ability to respond in a timely manner to a legal-discovery FOI compliance or audit request across the relevant repositories particularly email
n Ensure that you have a robust hold mechanism across each repository and look at your IT support for the downstream review process
n Consider specific e-discovery or litigation management products to manage the workflow for pre-trial Look to use content analytics or predictive coding to speed up the review cycle
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 27
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 1 Survey Demographics
Survey Background415 individual members of the AIIM community took the survey between Jul 11 and Aug 02 2014 using a Web-based tool Invitations to take the survey were sent via email to a selection of the 80000 AIIM community members
Organizational SizeSurvey respondents represent organizations of all sizes Larger organizations over 5000 employees represent 30 with mid-sized organizations of 500 to 5000 employees at 35 Small-to-mid sized organizations with 10 to 500 employees constitute 35 Respondents from organizations with less than 10 employees and suppliers of ECM products and services have been eliminated from the results taking the total to 353 respondents
Geography67 of the participants are based in North America with 18 from Europe and 15 rest-of-world
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 28
Search and Discovery
- exploiting knowledge m
inimizing risk
Industry SectorLocal and National Government together make up 29 Finance and Banking 15 Energy Oil and Gas 8 Other sectors are evenly split
Job Roles29 of respondents are from IT 43 have a records management or information management role and 27 are line-of-business managers
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
11-100 emps 14
101-500 emps 21
501-1000 emps 11
1001-5000 emps 24
5001-10000 emps 10
over 10000 emps 20
US 55
Canada 12
UK Ireland 10
Mainland Europe 8
Australasia 7
Middle East Africa SAfrica
4
Asia Far East 3 Central
SAmerica 2
Government amp Public Services -LocalState 18
Government amp Public Agencies - NaonalInternaonal 11
Finance Banking Insurance 15
Energy Oil amp Gas Mining 8IT amp High Tech -
not ECM 6
Telecoms Water Ulies 6
Consultants 6
Manufacturing Aerospace Food
Process 5
Educaon 4
Retail Transport Real Estate 4
Document Services Provider 3
Healthcare 3
Legal and Prof Services 3
Engineering amp Construcon 2
Life Science Pharmaceucal 2
Non-Profit Charity 2
Media Entertainment Publishing 1 Other 4
IT staff 15
Head of IT 2
IT Consultant or Project Manager
12
Records or document management staff
24
Head of records compliance info
management 19
Line-of-business execuve
department head or process owner
8
Business Consultant 7
Intranet Manager Internal PR
Comms Director 3
President CEO Managing
Director 2
Legal Corp Counsel Corp Compliance 2 Other 5
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 29
Search and Discovery
- exploiting knowledge m
inimizing risk
Appendix 2 General Comments
Do you have any general comments to make about your enterprise search and discovery experiences (Selective)
n Our company utilizes the ldquoshoe boxrdquo style of document retention - Everything has been thrown into the box and if we need it - somebody looks for it
n Most senior managers do not yet recognize that enterprise search amp discover is not simply a matter of purchasing a software solution off-the-shelf Need much greater appreciation for the social amp organizational aspects than the technical capabilities
n We donrsquot want to spend time for manual classification or indexing
n It has not been a priority in spite of it coming up repeatedly as a pain point The upfront work needed to execute a good solution is costly and resource intensive IT does not want to own it but neither does anyone else
n One of the biggest complaints by our users is that they ldquoCanrsquot find anythingrdquo Improving search must involve a combination of technology with an understanding of the role of taxonomy and consistent metadata application across repositories
n We need to unify our search across repository boundaries as well as implement a Document Retention Strategy
n There has been recent recognition by our Executive Level Management team that we are in a very poor position in regards to search and discovery across the organization It has been placed in the Strategic Plan as an area which must be improved and receive financial support
n Complexity of enterprise search is underestimated Small projects given to project managers lacking empowerment yield local results only non-existent strategy and lack of willingness to pay
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 30
Search and Discovery
- exploiting knowledge m
inimizing risk
UNDERWRITTEN IN PART BY
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
With Iron Mountain Records Management services yoursquoll have the resources you need to effectively store and safeguard your information assets By leveraging our proven capabilities and best practices yoursquoll be able to
Keep it safe Employ storage processes designed to protect your critical records from a myriad of internal and external threats
Get it when you need it Classify store and track your records online following proven best practices so yoursquoll be able to retrieve a particular piece of information as efficiently as possible
Manage with experience Leverage the insights and expertise needed to maximize scarce resources and make records management a seamless extension of your everyday operations
wwwironmountaincom
About Iron Mountain
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
Industry
Watch
copy2014 AIIM - The Global Community of Information Professionals 31
Search and Discovery
- exploiting knowledge m
inimizing risk
Learn how to combine content analytics collaboration governance and processes with anywhere anytime access to deliver value to your customers partners and employees
AIIM Enterpise Content Management (ECM) Resource Centre
wwwaiimorgResource-CentersEnterprise-Content-Management
AIIM (wwwaiimorg) AIIM is the global community of information professionals We provide the education research and certification that information professionals need to manage and share information assets in an era of mobile social cloud and big data
copy 2014AIIM AIIM Europe1100 Wayne Avenue Suite 1100 The IT Centre Lowesmoor WharfSilver Spring MD 20910 Worcester WR1 2RR UK+1 3015878202 +44 (0)1905 727600wwwaiimorg wwwaiimeu
top related